GAVI Alliance Evaluation Ad visory Committee Meeting, 19 January 2010 FINAL MINUTES

GAVI Alliance Secretariat, 2 March 2010 1


GAVI Alliance Evaluation Advisory Committee M eeting
19 January 2010
Geneva, Switzerland

FINAL Minutes

Finding a quorum of members present 1, the meeting commenced at 9.05 Geneva time on 19
January 20 10 .
1 Welcome and Expectations
Julian Lob -Levyt, CEO , thanked the participants noting that although GAVI has performed
evaluations in the past , they were not as deliberately planned. He welcomed this opportunity
to implement , with strong Board oversight and support , a more structured evaluation
framework to examine GAVI?s overall strategy and implementation approaches. He
expressed the belie f that this shall support organisational learning and lead to improved
performance. Discussion followed:

? It is understood that the Evaluation Advisory Committee report s to the Board and its role
is to provide independent, expert input retrospective ly on past evaluation s and
prospective ly on the development of future evaluations as well as on M onitoring and
Evaluation (M /E ) policy and frameworks (Doc #1 in the committee pack) . The
Committee will not involve itself in management tasks best suited for the Secretariat .

? Whil st the Comm ittee will not set policy , it will play a critical role in strategically informing
the deliberations of the Board , including by ensuring that reviews and evaluations
commissioned by the Secretariat are adequately designed, appropriately conducted and
meet accepted standards for quality.

? Some of the key topics the Committee may deliberate on from time to time include:
o Metrics to accurately a nd effectively measure country -level performance of GAVI
programmes
o Partner accountability for delivery
o Evaluation of market impact to ensure sustainable introduction of vaccines (including
assessment of procurement practice and principles)
o Criteria to measure the added value of the Alliance
o The extent to which GAVI remains ?country driven? as opposed to ?top -dow n?
organisation
o Possible steps that can allow countries to engage more meaningfully with GAVI with
regard to monitoring and evaluation
2 Introduc tion and Overview
Nina Schwalbe, Managing Director of Policy and Performance , reviewed the mission, goals,
objectives and new governance structure of the GAVI Alliance . She also gave an overview
of the evaluation framework (Doc #2) Discussion followed:
? Un der the previous system, accountability was complicated by GAVI?s management of
three separate streams of financing (vaccines and health systems support , partner
funding , and separately budgeted administrative spending ). In 2010, GAVI is moving
1 Attendees are listed in Attachment A.

GAVI?Board ?Evaluation ?Advisory ?Committee? Teleconference ?
5?October? 2009? ?
?
?
ATTENDANCE :??Committee ?Members ?Present :? Zenda ?Ofir, ?Bernhard ?Schwartl?nder,? Minister?Richard ?Sezibera, ?George ?
Wellde ?
Committee ?Members ?Absent
:? Yoka ?Brandt, ?George ?Pariyo,? Helen?Rees?
GAVI ?Secretariat ?Members? Present
:?Abdallah?Bchir, ?Peter ?Hansen, ?Elodie ?Sarreau, ?Nina ?Schwalbe ?
?
?
AGENDA?ITEMS??
1. Selection ?of ?chair ?
2. Review ?of ?process ?for ?selecting ?bidder? for?Second ?GAVI ?Evaluation ?
?
?
?
1. Selection ?of ?chair ?
?
Bernhard ?Schwartl?nder ?was ?nominated ?and ?unanimously ?elected ?as? chair ?of ?the ?committee. ????
? 2. Review ?of ?process ?for ?selecting ?bidder? for?Second ?GAVI ?Evaluation
?
? The?committee? concluded?that ?the ?process ?undertaken ?by ?the ?GAVI? Secretariat ?to ?select ?the ?bidder ?for ?the ?Second ?
GAVI ?Evaluation ?was ?sound ?and ?endorsed? the?selection ?of ?the ?bidder. ???
?
3. Committee ?feedback ?on? proposal ?and ?selection ?process
?
?
The ?committee? noted?the ?following ?points ?of ?follow ?up: ?
?
? Some ?members? of?the ?evaluation ?consortium ?selected ?as? the ?winning? bidder?have ?previous ?experience ?
working ?with ?GAVI. ??Their ?role ?should ?be ?watched ?carefully, ?and ?their ?previous ?experiences ?should ?not ?
compromise ?their ?objectivity? or?independence. ??
?
?
The ?extent ?of ?country ?participation ?in? development ?of ?the ?proposal? appears?to ?be ?minimal ?and ?the ?role? of?
developing ?country? partners ?in? the ?implementation ?of ?the ?evaluation ?is ?not? clear. ??In?contract?
negotiations, ?the ?role ?of ?developing ?country ?partners ?should ?be ?clarified ?and ?strengthened.?
?
?
The ?budget ?of ?the ?winning ?bidder, ?in ?particular ?the ?professional? fees?of ?some? members? of?the ?consortium, ?
should ?be ?justified ?by ?the ?consortium.?? The?GAVI ?Secretariat? should?negotiate ?carefully ?with ?the ?
consortium ?on ?matters? pertaining ?to ?the ?budget. ??
?
?
The ?lack ?of ?reference ?to ?a ?theory ?of ?change ?in ?the ?terms ?of ?reference ?and ?submitted ?proposal? is?a ?missed ?
opportunity. ??Counterfactuals ?can ?be ?helpful, ?but? they ?have ?serious ?limitations. ??If?the ?programme ?or ?
organisation ?being ?evaluated ?has ?a ?clear ?theory ?of ?change, ?this ?represents ?an ?important ?frame ?of ?
reference ?for ?evaluation.
?
?
The ?criteria ?used? to?score ?the ?proposals ?(but ?not ?the ?scores ?reported ?by ?individual ?members ?of ?the ?
adjudication? committee)?should ?be ?included ?with ?the ?documentation? on?the ?selection ?process ?compiled ?
by ?the ?GAVI ?Secretariat. ??
?
?
As ?part ?of ?its ?regular ?reporting ?to ?the ?GAVI ?Secretariat, ?the ?evaluators ?should ?provide ?their ?own ?
assessment ?of ?the ?quality ?of ?the ?evaluation ?and ?associated ?data ?and ?methods. ??In? particular, ?the ?

Evaluation Advisory Committee Meeting
5 July 2012
EAC -2012 -Mtg -3a 1




GAVI Alliance Evaluation Advisory Committee Meeting
5 July 2012
Geneva, Switzerland


FINAL MINUTES


1. Chair?s report

1.1 Finding a quorum of members present, the meeting commenced at 09.45
Geneva time on 5 July 2012. Sania Nishtar , Committee Chair, participating by
videoconference, chaired the meeting. Rob Moodie co -chaired.

1.2 Standing declarations of interest were tabled to the Committe e (Doc 1a ). Alan
Hinman noted that the Novartis research grant reported was for rabies rather
than measles.

1. 3 The Committee noted the minutes of its meeting of 19 -20 January 2012 in
Geneva (Doc 1b) and its teleconference of 13 February 2012 (Doc 1c) .
The se minutes were approved by no objection on 23 April 201 2.

1.4 The Chair updated the EAC on the GAVI Alliance Board meeting which had
taken place in Washington D.C. in June 2012 and at which she had reported
on the activities of the EAC. The Board had approved the Evaluation Policy
and considered the EAC engagement with the evaluation of GAVI support to
CSOs as quite productive. She had updated the Board on the EAC?s role in
reviewing and approving the Request for Proposals for the Advance Market
Commit ment for Pneumococcal Vaccine Process and Design Evaluation , as
well as the process in relation to the Full Country Evaluations.

1.5 During a short meeting with Dagfinn H ?ybr ?ten, GAVI Alliance Board Chair,
the EAC Chair had briefly discussed the w ork of the EAC feeding into policy
as well as the changing landscape of health with respect to the post MDG
landscape. A short discussion on the latter is recorded under Item 9.

--- ---

2. Update from the Secretariat

2.1 Nina Schwalbe, Managing Director, Policy and Performance, reported to the
EAC that the Secretariat has been working on updating the mission indicators
and that the Board has been provided with progress reports on Key
Performance Indicators and the GAVI All iance risk register.

GAVI Alliance Evaluation Advisory Committee Meeting, 2 June 2010 FINAL MINUTES


1

GAVI Alliance Evaluation Advisory Committee Meeting
2 June 2010
Teleconference

FINAL MINUTES

Finding a quorum of members present 1, the meeting commenced at 15.15 Geneva
time on 2 June 2010.

Given the length of the documents, the Chair of the Evaluati on Advisory Committee
(EAC) propose d that each committee member review the main report and the report
from one of the four strategic goals, along with their fellow committee member as
indicated.

? Strategic Goal 1: Sania Nishtar and Bernhard Schwartlander
? Strategic Goal 2: Stan Foster and Ken Hill
? Strategic Goal 3: George Wellde and Gonzalo Hernandez
? Strategic Goal 4: Minister Sezibera and Zenda Ofir

The Committee Chair suggested focusing on the following questions:
1. To what extent is there adequate descrip tion of the methods used in the
evaluation study?
2. To what extent is there adequate identification and assessment of the
limitations and potential sources of bias in the evaluation study?
3. To what extent do the reports adequately address the study?s defined
evaluation questions?
4. To what extent are the conclusions substantiated by the evaluation?s findings,
and supported through sound and transparent application of appropriate
evaluation methods?

Discussion followed:
1 IFFIm Evaluation

? It was noted that the report for Strategic Goal #3 contains an extensive
discussion of the IFFIm and AMC . The Secretariat is prepared to go to tender
with a Request for Proposals for an evaluation of the IFFIm once the steering
committee for this evaluation is convened and app roves the terms of
reference.

? Although the p reliminary draft report from the Second GAVI Evaluation is not
complete , the section on the IFFIm is almost final. W e could therefore
compare what is addressed in the Second GAVI Evaluation vis -a-vis IFFIm
wit h what we want to get out of the IFFIm evaluation as per the draft ToRs .
The EAC could then ask the IFFIm donors and other stakeholders whether we
have already learned what we wanted to learn about the IFFIm and, if not,
whether the best way to address ou tstanding questions related to the IFFIm is
1 Attendees are listed in Attachment A.

GAVI Alliance Evaluation Advisory Committee Meeting, 20 -21 January 2011 FINAL MINUTES

EAC -2011 -Mtg -1 1




GAVI Alliance Evaluation Advisory Committee Meeting
20 -21 January 2011
Geneva, Switzerland


FINAL MINUTES

1. Welcome , introduction and Secretariat update

Finding a quorum of members pre sent, the meeting commenced at 9. 10 on 2 0
January 2011 . Bern hard Sch wartl? nder chaired the meeting. The Chair welcom ed
the participants (including Sania Nishtar via video conference from Pakistan) and the
Committee agree d to some changes to the agenda . The Chair then welcomed the
acting GAVI CEO, Helen Evans, and invited her to update the Committee on key
developments within the GAVI Alliance.

Ms Evans briefed the Committee on several issues including :

? The GAVI Alliance strategy and business plan for 2011 -15

? The recruitment of a new CEO, recent installation of a new GAVI Alliance
Board Chair and the replenishment process for the GAVI Alliance

? The recent launch of pneumococcal vaccine in Nicaragua , the p lanned launch
in Kenya and the recent launch in Burkina Faso of the va ccine to prevent
Meningitis A

? Progress in co -financing , implementation of the Health Systems Funding
Platform , and the sta tus of the call for new vaccine applications

? The role that the Second GAVI E valuation would have in the April 2011 GAVI
Alliance Board retreat


2. Approval of Minutes

The Minutes from the Committee?s last meeting on 29 June 2010 were approved
with the following amendments:

? On page 2 (section 3, 4 th bullet) , in addition to the survey instruments listed
from DHS and UNICEF , GAVI should also include the World Bank?s Living
Standards Measurement Study .

Evaluation Advisory Committee Meeting
19-20 January 2012
EAC -2012 -Mtg -1 1




GAVI Alliance Evaluation Advisory Committee Meeting
19-20 January 2012
Geneva, Switzerland


FINAL MINUTES


Introduction and welcome

Finding a quorum of members present, the meeting commenced at 9.00 Geneva
time on 19 January 2012 . Sania Nishtar, Committee Chair , chaired the meeting.

Seth Berkley, CEO of the GAVI Alliance, welcomed the Committee, highlighting the
issues that they would be discussing during this meeting and stressing in particular
their important role in the Fu ll Country Evaluation process. He gave an overview of
the decisions made by the GAVI Alliance Board a t its meeting in November 2011
and indi cated that there are a number of related issues which will be brought to the
EAC in the future.

----- -

1. Chair?s report

1.1 Standing declarations of interest were tabled to the Committee (Doc #1a ).
Alan Hinman indicated that although he did not have a Conflict of Interest he
would recuse himself from the discussion on the CSO Evaluation under
Agenda Item 5 .

1.2 The Committee noted the minutes of its meeting of 13 -14 S eptember 2011 in
Geneva (Doc #1b). The se minutes were approved by n o objection on 12
December 2011.

--- ---

2. Update from the Secretariat


2.1 Peter Hansen, Director of Monitoring & Evaluation , presented information on
the outcome of the GAVI Board meeting held in Dhaka, Bangladesh, in
November 20 11 and an update on monitoring and evaluation activities, in
particular in relation to routin e programme monitoring and targeted studies.

Discussion

Evaluation Advisory Committee Meeting
13 February 2012
EAC -2012 -Mtg -2 1



GAVI Alliance Evaluation Advisory Committee Meeting
13 February 2012
Teleconference

FINAL MINUTES


Introduction and welcome

Finding a quorum of members present, the meeting commenced at 13.11 Geneva
time on 13 February 2012 . Sania Nishtar, Committee Chair , chaired the meeting.

----- -

1. Full country evaluations

1.1 Peter Hansen, Director of Monitoring & Evaluation, presented an update on
developments since the last meeting , in particular discussions with UNICEF
and WHO in relation to their possible contribution to the Full Country
Evaluation process. Both organisations have shown interest in participating
through an nual surveys and health facility assessment respectively . It will
however not be possible to get their commitment in writing before the RFP is
published.

1.2 Peter Hansen highlighted the changes made to the RFP since the last
meeting .

1.3 The Committee discussed the new RFP and proposed further revisions.

---- --

Decision One

The GAVI Evaluation Advisory Committee :

? Requested the Secretariat to issue a revised RFP taking into account the EAC
comments .

---

As there was no further business, the meeting was brought to a close.


__________________________
Ms Debbie Adams
Secretary to the Board

M
i
n
u
t
e
s

G
a
v
i
A
ll
i
a
n
ce
E
v
a
l
u
a
t
i
o
n
A
d
v
i
s
o
ry
C
o
m m
i
t
t
e e
M
e
e
t
i
n
g

1
5
-
1
6
M
a
r
c
h
2
0
1
7

G
a
v
i
A
lli
a
n
ce
,
G
e
n
e v
a
,
S
w
i
t
z
e
r
l
a
n
d

1
.
C
h
a
i
r
'
s
r
e
p o
rt

1
.
1
T
h
e
m
e
e
t
i
n g
c
o
m m
e
n
c
e
d
a
t
0
9
.
0
5 G
e
n
e
v
a
t
i
m
e o
n
1
5
M
a
r
c
h
2
0
1
7
.
R
o
b
M
o
o
d
i
e
,

E
v
a
l
u
a
t
i
o
n
C
o
m
m
i
tt
e
e
C
h
a
i
r
,
c
h
a
i
r
e
d
t
h
e
m
ee
t
i
n
g
.

1
.
2
S
t
a
n
d
i
n g
d
e
c
l
a
r
a
t
i
o
n
s
o
f
i
n
t
e
r
e
s
t
w
e
r
e
ta b
l
e
d
t
o
t
h
e
C
o
m
m
i
tt
ee
(
D
o
c
0
1
a
)
.
l
t
w
a
s

n
o
t
e
d
t
h
a
t
N
i
n a S
c
h
w
a
l
b e
h
a
d
a
c
o
n
t
ra
c
t
u
a
l
o
b
li
g
a
t
i
o
n
for
c
o n
s
ul
t
a n
c
y s
e
rv
i
c
e
s

fo r
t
h
e
C
o
un
t
ry
P
r
o
g
r
a
m
m
e
s
te
a
m
,
w
h
i
c
h
d
i
d
n
o
t
r
e
p
r
e
s
e
n
t
a
n
y
c
o
n
fl
i
c
t
w
i
t
h
t
h
e

p
r
o
c
e
e d
i
n
g
s
o
f
t
h
e
E
A
C
m
ee
t
in
g
.

1
.
3
C
o
m
m
i
tt
e
e
m
e
m
b
e
r
s
n
o
t
e
d
t
h
e
m
i
n
u
t
e
s
o
f
i
t
s
m
e
e
t
in
g
o
n
4
-
5 O
c
t
o
b
e
r
2
0
1
6

(
D
o
c
0
1
b
)
w
h
i
c
h
h
a
d
b
e
e
n
a
p
p
ro
v
e
d
b
y
n
o
-
o
b
j
e
c
t
i
o
n
o
n
5
D
e
c
e
m b
e
r
2
0
1
6
.

1
.4
T
h
e
C
h
a
i
r
r
e p
o
rt
e
d
t
o
t
h
e
E
A
C
o
n h
i
s
p
a
rt
i
c
i
p a
ti
o
n
a
t t
h
e
G
a
v
i
B
oa
r
d
m
ee
t
i
n
g
i
n

D
e
c
e
m
b
e
r
2
0
1
6
.
H
e
i
n
f
o
r
m
e
d m
e
m
be
r
s
t
h
a
t
h
e
h
a
d
h
a
d
a
n
o
p
p
o
rt
u
n
i
t
y
t
o
m
ee
t

t
h
e
C
h
a
i
r
o
f
t
h
e
P
ro
g
r
a
m m
e and
P
o
li
c y
C
o
m
m
i
t
t
e
e
(
P
P
C
)
,
w
i
t
h
w
h
o
m
h
e
a
g
r
e
e
d

o
n h
a
v
in
g
a
j
o
i
n
t
s
e
s
s
i
o
n
o
f
t
h
e
E
A
C
an
d
P
P
C
i
n
O
c
t
o
b
e
r
.

1
.
5
T
h
e
C
h
a
i
r
w
e
l
c
o
m
e
d
n
e
w
m
e
m
b
e
r
s
o
f
t
h
e
E
A
C
,
n
a
m
e
l
y
A
n
n
a
H
a
m
r
e
ll
,
N
i
n
a

S
c
h
w
a
l
b
e a
n
d
V
iro j
T
a
n
g
c
h
a
ro
e
n
s
a
t
h
i
e n
.

1
.
6
T
h
e
C
h
a
i
r
i
n
fo
r
m
e
d
t
h
e
E
v
a
l
u
a
t
i
o
n
A
d
v
i
s
o
ry
C
o
m m
i
tt
e
e
m
e
m
b
e
r
s
t
h
a
t
i
n
o
r
d
e
r
to
d
e
a
l
w
i
t
h
t
h
e
c
o
m m
e
rc
i
a
l
s
e
n
s
i
t
i
v
i
t
i
e
s
u
n
d
e
r
I
t
e
m
0
7
,
t
h
e
r
e
p
r
e
s
e
n
t
a
t
i
v
e
s
fr
o
m

U
N
I
C E
F
,
W
H
O
and
B
M
G
F
,
w
h
o
h
a
d
b
e
e
n
i
n
v
i
t
e
d
t
o
j
o
i
n
fo
r
t
h
e
F
C
E
a
n n
u
a
l
r
e po
rt

s
e
s
s
i
o
n a
n d
t
h
e
p
r
e
s
e
n
t
a
t
i
o
n
fr
o
m
P
A
T
H
o
n
t
h
e
i
r
t
e
c
h
n
i
c
a
l
p
ro
po
s
a
l
,
w
o
u
l
d b
e

r
e qu
e
s
t
e
d
t
o
l
e a
v
e
t
h
e
m
e
e
t
in g d
u
r
i
n g
P
A
T
H
'
s
p
r
e
s
e
n
t
a
t
i
o
n o
f
t
h
e
fi
n
a
n
c
i
a
l

p
ro
p
o
s
a
l.
P
A
T
H
w
o
u
l
d
t
h
e
n
al
s
o
l
e a
v
e
t
h
e
m
ee
t
i
n
g
s
o
t
h
a
t
t
h
e
E
A
C
c
o n
t
i
n
u
e
s
i
t
s

o
w
n
d
e
l
i
b
e
r
a
t
i
o
n
s
t
o a
r
r
i
v
e a
t
a
d
e
c
i
s
i
o
n
i
n
l
i
n e
w
i
t
h
i
t
s
C
h
a
rt
e
r
.

2
.
U
pd
a
t
e
fr
o
m S
e
c
r
e
t
a
r
i
a
t

2
.
1
S
e
t
h
B
e
r
k
l
e
y
,
C
E
O
,
e
x
p
r
e
ss
e
d h
i
s
a
p p
r
e
c
i
a
t
i
o
n
t
o
t
h
e
E
A
C
fo
r
t
h
e
i
r
w
o
r
k
an
d

h
i
g h
l
i
g
h
t
e
d
t
h
e
i
m
p
o
rt
an
c
e
o
f
e
v
a
l
u
a
t
i
o
n
s
f
o
r
G
a
v
i
,
a
s
i
t
i
n
c
r
e
a
s
i
n
g
l
y
t
r
a
n
s
f
o
r
m
s

i
n
t
o
a
l
e
a
rn
i
n g o
r
g
a
n
i
s
a
t
i
o
n
.
H
e
h
i
g h
l
i
g h
t
e
d
t
h
e
i
m
p
o
rt
a
n
c
e
o
f
b
e
i
n g
a
b
le
t
o
m
e
a
s
u
r
e
a
n
d
l
e a
rn
,
an
d
t
h
e
r
e
b
y
m
a
k
e
e
v
i
d
e
n
c
e
-
b a
s
e
d
d
e
c
i
s
i
o
n
s
.
H
e
n
o
t
e
d
t
h
a
t

t
h
e
m
o
n
i
t
o
r
i
n
g and e
v
a
l
u
a
t
i
o
n
(
M
&
E
)
w
o
r
k
wa
s
n
o
t
a
l
w
a
y
s
v
i
s
i
b
le
a
n
d
r
e
f
e
r
r
e
d
t
o

a
r
e
c
e n
t
d
o
n
o
r
r
e
v
i
e
w
t
h
a
t
h
i
g h
l
i
g
h
t
e
d
a
l
a
c
k
o
f
M
&
E
w
o
r
k
a
t
G
a
v
i
w
h
i
c
h

e
m
p
h
a
s
i
s
e
d
th
i
s
p
o
in
t.

E
A
C
-
2
0
1
7
-
M
t
g
-
0
2

EAC -2017 -Mtg -04
1




G avi Alliance E valuation Advisory Committee Meeting
24 -25 October 2017
Gavi Alliance, Geneva , Switzerland

1. Chair?s report

1.1 The meeting commenced at 09 .05 Geneva time on 24 October 2017 . Rob
Moodie, Evaluat ion Advisory Committee (EAC) Chair , chaired the meeting.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.3 Committee members noted the minutes of its meeting on 29 May 2017
(Doc 01 b) which had been approved by no -objection on 2 August 2017 , as well
as a unanimous consent decision which was approved on 8 June 2017 (Doc 01c) .
They also reviewed the action sheet (Doc 01d).

1.4 The Chair reported to the EAC on his participation at the Gavi Board meeting in
June 2017 . He informed members that he had had an opportunity to meet the
Chair of the Programme and Policy Committee (PPC) , with whom he discussed
the agenda for the joint ses sion of the EAC and PPC , which was to follow the
next day, on 25 October.

1.5 The Chair welcomed the members of the EAC whose membership , effective
1 January 2018 , had been approved by the Board , namely Craig Burgess, and
Mira Joh ri. It was noted that while Craig Burgess was not present, Dr Joh ri was
attending the EAC meeting as an observer. The Chair also welcomed Nick York,
who had chaired the panel that conducted the peer review of the Gavi Evaluation
function, to the meeting.

------

2. Update from Secretariat

2.1 Seth Berkley, CEO, thanked the EAC for its great work and provided an overview
of the key developments in the global landscape.

2.2 Dr Berkley referred to the work recently undertaken by the newly appointed
Director General o f WHO in terms of presenting a bold workplan, with a focus on
Universal Health Coverage (UHC), as well as having announced his new
leadership team. He informed the EAC that WHO had strongly signalled the
importance it gave to collaborating with Gavi on imm unisation.

2.3 He updated the EAC on the work done by the Alliance to ensure that a more
appropriate indicator for immunisation as part of the Sustainable Development
Goals (SDGs) (that factored the coverage of DTP3, last dose of PCV, MR and
HPV2) was recommended by SAGE , which is considering the suggestion .

Minutes

EAC -2018 -Mtg -01
1




G avi Alliance E valuation Advisory Committee Meeting
11 -12 April 2018
Gavi Alliance, Geneva , Switzerland


1. Chair ?s report

1.1 The meeting commenced at 09 .05 Geneva time on 11 April 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 The Committee Chair welcomed new EAC member Craig Burgess whose
membership became effective from 1 January 2018 . Craig is the Alternate Board
member for the Civil Society Organisations (CSO) constituency.

1.3 The Chair extended a particular welcome to Seth Berkley , Gavi CEO and thanked
him for taking time to present to the Committee and share his views on their
meeting agenda .

1.4 The Chair made the members aware that the meeting w ould be recorded to aid
minute taking.

1.5 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.6 Committee members noted the minutes of its joint meeting with the PPC on 24
October 2017 (Doc 01b ) which had been approved by no -objection on 8 February
2018 and the minutes of its meeting on 24 -25 October 2017 (Doc 01 c) which had
been approved by no -objection on 8 February 2018 . The members also noted a
unanimous consent decision which was approved on 1 December (Doc 01d ) and
re viewed the action sheet (Doc 01e ).

1.7 Th e Chair upda ted the Committee on the Gavi Board meeting in V ientiane in
November which included some very fruitful discussions on evaluations. He
reported that t here was a strong conse nsus from the Board around learning and
a strong ap petite to hear about what is and is not working well within Gavi .

1.8 The Chair proposed a short closed session of the Committee members at the end
of the day , as per a request from the Committee at the previous meeting .

------



Minutes

EAC -2018 -Mtg -03
1




G avi Alliance E valuation Advisory Committee Meeting
26 June 2018
Teleconference


1. Chair ?s report

1.1 The meeting commenced at 13.07 Geneva time on 26 June 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting , which was co -
chaired by Mira Johri at the request of the Chair.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

------

2. Review of Evaluation Policy

2.1 Abdallah Bchir, Head, Monitoring and Evaluation, briefly introduced this item,
recalling the process which had been undertaken to develop the proposed revised
Evaluation Policy for review by the EAC (Doc 02).

2.2 Anna Hen ttinen, Peer Review Panel Member, outlined some of the main points
from the proposed new policy - i) it will cover all Gavi evaluations (centralised and
decentralised); ii) it is proposed that the Operational Evaluation Guidance (OEG)
becomes a working manual for all evaluations; iii) ther e is a proposed new process
in relation to quality assurance of Gavi evaluations with the proposed creation of
an independent quality assessment panel (IQAP), managed by the Secretariat
Evaluation Unit, which would review reports before they are presented to the EAC;
and iv) it is proposed that all evaluations would have a Steering Committee (SC)
whose role and scope would depend on each evaluation.

2.3 She also referred to the proposed ethical principles for Gavi evaluations as well as
to the description of the roles and responsibilities of the different actors in Gavi?s
evaluation function .

Discussion

? EAC members expressed concerns around what appeared to be the addition of a
number of layers in the overall process with the introduction the IQAP, and
questioned in particular in relation to the lat ter, what role would remain for the EAC
in relation to qu ality assurance of the evaluations. It was unclear as to what exactly
was meant when it was stated that the EAC would play a more strategic role.

? It was suggested that give n the different size and nature of Gavi evaluations it
might be more appropriate to have a more flexible approach whereby some

Minutes

EAC -2018 -Mtg -04
1




G avi Alliance E valuation Advisory Committee Meeting
16-17 October 2018
Gavi Alliance, Geneva , Switzerland


1. Chair ?s report

1.1 The meeting commenced at 09 .00 Geneva time on 16 October 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 The Chair extended a particular welcome to Anuradha Gupta, Gavi Deputy CEO ,
and thanked her for taking time to present to the Committee and share her views
on their meeting agenda .

1.3 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.4 Committee members noted the minutes of its meetings on 11 -12 April 2018 (Docs
01b and 01c ), 18 May 2018 (Doc 01d) and 26 June 2018 (Doc 01e) which had
been approved by no -objection on 20 June 2018, 9 July 2018 and 23 August 2018
respectively .

1.5 Th e Chair upda ted the Committee on the Gavi Board meeting in Geneva in June
which included some very fruitful discussions on evaluations , and a request from
the Board Chair to have a presentation at the next Board meeting on how
evaluations have been utilised .

1.6 The Chair proposed a short closed session of the Committee members at the end
of the day , as per a request from the Committee at a previous meeting .

------

2. Update from Secretariat

2.1 Anuradha Gupta, Gavi Deputy CEO, started by informing EAC members that at
its meeting the previous week the Governance Committee had agreed to
recommend to the Board that it exceptionally extend Rob Moodie?s term as EAC
chair to end June 2019.

2.2 Ms Gupta recalled that Gavi is nearing the mid -point of its current strategic period
and that it is therefore time to step back and reflect on progress to date.

2.3 She highlighted that there has been a paradigm shift in the way Gavi works and
outlined the four principles that are embedded into Gavi?s approach namely (i)
country -centric; (ii) differentiation; (iii) transparency; and (iv) accountability.
2.4 Ms Gupta i ndicated that Gavi has also been increasing its focus on risk assurance
through its three lines of defence model. In this context, Senior Country Manag ers

Minutes