Our Approach to Evaluation
We evaluate to learn about the landscape, impact, and outcomes of our strategies to keep them dynamically working toward their purpose. We aim to be transparent about how we work, the decisions we make, and the lessons we learn along the way.
Why We Evaluate
We evaluate for learning and to keep our strategies dynamic. At its simplest, evaluation is an ongoing process of information collection at a strategy level that helps us measure progress, learn, reflect, and make informed choices. We value evaluation that recognizes that diversity of thought, sharing knowledge, and including many voices are essential to get at larger truths that help us make informed, long-lasting change.
We believe that our programmatic choices will be most impactful and aligned with our values when we hold ourselves accountable with regular feedback from a range of perspectives—especially external perspectives. So we evaluate our strategies and strategic choices, recognizing that evaluation can broaden our awareness and challenge our assumptions.
Through a close working relationship with program teams, the Office of Evaluation provides information as a resource in support of a program’s decision making for effective stewardship of the Foundation funds. Our evaluation work is guided by our principles: be ambitious, yet realistic, be rigorous and apply logic while staying flexible, prioritize learning and be purpose-oriented, ensure inclusivity and diversity, be ethical and respectful.
Our focus in evaluation is learning—about the landscape in which grantees are working; about the needs of the people in our grantees’ communities; about how we can be a better funder, partner; and supporter of grantees’ work, and about the impact of our grantees’ contributions.
While each area of work may be at a different stage of development, all programs are evaluated. Rather than evaluating individual grants, we focus our efforts on the portfolio and strategy as a whole. Our approach to evaluation focuses on the range of questions that program team leaders have as they make choices around how best to deploy Foundation resources in support of grantees in four areas. Questions depend on the strategy’s intended purpose, but include:
- Landscape: What is the landscape for my program area? How is it changing?
- Feedback: What are we doing well? Where can we improve?
- Outcomes: What progress is evident? With what consequences?
- Impact: How are we contributing to meaningful impact?
We seek to learn whether our strategy is producing significant results or meaningful contributions including assessing the extent to which our work is aligned with our values. We do this by creating dynamic, continuous learning opportunities to ensure we have the inputs we need to understand how best to shift our strategy to further achieve our goals around diversity, inclusion, equity, and impact.
We rely on a variety of sources for input including Board advisors, grantees, external experts, internal advisors, and evaluation and learning partners which we use to improve and hone our strategies and to bring in perspectives beyond our networks to challenge our assumptions. And we aim to be transparent about how we work, the decisions we make, and the lessons we learn along the way. We are committed to sharing the lessons from our evaluations to benefit the field as well as hold ourselves accountable.
How We Use Evaluations
Our focus in our evaluative work is on learning–learning about the landscape in which grantees are working, learning about the needs of the people most affected by the problems that grantees are seeking to solve, learning how we can be a better funder, partner, and supporter of the grantees’ work, and learning about the value-add contributions of our grantees. Working along the arc of our Design/Build framework, evaluation helps us understand changing contexts, challenge our assumptions, assess our effectiveness, measure our contributions, learn from our efforts, and take advantage of emerging opportunities.
While we believe in working dynamically, we do not believe in iterating eternally. Evaluation serves as a continuous input into our work. Further, we use evaluations as part of our Strategy Reviews as a formal institutional moment with our Board to assess our Big Bets against our time-bound intended impacts and our Enduring Commitments, Field Supports, and Awards and Special Projects against our expectations and specified outcomes.
High-level diagram of our Design/Build framework for how we work
Accessible PDF of diagram ›
What Grantees Need to Know
Grantees are an integral voice in determining how we evaluate, what we can learn, and how we understand the value of our work and the contributions of our grantees. We strive to be transparent with our grantees throughout the evaluation process and protect anonymity of input and information from grantees.
We convene grantees regularly to share our evaluative findings, and we also share reports externally via our website and Candid so that the greater public audience is informed of our learnings. We do not evaluate individual grants or investments.
Principles that guide our evaluation efforts include the following:
Be ambitious, yet realistic
- Focus on measuring changes of major significance and value
- Seek to measure long-lasting, not temporary, change
- Prioritize information needs and choose strategically
- Recognize that impact is achieved through the efforts of grantees and others
Be rigorous and apply logic while staying flexible
- Adhere to the highest technical standards
- Use well-vetted theories of change to guide evaluation and learning activities
- Give preference to mixed-methods approaches
- Continuously test assumptions
Prioritize learning and be purpose-oriented
- Endeavor to identify successes and failures
- Encourage critical thinking and reflection
- Keep an eye on the context, and adapt accordingly
- Recognize that evaluation is one part of the decision-making process; it is not the only part
- Never be punitive
- Stay focused on contribution over attribution
Ensure inclusivity and diversity
- Foster collaboration
- Incorporate varying perspectives
- Share findings and recommendations internally and externally
- Demonstrate cultural competence
Be ethical and respectful
- Practice and promote the highest standards of conduct
- Communicate in a constructive, honest, and timely manner
- Be as transparent as possible
- Respect the ideas, time, and resources of others
- Use resources responsibly
- Protect confidentiality and security
- Maximize benefits and avoid harm