PADM 5345. Evaluation of International Programs and Projects

2. Determining Objectives, Outcomes and the Output to Make Them Happen and the role of evaluation

29, 31 January 2024

This session will look at how objectives, outcomes and output should be drafted in order to conform with results-based management principles. We will also look at how evaluation functions in the UN system.

While principles are similar, each of the major international organizations has developed its own approach to evaluation. This session will take an overview of these approaches.

The approaches are usually defined by the main tasks of the organizations. Those that are primarily headquarters-oriented or concerned with activities funded from assessed budgets have developed approaches to determine the impact of these. The technical cooperation agencies have developed approaches to country-level evaluation. The development banks have developed approaches that can measure the effectiveness of loans and grants. At the level of the United Nations system, there has been a formal effort at coordination since the mid 1980's, but this has mostly consisted of exchanges of information rather than agreement on standard approaches, although the United Nations Evaluation Group has developed some standards.

Evaluation has taken on an increasing importance in the light of on-going reform efforts, which have emphasized results-based management and accountability.

Questions covered	What are the main policies regarding evaluation? What are the reasons for adopting these policies? How do international organizations differ from each other in their evaluation approaches. How is evaluation an essential elements of results-based management?
Lecture	Lecture dealing with Determining Objectives, Outcomes and the Output to Make Them Happena nd the role of evaluation PowerPoint Presentation given on 29 January
Required readings	RealWorld Evaluation, Chapters 1 and 2 Research Cooperation, Sida, Managing for Results (in Course Canvas), Section II, Programme Planning UNICEF, Revised evaluation policy of UNICEF (E/ICEF/2018/14), 12 April 2018. United Nations, Office of Internal Oversight Services, Strengthening the role of evaluation and the application of evaluation findings on programme design, delivery and policy directives (A/66/71) In the course Canvas UNFCCC, Adoption of the Paris Agreement, 12 December 2015 ECOSOC United Nations Economic and Social Counci : Secretary-General Lays Out Ambitious Pathway for Reforming United Nations Development System, with Firm Commitment to National Ownership at Core Green Climate Fund, About
Recommended readings	The following readings focus on the formal evaluation policies of different organizations. It includes, especially, the integration of monitoring and evaluation into results-based programming and budgeting. (Browse the documents you find most interesting.) United Nations Department of Economic and Social Affairs, Systematic Monitoring and Evaluation of Integrated Development Programmes, (United Nations publication, sales number E.78.IV.11, Chapter 2 United Nations Evaluation Group, Standards for Evaluation in the UN System, 29 April 2005 (Download the document) World Bank Group, Independent Evaluation Group International Atomic Energy Agency, Programme Evaluation Policy (SEC/NOT/1879). CARE International Evaluation Policy UNICEF, Evaluation Report Standards United Nations Development Programme, The evaluation policy of UNDP International Fund for Agricultural Development, Evaluation: About the Office of Evaluation and Studies. Read the sections on "About Evaluation", "Strategy, Process and Methodology" and "Programme of Work". WorldVision, Our Model for Implementing Programs. Evaluation policy of a major NGO in the development and humanitarian relief field
Simulation	The class will discuss the Green Climate Fund on 7 February and determine what are the issues to evaluate in the specific projects. In advance of the session you will be asked to indicate the team for which of the twelve projects we will evaluate you would like to join. You should look at: GCF Projects GCF, About GCF You should explore the Green Climate Fund website: http://www.greenclimate.fund/home To prepare for creating an inception report you should review the UNODC Evaluation Template for Inception Reports found in Canvas. The projects that will be examined are found in a Green Climate Fund Projects folder in the course Canvas. Each team will be supported by one of the teaching assistants.
Discussion questions	You should answer these questions very briefly (one or two sentences) and send these to the Canvas by Sunday, 29 January 2023. What are the best ways to determine objectives, outcomes and desirable output? Why is evaluation an essential component of results-based programming? How can evaluation findings affect the operation of programs and projects? Why is evaluation important for the Green Climate Fund?
Recordings	29 and 31 January 2024 in the course Canvas.

---

© 2003, 2004, 2005, 2024 John R. Mathiason. All Rights Reserved.
Revised: January 17, 2024 .