CIPA logo

PADM 5345 - Evaluation of International Programs and Projects

6. Obtaining information from surveys

28 February 2024

The most common means of obtaining information from a beneficiary population that is large is a sample survey. These surveys are based on individual interviews, usually with a randomly selected sample of the persons from which information is desired.

Because they are expensive to execute, particularly if probable error is to be reduced, they are used sparingly in practice. However, when the only way to determine whether programs or projects are having an impact, and why, is a survey they can be justified. Means exist to reduce probable error in sampling and to ensure that responses to questionnaires are reliable. The session will deal with some of these issues.

Questions covered

  • What are the main methods for obtaining information from documents?
  • What are the basic requirements for good content analysis?
  • How can validity and reliability be ensured in analyzing documents.

Lectures

Required readings

  • Bamberger and Mabry, Chapters 12-15

·       The other readings focus on the formal evaluation policies of different organizations. It includes, especially, the integration of monitoring and evaluation into results-based programming and budgeting.

United Nations Department of Economic and Social Affairs, Systematic Monitoring and Evaluation of Integrated Development Programmes, (United Nations publication, sales number E.78.IV.11, Chapter 2

William B. Trochim, "Sampling" in Research Methods Data Base.

Recommended readings

Simulation

  • Because of February break, there will be only a partial simulation during the session.  However, each of the teams should indicate how they would design a sample for a survey in their area and prepare a draft questionnaire. This should be put in the Canvas, by Wednesday, 5 March 2024.

Discussion questions

  • What are the main issues in using surveys in evaluations at the international level?
  • What is the best method of sampling to use?

On-line session recording

 

  • Wednesday, 28 February 2024 will be in the course Canvas.

 

Back to seminar schedule


John R. Mathiason.
Copyright 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020 John R. Mathiason. All rights reserved.
Revised: February 15, 2020


Revised: February 15, 2020 .