Evaluating projects

Evaluation is becoming increasingly important in health promotion and prevention. For a successful evaluation, the following must be clarified at an early stage:

  • Why a project should be evaluated and on which aspects this should focus
  • Which evaluation questions should be answered
  • Which methods should be used to record and analyze data
  • Who will be involved in the evaluation and how
  • How the findings of the evaluation will be used, etc.
Further to evaluating a project’s goal attainment and answering other evaluation questions, a critical project assessment which is based on the list of quality criteria will provide important information regarding a project’s strengths and potential for improvement. With a view on the project’s success, these can be discussed and useful insights be gained for future projects. It is particularly interesting to compare the view of external assessors with the insight of stakeholders in the project.
  • The evaluation chart will help you decide on the most appropriate methods for assessing the achievement of an objective or an intermediate target. The systematic assessment of results will help you in the management of your project and will provide evidence of success. The chart also provides space for additional questions to do with evaluation. Questions regarding evaluation type, data collection methods, time frames and assignment of responsibilities will be determined on the basis of this document.

    Evaluation_chart

    Instructions (pdf) | Template (doc.zip)
  • Usually, some evaluation measures are sketched out during the planning and design phase of a project. The evaluation plan allows a more detailed presentation of these measures. An evaluation plan is particularly helpful, and recommended, if a large evaluation is envisaged and if many questions regarding evaluation are left open in the project design. If an external organization is to be entrusted with the evaluation, an evaluation plan is compulsory – as a basis for discussion and for quotes. Pondering evaluation questions is helpful for clarifying one’s own expectations and for developing new and interesting lines of thought. Even if one is unfamiliar with evaluation, it makes sense to start thinking about possible evaluation methods. External evaluation experts can help to choose the best methodology for obtaining answers to the evaluation questions.

    Instructions (pdf) | Template (doc.zip)
  • The Swiss Model for Outcome Classification in Health Promotion and Prevention (SMOC) is a tool which may be used for analysis and quality development. In order to exploit its full potential, it should not be used by the project manager or evaluator alone, but should be used collectively e.g. in a meeting of the entire project team, or between the evaluators and key project members, etc. Generally speaking, the SMOC can be used to analyse a situation, to plan an intervention and to evaluate a measure.

    Outcome classification

    Instructions (pdf) | Overview (pdf) | Template (ppt.zip)
  • Criteria are required for a systematic projectand program quality assessment. The criteria that are presented in this document have been developed for intervention projects in health promotion and prevention but can be applied to other projects.

    Ackermann & Studer (2006) (pdf) Evaluation Profile (projects) (doc.zip) | Ackermann & Studer (2006) (pdf)
  • Are the planned evaluation measures suitable to assess project progress at regular intervals as well as the achievement of objectives at the end of the project?
  • Do the people involved have the necessary technical, language and methodological skills?
  • The systematic collection and analysis of information not routinely available about the different aspects of a project or an intervention and its critical appraisal; taking into account different perspectives and applying adequate (social-) scientific research methods and theories.
  • The systematic appraisal of an issue from an external point of view (e.g. through professional evaluators).
  • An indicator is a dimension that can be measured, observed and analyzed by empirical methods. Indicators serve as surrogate measures when assessing (usually complex) phenomena that cannot be directly quantified or evaluated.
  • The quality of products and efforts (output) and results (outcome). A project is of high quality if the stated objectives and the desired effects have been achieved and without having caused important negative side effects.
  • SMART objectives are 'Specific', 'Measurable', 'Achievable', 'Realistic' and 'Time-limited'.
  • The systematic assessment of a situation from the perspective of the person concerned.
Last modification: 16 April, 2014 11:46