7.pdf

Introduction • Evaluation is an important management tool. • Evaluation components are critical in quality assurance of health education programs. • It can be simple as reflection on past practices or more advance like statistics and computerized reports. Introduction • In Evaluation of the commun...

Introduction • Evaluation is an important management tool. • Evaluation components are critical in quality assurance of health education programs. • It can be simple as reflection on past practices or more advance like statistics and computerized reports. Introduction • In Evaluation of the community education programs, the professional mainly judge the progress and the results of the programs. • This judgment can be useful to the program in the future. • sometimes, this judgment can be subjective and on personal base. • And if it does not applied well it will be a source of bias and will be useless. Introduction • So, the effective evaluation needs to be objective rather than subjective. • It will be applied in systemic way. • It will add a value to the program in the future. Evaluation should be: • Non-threatening. • Should be looked upon to make a program better. • The program planner should be creative, positive and forward looking. Reasons to apply Evaluation 1. To help developing a new program or to improve an old program. 2. For the purposes of the quality assurance. 3. For program improvement. 4. The funding organization need to know if the funding and resources were used appropriately. 5. The funding organization wants to know if the funding should continue or stop. The Evaluation Requirements Sound planning skills. A commitment not to manipulate the outcome. The Characteristics of the Effective Evaluation Timely. Avoid covering failure. Comprehensive but not missing essential parts of the program. Transparence. Measure past success and failures and the reasons for them. Who will read the evaluation report? 1. Primary audiences. 2. Funding agencies. 3. Health educators. 4. Media. 5. Stakeholders. Types of Evaluation Formative Evaluation • It is called feedback loop because it provides continuous feedback to program directors that enable them to adjust the progress of the program. • It can be done by program developer or someone outside the program (independent evaluator). • Formative evaluation focuses on monitor the programs in early stages. Formative Evaluation It includes: Need assessment of the targeted group. Development of the goal. Assessment of the clients' reactions to the services delivered by the program. Input evaluation, process evaluation) example Summative Evaluation • It done after accomplish of the program or finish a phase in the program. • The policy makers and funding agencies are interesting in summative evaluation. • Summative evaluation usually focuses on whether the objectives or goals of the program have been accomplished. Summative Evaluation • It should be done by independent evaluators from outside of the program to avoid bias. • It needs more time and resources to implement. • Outcome,impact evaluation)example Summative Evaluation • The basics of evaluation is to determine if whether the objectives of the program has been accomplished or not and the extent of this accomplishment. BREAK Examples of the Questions of the Evaluation How many clients are managing stresses appropriately? How many clients join smoking cessation clinics? The decline in incidence and prevalence rate of Dengue fever. How much the health care cost was reduced? Five Steps to Plan an Evaluation 1. Describe your program activities. 2. Select evaluation measures. 3. Design data collection and analysis. 4. Develop an action plan. 5. Report results. 1- Describe your program activities: A. What are the goals and objectives? B. What activities are planned? C. Who and what are involved? 2- Select Evaluation Measures A. Who will use the findings of the evaluation? B. What is the primary purpose of the evaluation? C. How the information will be used? D. What questions should be answered? E. What was done? F. How and when was it done? G. What changes occurred? 3- Design Data Collection and Analysis A. What resources are available to conduct the evaluation? B. From where you will obtain the data? C. How you will collect, enter and analyze the data? 4- Develop an Action Plan A. Who will manage the evaluation? B. What are the specific tasks and timeline? (Look back to the action plan in recent lectures) 5- Report Results A. How you will share the results? B. With whom you will share the results?