Week 2 Building Blocks (M&E) - Postgraduate Diploma

Week 2: Theory of Change (Part 1) ================================= +-----------------+-----------------+-----------------+-----------------+ | **Name of | **FPD** | | | | institution:** | | | | +=================+=================+=================+=================+ | **Programme | **Postgraduate | | | | name:** | Diploma in | | | | | M&E** | | | +-----------------+-----------------+-----------------+-----------------+ | **Module | **Introduction | **Module code | | | Name:** | to M&E** | (online):** | | +-----------------+-----------------+-----------------+-----------------+ | **Module | **Frances | | | | Author:** | Kelly** | | | +-----------------+-----------------+-----------------+-----------------+ | **Hours on | **15 = 150 | | | | module** | hours = 15 | | | | | hours a week** | | | +-----------------+-----------------+-----------------+-----------------+ | **IDs** | **Ilana** | | | | | | | | | | **Michelle** | | | +-----------------+-----------------+-----------------+-----------------+ **Overview** Welcome to Week 2! This week, we delve into the **Theory of Change (ToC)**, a vital framework in Monitoring and Evaluation. ToC illustrates the logical flow of a program, linking resources, activities, and results to the desired long-term impact. We start by defining its **key components**: Inputs, Activities, Outputs, Outcomes and Impact. You'll also explore the **history of the Theory of Change**, understanding its evolution and significance in program design and evaluation. The week highlights the **purpose and importance** of ToC as a roadmap and communication tool. It helps stakeholders align on how and why a program achieves its objectives. We'll introduce **tools and methods** to develop a Theory of Change, including visual mapping and participatory approaches that foster stakeholder engagement. By the end of this week, you'll have a clear grasp of the Theory of Change and its role in designing effective programs. This foundation will prepare you for Week 3, where we'll delve deeper into creating a Theory of Change. Engage actively with the materials and discussion forums, as these concepts are key to your understanding of more advanced topics. Let's learn together! ***Watch the following video as I briefly introduce this week to you (Length: 0:36 min).*** *[Access the transcript.]* *Author:* *Frances Kelly* *Year: 2024* +-----------------------------------------------------------------------+ | **Transcript** | +=======================================================================+ | This week, we dive into the foundational concept of the **Theory of | | Change (ToC)**, a critical tool in the field of Monitoring and | | Evaluation. You will explore how this approach maps the logical flow | | of a program, linking resources and activities to the desired | | long-term impact. | | | | We will begin by defining the **key components of the Theory of | | Change**: | | | | - Inputs: The resources needed to run a program. | | | | - Activities: The actions or processes that transform inputs into | | outputs. | | | | - Outputs: The direct results of program activities. | | | | - Outcomes: The short- and medium-term changes resulting from the | | program. | | | | - Impact: The ultimate, long-term effect of the program on the | | target population. | | | | Additionally, we will trace the **history of the Theory of Change**, | | providing you with insight into its origins and evolution as a | | guiding framework in program design and evaluation. | | | | The **purpose and importance** of the Theory of Change will also be a | | key focus this week. You will learn how it serves as both a roadmap | | and a communication tool, ensuring that stakeholders share a common | | understanding of how and why a program is expected to achieve its | | goals. | | | | Finally, we will explore **practical tools** and methods used to | | develop a Theory of Change. These include visual mapping techniques | | and participatory approaches that engage stakeholders in the design | | process. | | | | By the end of the week, you will have a foundational understanding of | | the Theory of Change and its relevance in creating impactful | | programs, setting the stage for Week 3 where we will explore | | developing a Theory of Change in more detail. | | | | As you engage with the materials and discussions, remember that these | | concepts will lay the groundwork for the more complex topics to come. | | Feel free to ask questions and share your thoughts in the discussion | | forums - we\'re here to learn from one another! | +-----------------------------------------------------------------------+ Week 2 Learning Outcomes ------------------------ At the end of this week, you will be able to: 1. Define the concept of Theory of Change and its components (inputs, activities, outputs, outcomes, impact). *(MO 2)* 2. Summarise the history of the Theory of Change. *(MO 2)* 3. Describe the purpose and importance of a Theory of Change in program design and evaluation. *(MO 2)* 4. Summarise the tools used to develop a Theory of Change. *(MO 2)* Planning your Week Below is an outline of the items for which you will be responsible during this week. You are required to complete all the activities listed in the outline to fully meet the weekly outcomes which are indicated in brackets next to the activity (WO). The time estimated to complete this week is 15 hours. To be successful, prepare for and complete the following tasks: 1. Acronyms and Glossary *(WO 1)* - *Estimated time on task: ±1 hour.* 2. Introduction - *Estimated time on task: ±30 minutes.* 3. Lesson 1: Key Terms *(WO 1)* - *Estimated time on task: ±**15** minutes.* 4. Reading 1: Textbook Section 1.2 *(WO 1)* - *Estimated time on task: ±**45** minutes.* 5. Reading 2: Research and evaluation -- Ways of framing the differences *(WO 4)* - *Estimated time on task: ±**2**0 minutes.* 6. Activity 1: Classify projects as either research or evaluation *(WO 4)* - *Estimated time on task: ±20 minutes.* - *DUE: Sunday, 23:59 SAST by the latest.* - *Participation grade* 7. Reading 3: Afraid of the Monitoring and Evaluation (M&E) Monster? No need to be! (WO 1) - *Estimated time on task: ±20 minutes.* 8. Discussion 1: M&E Key Terms (WO 1) - *Estimated time on task: ±1 hour.* - *DUE: Friday and Sunday, 23:59 SAST by the latest.* - *Participation grade* 9. Lesson **2**: Purpose of M&E *(WO 2)* - *Estimated time on task: ±20 minutes.* 10. Reading 4: If you don\'t count, you don\'t count: Monitoring and evaluation in South African NGOs (*WO 2)* - *Estimated time on task: ±45 minutes.* 11. Video: How to measure the success of international development projects *(WO 2)* - *Estimated time on task: ±**10** minutes.* 12. Discussion 2: Purpose of M&E in the organisation they work for *(WO 2)* - *Estimated time on task: ±1 hour.* - *DUE: Friday and Sunday, 23:59 SAST by the latest.* - *Participation grade* 13. Activity 2: Photographic Data Evidence (WO 2) - *Estimated time on task: ±1 hour.* - *DUE: Sunday, 23:59 SAST by the latest.* - *Participation grade* 14. Video: What is monitoring & evaluation? (WO 3) - *Estimated time on task: ±15 minutes.* 15. Lesson 3: M&E in the Project Cycle (WO3) - *Estimated time on task: ±5 minutes.* 16. Reading 5: Textbook Section 1.4 (WO 3) - *Estimated time on task: ±20 minutes.* 17. Reading 6: Project Management, Monitoring and Evaluation (WO 3) - *Estimated time on task: ±45 minutes.* 18. Video: How is M&E useful in the program cycle (WO 3) - *Estimated time on task: ±15 minutes.* 19. Activity 3: M&E in the Project Cycle (WO 3) - *Estimated time on task: ±1**5** minutes.* - *DUE: Sunday, 23:59 SAST by the latest.* - *Participation grade* 20. Quiz: Week 1 *(WO 1 -- 4)* - *Estimated time on task: ±1 hour.* - *DUE: Sunday, 23:59 SAST by the latest. The quiz closes at midnight.* - *Graded: Yes* - *Weight: 50%* 21. Summary - *Estimated time on task: ±3 minutes.* 22. Week 1 Progress Check 23. References: Week 1 Introduction ============ *Estimated time on task: ±30 minutes.* Monitoring and evaluation (M&E) are critical components of project and programme management, providing essential insights into whether objectives are being achieved, how efficiently resources are being used, and where improvements can be made. In recent years, it has become increasingly recognised that M&E must be integrated into the overall project planning process to be effective. Without a structured M&E plan, even the best-designed projects can falter due to a lack of data, accountability, or clear mechanisms for tracking progress and assessing impact. At the heart of effective M&E planning is the need for a systematic framework that ties together all aspects of project design, implementation, monitoring, and evaluation. This involves careful consideration of the M&E requirements during the project planning phase, ensuring that M&E is not an afterthought but a core part of the overall strategy. Key stakeholders, including project planners, M&E specialists, and programme implementers, must collaborate from the outset to build a coherent and workable M&E framework. Central to the M&E planning process are three foundational tools: **programme theory**, **Theory of Change (ToC)**, and **logic models**. These tools provide a roadmap for the project, outlining the logical progression from activities to outcomes and impact. This introduction to M&E planning will explore the importance of these frameworks, their role in effective project management, and how they contribute to a robust M&E system. **Programme Theory:** Programme theory, also known as the theory of action, is a foundational concept in M&E planning. It explains the rationale behind a programme and how its activities are expected to lead to desired outcomes. By laying out the causal relationships between inputs, activities, outputs, outcomes, and impact, programme theory provides a clear framework for understanding the logic of a programme and the assumptions that underpin its success. In the context of M&E, programme theory helps to ensure that all stakeholders have a shared understanding of how the project is supposed to work. It clarifies the pathways through which the project will achieve its goals and highlights the key assumptions that need to be tested during the project's implementation. It also helps to ensure that programmes are based on a sound and evidence-based ToC, and that they are implemented in a systematic and strategic manner. Without a clear programme theory, it can be difficult to identify which aspects of the project are working and which need adjustment. For example, in a health intervention aimed at reducing childhood malnutrition, the programme theory would outline how specific activities---such as distributing nutritious food and educating parents about nutrition---are expected to lead to improvements in children's health. It would also identify critical assumptions, such as the availability of food supplies or parents' willingness to participate in the educational sessions. Programme theory, therefore, serves as the foundation upon which the M&E system is built, ensuring that the monitoring process tracks not just what happens, but why it happens. **Theory of Change** Building on the programme theory, the **Theory of Change (ToC)** is a more detailed and comprehensive framework that maps out the sequence of events that must occur to achieve the desired long-term outcomes. The ToC goes beyond the linear progression of inputs, activities, and outputs, to include the underlying assumptions, external factors, and potential risks that could affect the success of the project. One of the key strengths of the ToC is its flexibility and adaptability. It provides a roadmap that can be continuously refined as the project evolves and new information becomes available. This iterative process of refinement allows for adjustments to be made to the project strategy in response to emerging challenges or changing conditions, ensuring that the project remains on track to achieve its objectives. The ToC is particularly valuable in the evaluation phase of the project, as it provides a framework for testing the underlying assumptions and causal linkages that were initially identified. By comparing the actual outcomes with the predicted outcomes, evaluators can assess whether the project is achieving its intended impact and where improvements may be needed. In this way, the ToC serves as both a planning tool and an evaluation tool, helping to ensure that the project is grounded in a clear and evidence-based strategy. For instance, if a programme aimed at increasing school attendance among girls in rural areas is not achieving the expected results, the ToC can help identify whether the problem lies in the assumptions made during the planning phase---such as the assumption that providing financial incentives to families would be sufficient to encourage school attendance---or in the external factors---such as transportation barriers or cultural norms that restrict girls\' education. **Logic Models** While the ToC provides a comprehensive and detailed framework for understanding how change happens, **logic models** offer a simpler, more visual representation of the programme's components. A logic model typically takes the form of a flowchart, outlining the inputs, activities, outputs, outcomes, and impact in a clear and easy-to-understand format. This makes logic models an invaluable tool for communicating the project's strategy to a wide range of stakeholders, from funders and policymakers to project staff and beneficiaries. Logic models are particularly useful during the project's implementation phase, as they provide a clear and concise roadmap that can be used to monitor progress and adjust as needed. By breaking down the project into its component parts, the logic model makes it easier to identify where things are going off track and where corrective actions are needed. This helps to ensure that the project remains focused on its intended goals and that resources are being used efficiently. In the context of M&E planning, logic models play a crucial role in the development of indicators. Indicators are the measurable signs of progress that are used to track the project's success. By aligning the indicators with the different levels of the logic model---inputs, activities, outputs, outcomes, and impact---project managers can ensure that the monitoring process is capturing the right data at each stage of the project. This provides a clear and systematic way to assess whether the project is achieving its goals and where improvements may be needed. For example, in a project aimed at improving water access in rural communities, the logic model would outline the inputs (such as funding and materials), activities (such as building wells and installing water filtration systems), outputs (such as the number of wells constructed), outcomes (such as increased access to clean water), and impact (such as improved health outcomes). The indicators at each stage would track the progress of the project, from the number of wells built to the health improvements observed in the community. **The Importance of Indicators in M&E Planning** Indicators are a critical component of the M&E system, providing the data needed to assess whether the project is on track to achieve its objectives. In the context of a logic model, indicators are developed at each level---inputs, activities, outputs, outcomes, and impact---to measure the progress of the project and identify areas where adjustments may be needed. Effective indicators are specific, measurable, achievable, relevant, and time-bound (SMART). They provide clear and objective criteria for assessing the project's success and help to ensure that the monitoring process is systematic and evidence-based. Without clear indicators, it can be difficult to assess whether the project is achieving its goals or to make informed decisions about where improvements are needed. For example, in a project aimed at reducing maternal mortality, indicators might include the number of health workers trained, the number of prenatal check-ups conducted, and the reduction in maternal mortality rates over time. By tracking these indicators, project managers can assess whether the project is on track to achieve its objectives and where additional resources or adjustments may be needed. We will discuss the development of indicators in detail in Module: Programme Monitoring System Design CME4163. **Developing a Monitoring and Evaluation Plan** As discussed in Module: Monitoring & Evaluation Fundamentals CME4161, the development of an M&E plan is a critical step in ensuring the success of any project or programme. The M&E plan outlines how the monitoring and evaluation process will be conducted, including the indicators that will be used, the methods for collecting data, and the timeline for conducting evaluations. A well-designed M&E plan should be developed in a participatory manner, involving all key stakeholders in the process. This helps to ensure that the M&E system is aligned with the project's objectives and that all stakeholders have a shared understanding of how the monitoring and evaluation process will be conducted. It also helps to build ownership and buy-in from stakeholders, which is critical for the successful implementation of the M&E plan. The development of the M&E plan should also be guided by the M&E framework, which provides the overall structure for the monitoring and evaluation process. The M&E framework outlines the key components of the monitoring and evaluation system, including the indicators, data collection methods, and reporting mechanisms. \* * Lesson 1: Programme Theory ========================== *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±30 minutes.* **Introduction to Theory** Theory plays a pivotal role in human understanding, providing a structured way to comprehend, predict, and influence the world around us. In its simplest form, theory is a set of concepts and principles that help explain a particular phenomenon. When applied in social development, theory becomes an invaluable tool in planning, executing, and evaluating interventions aimed at improving societal conditions. This essay explores the value and use of theory, particularly in the field of social development, drawing on key literature to highlight its importance. **What is Theory?** Theory can be understood as an explanation of how specific aspects of human behaviour or performance are organised. In essence, theory provides a framework that allows us to predict and analyse outcomes based on relationships between various concepts. Moore (1991: 2) notes that \"theory is the summary and synthesis of what is known about a field, presented in a way that shows underlying patterns and relationships\". This statement captures the essence of theory's role in systematising knowledge, providing a structured understanding of complex phenomena. At its core, a theory is composed of concepts and principles. Concepts are symbolic representations of actual things, while constructs represent abstract ideas such as democracy or learning. The relationships between these concepts and constructs form principles, which explain or predict outcomes. These principles help explain what is happening in the world around us and allow us to predict future events based on observed patterns. **The Importance of Theory in Social Development** The role of theory in social development is multifaceted. It provides a framework for identifying problems, guiding interventions, and understanding the outcomes of social programmes. The application of theory to social development extends beyond the mere prediction of outcomes; it enables practitioners to plan interventions that are evidence-based and grounded in research. 1. **Theory Guides Understanding and Change**: One of the most critical functions of theory in social development is that it allows practitioners to understand and explain social phenomena. By offering a systematic way of examining behaviour, theory helps identify the root causes of societal issues. For example, theories of behavioural change, such as the Health Belief Model and Social Cognitive Theory, are frequently used to design interventions aimed at changing health-related behaviours (Glanz, Rimer & Viswanath, 2015). These theories guide the development of strategies that target specific behaviours, increasing the likelihood of successful outcomes. 2. **Theory Provides a Basis for Funding and Support**: In the context of social development, securing funding is often contingent on demonstrating that a programme is grounded in solid theoretical frameworks. Theory not only explains what is being done but also offers a rationale for why it is expected to work. This can be particularly important when justifying the allocation of resources to social programmes. Research suggests that funders are more likely to support initiatives that are based on evidence and sound theoretical principles, as they are seen as more likely to succeed (Weiss, 1998). 3. **Theory Enhances Professional Growth and Knowledge**: Theory plays a crucial role in the professional growth of those working in social development. By building on existing knowledge and developing new theories, practitioners contribute to the growth of their field. Moreover, theory helps bridge the gap between research and practice. It allows practitioners to apply research findings to real-world problems, thereby enhancing the effectiveness of their interventions. As Moore (1991: 2) points out, \"Theory guides research\", ensuring that research efforts are focused on answering meaningful questions that can inform practice. **Theory Development in Social Development** The development of theory is an iterative process that is continuously revised as new knowledge is discovered through research. The process of theory development generally follows three stages: speculative, descriptive, and constructive. The speculative stage involves attempting to explain what is happening, while the descriptive stage gathers data to provide a more detailed understanding of phenomena. The constructive stage involves revising old theories and developing new ones based on ongoing research (Moore, 1991). In social development, this process of theory development is crucial for ensuring that interventions remain relevant and effective. For example, as societal challenges evolve, theories of social change must also adapt to reflect these changes. The Theory of Change (ToC), for instance, is widely used in social development to map out the pathways through which an intervention is expected to lead to desired outcomes (Vogel, 2012). As new data is collected and analysed, the ToC is refined to better reflect the realities of implementation. **The Role of Theory in Monitoring and Evaluation** Monitoring and evaluation (M&E) are critical components of social development projects, and theory plays a vital role in guiding these processes. Theories provide the building blocks for understanding complex social issues and their influences. They help project managers and stakeholders move beyond "educated guesses" by offering a structured framework for designing and evaluating interventions based on an understanding of the issues at hand (Patton, 2008). Moreover, theory helps to focus attention on appropriate issues, identify priorities, and ensure that interventions are implemented using the most effective methods. Theories such as the Theory of Action, Theory of Change and Programme Theory are particularly valuable in M&E. These theories clarify the underlying assumptions and logic behind how a programme is expected to work, helping evaluators to assess whether the programme is likely to achieve its intended outcomes (Funnell & Rogers, 2011). Additionally, behavioural change theories and complexity theories help evaluators to understand the non-linear relationships and feedback loops that often exist within social systems. **Conclusion** Theory is a fundamental tool in social development, providing a framework for understanding, predicting, and influencing social phenomena. By offering a systematic way of examining relationships between concepts, theory helps social development practitioners to plan effective interventions, secure funding, and evaluate outcomes. As new knowledge is gained through research, theory is continuously refined, ensuring that social development efforts remain relevant and impactful. In this way, theory not only guides practice but also drives the evolution of the field itself. ** Introduction to programme theory** As Monitoring and Evaluation (M&E) specialists, we are often tasked with understanding how a particular intervention, programme, or policy works to create positive change in society. One of the most effective tools at our disposal for programme design, implementation, and evaluation is programme theory. This systematic approach provides a clear framework for understanding how different elements of a programme fit together to achieve the desired outcomes. In this section, we will introduce the concept of programme theory, exploring how it helps us explain the relationships between programme inputs, processes, and expected outcomes. By the end of this section, you should have a solid grasp of how programme theory can guide effective M&E practices, support logical programme design, and improve the accountability of social interventions. **What is Programme Theory?** Programme theory provides a structured explanation of how and why a programme is expected to work. It is essentially a roadmap that connects a programme\'s inputs (resources such as money, people, and time) to its activities (such as training, community engagement, or service delivery) and ultimately to its expected outputs, outcomes, and impacts (Weiss, 1998). These connections are based on underlying assumptions about how change occurs and are usually represented in a **logic model** or a **Theory of Change**. For example, a programme aimed at reducing youth unemployment may have inputs like funding for skills training, activities such as job preparation workshops, outputs like the number of participants who complete the training, and long-term outcomes such as improved employment rates among young people. Programme theory allows us to clearly articulate the mechanisms through which these various components are expected to lead to the desired result---in this case, lower youth unemployment. The value of programme theory lies in its ability to make these assumptions explicit. By clearly defining the causal pathways that link programme components, programme theory allows us to test whether these pathways hold true in practice and whether the programme is achieving its intended results. ** ** **The Role of Assumptions and Context** A key feature of programme theory is that it forces us to make explicit the assumptions that underlie our expectations of how change will occur. These assumptions might relate to how we expect people to respond to a particular intervention, or they might involve external factors, such as the social, political, or economic conditions that may influence the programme's success. For example, a job training programme might assume that participants will find employment after receiving training. However, this assumption might not hold true if there are not enough jobs available in the local economy. By making these assumptions explicit, programme theory allows us to identify potential risks and challenges that might affect programme outcomes and to design strategies to mitigate them. In addition to assumptions, context is also crucial in determining how a programme operates. Social, cultural, and political factors can significantly influence the success of a programme, and programme theory helps to highlight how these contextual factors can affect programme implementation and outcomes (Van Es, Guijt, & Vogel, 2015). **Programme Theory and Evaluation** Programme theory is not only useful for programme design but also for evaluation. It provides a framework for identifying key indicators that can be used to measure programme performance and for assessing whether the programme is achieving its intended outcomes. In M&E, we often use programme theory to guide the development of evaluation questions and to ensure that our data collection methods are aligned with the programme's objectives. For example, if a programme theory identifies improved knowledge as a key short-term outcome, we can design an evaluation that measures changes in participants' knowledge before and after the intervention. By doing so, we can determine whether the programme is on track to achieve its desired outcomes and identify any areas where adjustments may be needed. **Theory of Action and Theory of Change** Two key concepts that are often used in conjunction with programme theory are **Theory of Action (ToA)** and **Theory of Change (ToC)**. The ToA focuses on explaining how and why a programme is constructed in a specific way to bring about change. It provides a rationale for the programme design, detailing how specific activities are expected to lead to the desired results (Weiss, 1998). The ToC, on the other hand, is more concerned with the causal pathways that lead from the activities to the desired outcomes. It explains how and why certain changes are expected to occur, outlining the steps that are expected to lead to the programme's success. The ToC also considers the broader social, economic, and political context in which the programme operates and how this context might affect the programme's outcomes (Rogers, 2014). Together, the ToA and ToC provide a comprehensive framework for understanding how a programme is expected to work and for evaluating its success. We will explore both concepts in more detail in subsequent sections, as they are essential tools in M&E. **Conclusion** Programme theory is a vital tool in the field of Monitoring and Evaluation. It provides a structured and systematic way of understanding how a programme is expected to work, linking inputs and activities to outputs, outcomes, and impacts. By making explicit the assumptions that underlie programme design, programme theory helps practitioners to plan more effective interventions and to evaluate whether those interventions are achieving their desired results. Online Video: An Introduction to Program Theory =============================================== *This activity aligns with Weekly Outcome 1.* *Estimated time on task: ±15minutes.* The video, presented by the Student Affairs Assessment Support Services team at James Madison University, introduces the concept of programme theory and its importance in programme assessment. Programme theory explains how and why a programme is expected to achieve its outcomes. Using the example of the \"An Apple a Day\" initiative, the video highlights the need to outline the causal mechanisms that link programme activities to outcomes, which aids in accurately interpreting the success or failure of a programme. The video discusses the significance of developing a robust programme theory, supported by evidence, to ensure interventions are effectively designed and adaptable to various contexts. Additionally, programme theory plays a crucial role in determining what data should be collected and how the results are analysed. A distinction is made between programme theory and logic models, with logic models serving as visual representations of the causal links in a programme, while programme theories provide the evidence and rationale behind those connections. The video concludes by emphasising that incorporating programme theory into the assessment cycle leads to more intentional, evidence-based programmes and enhances the evaluation process. As you watch the video below, reflect on the following: - *How does the Theory of Change framework facilitate a clear understanding of the steps required to achieve a program\'s long-term goals?* - *In what ways can identifying assumptions within a Theory of Change model enhance the effectiveness of program planning and evaluation?* - *How can engaging stakeholders in the development of a Theory of Change contribute to the success and sustainability of a program?* ![](media/image2.png)Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps you make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- \\ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- **Title: **An Introduction to Programme Theory **Author: **SASS at JMU **Year: **2018 **Reference: **Student Affairs Assessment Support Services (SASS) at James Madison University, 2018. *An introduction to program theory*. Available at: \[Accessed 29 September 2024\]. **Transcript** ---------------- Reading 1: Prescribed Textbook ============================== *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±45 minutes.* To introduce the concept of the Theory of Change, start by reading the introduction of Chapter 3, Theories of Change and Programme Logic, authored by Fanie Cloete and Christelle Auriacombe. Fanie Cloete is an Emeritus Professor of Public Governance at the Universities of Stellenbosch and Johannesburg, with expertise in public sector institutional and managerial capacity development. Christelle Auriacombe is a Professor of Public Management and Governance at the University of Johannesburg, where she also serves as Director of the School of Public Management, Governance, and Public Policy within the College of Business and Economics. This chapter provides an in-depth exploration of the definition and nature of theories of change, their practical applications, and illustrative examples to deepen your understanding of this critical framework. Read Chapter 3, section 3.1. 'Introduction' in your textbook. *±10 pages* Cloete *et al.* (2014) *Evaluation management in South Africa and Africa*. Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. Discussion 1: Project Idea ========================== *This activity aligns with Weekly Outcome 1.* *Estimated time on task: ± 60 minutes.* This week, you will brainstorm and select a project to which you will apply Theories of Change and Logic Models throughout the module. Using ChatGPT or a similar AI tool, engage in an interactive conversation to help you identify a suitable programme. This brainstorming session is designed to help you think critically and creatively about potential projects. **Meet Jane -- your AI Coach** **Task ** You will be using Artificial Intelligence (AI) for this part of the activity, so login or access your preferred site to start, - [ChatGPTLinks to an external site.](https://chatgpt.com/auth/login?sso) *(Highly Recommended)* - [GeminiLinks to an external site.](https://gemini.google.com/app) - [PerplexityLinks to an external site.](https://www.perplexity.ai/) - [Claude AnthropicLinks to an external site.](https://ai-pro.org/start-claude-ai/?kt8typtb=arcana_wp&ppg=03&keyword=claude&adid=707380050711&pmt=pay2&gad_source=1&gclid=CjwKCAjw68K4BhAuEiwAylp3kuCV68Lkplj7I-1197qqvNvCMsY15iRjNduQdCzgMmWNvZPWCZ0PqxoCJs8QAvD_BwE) \*See support guides at below to help you navigate the AI if you need some help. Support Guides - [ChatGPT: How to loginLinks to an external site.](https://www.youtube.com/watch?v=uWBu7i2Wuh8) - [Gemini: How to loginLinks to an external site.](https://www.youtube.com/watch?v=LXyKA1R1t5Q) - [Getting started with PerplexityLinks to an external site.](https://www.perplexity.ai/hub/getting-started) - [Introduction to Claude Anthropic](https://docs.anthropic.com/en/docs/intro-to-claude) **Instructions:** 1. **Start the Conversation:** - Use the AI of your choice to brainstorm potential projects. Begin by asking open-ended questions about possible projects that align with your interests and the week\'s topics. For example, ** ** ***\"What are some effective community health projects that could benefit from a Theory of Change and Logic Models approach?\"*** ***\"ChatGPT, what are some impactful educational projects that could benefit from applying Theories of Change and Logic Models?\"*** ** ** - Provide context about the type of project you are interested in and any specific areas you want to explore. Ask follow-up questions: ** ** ***\"Can you provide examples of projects aimed at improving primary education in rural areas?\"*** ** ** \*Look at the [Example prompt document](https://fpdonline.instructure.com/courses/227/files/10767?wrap=1) for guidance on how to have your conversation. ** ** 2. **Evaluate Suggestions:** - Critically assess the suggestions provided by your chosen AI. Consider the relevance, innovation, and practical applications of each project idea. - Reflect on the potential impact and feasibility of implementing the suggested project within your context. - Choose one project from the suggestions that you find most engaging and suitable. - Explain why you believe this project is a good fit for applying Theories of Change and Logic Models. Discuss how it meets the weekly outcomes. ** ** 3. **Document the Process:** - Copy and paste your entire conversation with your chosen AI into an MS Word document. 4. **Submit:** - How sensible/realistic are their recommendations? Does their assessment of the situation confirm your thoughts and feelings? Do they challenge your thinking in any way? If so, how? - Have you any personal experiences which may give you a different perspective on the situation? If so, how? **GRADING** The completion of this activity will contribute towards your participation grade for this module. Lesson 2: Theory of Change ========================== *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±30 minutes.* Theory of Change A Theory of Change (ToC) explains how a programme or intervention is expected to bring about the desired change. It creates a roadmap for the desired change and explains the assumptions made regarding the implementation of the programme. It highlights who should be involved in a programme, how the change is expected to occur and what the results of the change should be (Walters, 2007). This process requires stakeholders to be clear on the type of change that is required. It should be clear why change is expected to happen in a particular way. The ToC is one of the tools that can be used to determine the pathway to achieving the desired results. Institutions can also use planning tools other than the ToC to support the results-based methodology. Elements of a ToC include the pathway of change, results, and preconditions (impact, outcomes, outputs, activities, and inputs), indicators and assumptions (DPME, n.d.). Pathway of change is a map that illustrates the relationship between actions and outcomes. Each step of the results chain is reflected on the map and should lead to the achievement of the outcomes and impact (NSG, 2019). It is useful for interventions if a ToC is developed and explicitly stated from the start, but very often it is implicit in the understanding of how a programme will bring about change. One of the crucial aspects within a ToC is the assumptions behind how we expect an intervention will bring about change. This pertains mainly to external influences (such as assumed behaviour from beneficiaries) and factors in the context where an intervention is implemented. It brings understanding on when, how, why and under which circumstances actions will lead to change (or the outcomes anticipated) (IFAD, 2015). It is important to keep in mind that a ToC is simply a theory, which can, and should, be adapted as the programme is implemented. It should be used as an ongoing process to reflect on whether a programme works the way it was planned, and if not, the ToC should be adapted. A ToC looks at the long-term goal and then breaks it down into the pathways of intended change. It is usually presented as a flow chart or as a diagram. The ToC explains how an organisation functions and how it relates to the theory and the assumptions of a programme. It captures the complexity of a programme and considers relationships between different programmes. It also explains how outputs of a programme should lead to impact. It gives a big picture of pathways that can lead to change (those that your programme influences as well as those from other programmes). It describes why and how change will happen in a programme. The logical framework and ToC approach can, and should be used together (Van Es et al., 2015). As ToCs are flexible and not rigid, there are various types of ToCs. Some donors prescribe a format, others allow the organisations to develop their own. Some focus on the high-level intended change and the processes linking to it, others focus more on the pathways of change (Vogel, 2012). Others focus on the assumptions on why it is thought that a programme will work. It depends on the specific reason why a ToC is developed. The South African government is increasingly using the ToC in various processes. This includes the five-year strategic planning process, the development of implementation programmes, as well as in evaluations. 2.1 Definitions --------------- Rick Davies (Vogel, 2012) defines ToC as: *'The description of a sequence of events that is expected to lead to a particular desired outcome.'* Patricia Rogers (Vogel, 2012), puts it like this: *'Every programme is packed with beliefs, assumptions, and hypotheses about how change happens, about the way humans work, or organisations, or political systems, or eco-systems. Theory of change is about articulating these many underlying assumptions about how change will happen in a programme.'* HIVOS (Van Es et al., 2015) explains ToC as: *'Theories of change are the ideas and hypotheses ('theories') people and organisations have about how change happens. These theories can be conscious or unconscious and are based on personal beliefs, assumptions and a necessarily limited, personal perception of reality.'* The NEPF (DPME, 2011) uses the following definition: *'Theory of Change is a tool that describes a process of planned change, from the assumptions that guide its design, to the planned outputs and outcomes and the long-term impacts that it seeks to achieve.'* 2.2 Reasons for using a ToC --------------------------- - Planning The ToC assists implementing institutions (government department, organisations, NGOs) to map the change process and its expected outcomes and then facilitates implementation. For this purpose, the ToC is often used in conjunction with log frame approaches. - Monitoring The ToC articulates expected processes and outcomes that can be reviewed over time. This allows institutions to assess their contribution to change and to revise their ToC, where necessary. - Evaluation A ToC assists with evaluation of a strategy as it explains the original assumptions made when the strategy was designed and can show how the implementation of a strategy was adapted from the original design. - Description and communication ToC allows implementing institutions (government departments, organisations, NGOs) to communicate their chosen change process to internal and external partners. Lesson 3: History of Theory of Change ===================================== *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±5 minutes.* The Theory of Change (ToC) approach has its roots in the field of evaluation research and programme planning in the late 1960s and early 1970s. It was developed to evaluate complex social programmes that sought to achieve broader social change beyond immediate programme outcomes. One of the earliest proponents of the ToC approach was Carol H. Weiss, a prominent social scientist and evaluation researcher. In her 1972 book, "Evaluation Research: Methods for Assessing Programme Effectiveness," Weiss argued that programme evaluation should focus not just on programme outputs and outcomes, but also on the underlying theory of how the programme is expected to achieve those outcomes. Weiss emphasized the importance of understanding the causal mechanisms that underlie a programme's intended outcomes and proposed the use of ToC diagrams to illustrate those mechanisms. This approach provided a framework for identifying the underlying assumptions and logic that connect programme activities with intended outcomes. In the decades that followed, the ToC approach became increasingly popular in the evaluation and programme planning fields and was used to evaluate a wide range of social programmes, including education, health, and community development programmes. Today, the ToC approach is widely used by international development organisations, governments, and NGOs as a planning and evaluation tool. It is seen as a powerful way to ensure that programmes are based on a sound ToC, and that evaluations are focused on understanding how programmes work and why they succeed or fail. Online Video: A Brief History of Theory of Change ================================================= *This activity aligns with Weekly Outcome 2* *Estimated time on task: ±5 minutes.* The video *\"A Brief History of Theory of Change\"* by InFocus provides a concise overview of the development of the Theory of Change (ToC) in the context of programme evaluation and social impact. It explains that ToC is part of a broader family of approaches, including programme theory and theory-based evaluation, all of which focus on the theoretical foundations of social programmes. The video traces the origins of ToC to early forms of social experimentation, such as the British Navy's use of citrus fruits to combat scurvy in the 18th century, and later to large-scale social programmes of the 1960s. Influential thinkers like Paulo Freire, who focused on poverty and the socio-political context of change, contributed to the evolution of these ideas in the 1970s. In the 1990s, the Aspen Institute\'s Roundtable on Community Change and Carol Weiss's 1995 article popularised the term *Theory of Change* by introducing a process to map out the small steps from activities to outcomes, allowing for a more structured evaluation of complex social programmes. Since then, ToC has been widely adopted by organisations, particularly in the development sector, as a tool for planning, monitoring, and evaluation. ![](media/image2.png)Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps you make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. As you watch the video below, reflect on the following: - *How can the idea of social experimentation, as mentioned in the video, be applied to your own projects or programmes?* - *How can you use the Theory of Change framework to map out the \"small and intervening steps\" in your own projects or initiatives?* ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ \\ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ***Title: **A Brief History of Theory of Change* ***Author: **InFocus Enterprise* ***Year: **2015* ***Reference: **InFocus Enterprise, 2015. A Brief History of Theory of Change. Available at: \[Accessed 30 September 2024\]* **Transcript** ---------------- Online Video: Theory of Change Explained ======================================== *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±6 minutes.* The video titled *\"What is a Theory of Change?\"* by the Centre for Development Innovation (CDI) at Wageningen University provides a succinct overview of the **Theory of Change (ToC)** and its practical applications. The presenter, Jan Brouwers, discusses how ToC is a valuable tool for guiding strategic thinking and action, particularly in complex settings with multiple actors, issues, and unforeseen events. The video outlines four key reasons for utilising ToC: 1. **Planning**: ToC supports the development of robust plans for interventions. 2. **Monitoring, Evaluation, and Learning**: It helps define clear assumptions and identify indicators for tracking progress. 3. **Scaling Up**: It encourages consideration of how interventions can be expanded from the outset. 4. **Evaluation**: ToC can be used to reconstruct or evaluate the pathway of change at the end of a project. Brouwers explains that ToC centres on understanding what is to be achieved, how it will be achieved, and why those objectives are important. Typically, ToC is represented visually, summarising the intervention's "pathway of change," alongside a narrative explaining each step. The pathway illustrates how short and medium-term outcomes contribute to the ultimate vision and accounts for the roles of other actors. The presenter highlights the importance of making assumptions explicit, an area often overlooked in traditional planning models such as logical frameworks. ToC delves deeper into cause-effect assumptions and explores different mindsets around how change occurs, ensuring that teams are aligned on how change will be realised. Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps you make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. As you watch the video below, reflect on the following: - ***How could the Theory of Change approach help you and your team improve the planning and clarity of your current projects?**\ Consider how creating a visual pathway of change and explicitly defining assumptions might enhance your strategic planning and monitoring processes. What assumptions in your current projects could benefit from being made more explicit?* - ***In your work, how do you assess whether short-term activities are effectively contributing to long-term goals?**\ Reflect on how using a Theory of Change framework could help you track progress and evaluate outcomes more systematically. How might this approach improve your ability to adapt and scale up interventions over time?* ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ \\ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ***Title: **Theory of Change Explained* ***Author: **Centre for Development Innovation* ***Year: **2016* ***Reference: **Centre for Development Innovation, 2016. Theory of Change Explained. Wageningen University. Available at: \[Accessed 30 September 2024\].* **Transcript** ---------------- Lesson 4: Role of ToC in programme design and evaluation ======================================================== *This activity aligns with Weekly Outcome 3* *Estimated time on task: ±10 minutes.* 4.1 Role of ToC in programme design ----------------------------------- It is important to understand how the ToC fits into programme design and the benefits it adds to the programme management cycle. It allows all programme staff to have a better understanding of the work to be undertaken and the context in which this will happen. It strengthens the clarity and the focus of programmes. It also provides the framework for monitoring, but also future evaluation of a programme and provides opportunity for learning throughout the programme cycle. It strengthens the relationship between stakeholders, since there is a better understanding of the programme context. It improves dialogue with stakeholders, as the influence of stakeholders and other departments are better understood. Many organisations have now included the development of a ToC as part of their programme cycle. It assists with planning, as programme managers can then decide what will be realistically achieved within a specific timeframe. They will have a better understanding of the context of the programme, and schedule interventions better. Van Es *et al*., (2015) explain how the ToC fits into the programme cycle in the figure below. The ToC in programme cycle management Source: Van Es *et al.*, (2015: 114) The value and benefits of the ToC are very important for the programme cycle: - Helps with implementation planning: The ToC assists implementation agencies (government departments, organisations, NGOs) to map the change process and its expected outcomes and facilitates project implementation. For these purposes, ToC is often used in conjunction with log frame approaches. - Helps with monitoring: ToC articulates expected processes and outcomes that can be reviewed over time. This allows organisations to assess their contribution to change and to revise their ToC where necessary. - Is a process and a product: It is part of the on-going implementation of a programme and can therefore influence the implementation of a programme. It also assists with the design and planning of a programme, as it roots the programme into context. It creates a framework to improve design, implementation, and evaluation. It also assists with the preparations for the inception phase, (Van Es et al., 2015). - Explains the assumptions of a programme: This ensures strategical thinking and realistic planning for programmes. - Allows stakeholders to engage with the process: The ToC allows stakeholders to consider evaluation as well as implementation questions. It also allows stakeholders to challenge the underlying logic of a programme in the design phase (Anderson, 2005). It creates a shared understanding among stakeholders about what a programme is trying to accomplish. - Assists with evaluation: A ToC assists with evaluation programmes as it explains the original assumptions made when the programme was designed and can show how the implementation of a programme adapted from the original design. - Enables description and communication: ToC allows implementation agencies (government departments, organisations, NGOs) to communicate their chosen change process to internal and external partners. 4.2 Role of ToC in evaluation ----------------------------- The ToC adds a great deal of value to the implementation of programmes and is specifically used to conduct evaluation as well. It helps to: - check milestones against the original plans - document lessons learned - keep the implementation process transparent - keep all evaluation processes transparent - report on findings (Kusters *et al.,* 2011). As part of the evaluation process, it is important to periodically review the ToC and analyse what was learned about the implementation thus far and how it is implemented. All stakeholders should engage in this process. All participants should consider their assumptions about how they think change happens. This helps the evaluators to understand the perceptions and assumptions of all relevant stakeholders (Kusters *et al.,* 2011). Evaluating the ToC is a critical part of certain evaluations, such as the design evaluation within the NEPF framework. The ToC or programme theory describes the causal mechanism of how activities and outputs will result in the anticipated outcomes and impacts and the assumptions involved. There can be multiple ToCs that describe the programme. For example, different theories can show how the intervention works in different contexts, or at different stages of the intervention, or even for different intended impacts. The ToC should be established during the early planning stages of a policy or programme. A ToC can help to identify which impacts are likely to be achieved during the timeline of an evaluation, and what else should be examined in the evaluation, activities, context, and intermediate outcomes. Also, the ToC helps to identify what needs to be in place, such as people, agencies, activities, mechanisms, resources, for the impact to be achieved. It can also be used to analyse the evaluation results. A good ToC can lead to an effective evaluation, by asking the following questions about a programme: - 'Is the intervention meaningful?' - 'Is it plausible?' - 'Is it doable by this particular organisation or department?' - 'Is it measurable?' A ToC also explains why a programme works in a certain context, strengthening the implementation and enhancing decisions about the programme. It also gives background about the original thinking of a programme, regarding how it was expected to work. Context can influence programme mechanisms in many ways. The context within which the organisation implementing a programme can influence the way in which, or the extent to which, a programme is implemented, who it targets, who it reaches and so on. However, it can also influence the ways in which intended beneficiaries respond. It also provides information about outcomes in a particular setting. The ToC assists an impact evaluation at a later stage as it provides valuable information about the original context of a programme, but also about how a programme was adjusted during implementation (Peersman, 2014). The ToC enables programme managers to understand how and why change happens. It seeks to understand outcomes; the so-called 'missing-middle' or 'black box' of results that emerge downstream from the initiative's activities but upstream from longer-term economic, environmental, political, or demographic changes (Better Evaluation, 2013). As an evaluation approach, this unpacks the programme's original and adjusted ToC, and provides a framework to collect data on immediate, basic changes that lead to longer, more transformative change, and allows for the plausible assessment of the initiative's contribution to results (Better Evaluation, 2013). 4.3 Reading 4: Theories of Change at different levels ----------------------------------------------------- *This activity aligns with Weekly Outcome 1* *Estimated time on task: ±20 minutes.* The concept of Theory of Change (ToC) offers a versatile framework for understanding and driving change across multiple levels, from overarching worldviews to specific project-level interventions. This reading explores the different applications of ToC, illustrating how it evolves to address varying scopes and contexts of social transformation. At its broadest level, ToC reflects **worldview theories of change**, encompassing personal and collective beliefs about how societal progress occurs. These perspectives, shaped by political ideologies, cultural influences, and academic theories, may prioritize factors such as democratization, economic growth, or individual empowerment as key drivers of change. Moving to the **organisational level**, ToC becomes a strategic tool for defining an institution\'s vision, mission, and role in fostering social transformation. It guides decision-making by addressing foundational questions: What needs to change in the world? Why? How does the organization contribute to this change? While rooted in shared values and assumptions, this level also allows for adaptability and innovation through dynamic policy processes that incorporate input from staff and stakeholders. At the **policy domain or thematic level**, ToC narrows its focus to specific areas of work, such as health, energy, or education. It examines the drivers and barriers to progress within these themes, identifying effective strategies and the organization\'s role in advancing them. Finally, at the **program or project level**, ToC becomes highly context-specific, often referred to as a Theory of Action. It outlines the detailed objectives, strategies, and assumptions for achieving targeted outcomes in particular settings, ensuring alignment with broader thematic or organizational ToCs. This multi-level approach demonstrates the adaptability of ToC, making it a powerful framework for designing, implementing, and evaluating change initiatives at various scales. Read Van Es *et al.* (2015) '2.4 Theories of Change at different levels'. Pp. 18 -- 19. ![](media/image2.png)Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. As you read the text, reflect on the following: - How do worldview theories of change influence the strategic decisions and priorities of organisations working toward social transformation? - What are the key differences between an organisational Theory of Change, a thematic or policy-level Theory of Change, and a project-level Theory of Action? How do these levels interact with and support one another? - Why is it important for organisations to revisit and adapt their Theories of Change regularly? How might stakeholder involvement contribute to maintaining dynamic and effective strategies? Reading 5: Role of theories of change and programme logic models in policy evaluation ===================================================================================== *The activity aligns with weekly outcome 2.* *Estimated time on task: ±45 minutes.* This article by Christelle Auriacombe is a vital resource for understanding how **Theories of Change (ToC)** and **Programme Logic Models (PLM)** enhance the evaluation of public policies. These tools are foundational for systematic evaluation, a critical process in improving evidence-based decision-making in governance. The reading highlights the increasing importance of ToC and PLM in assessing whether policies and programs achieve their intended goals. It emphasises their role in fostering transparency, accountability, and improved outcomes, particularly within the framework of South Africa\'s National Performance Management System (NPMS). Read Auriacombe, C.J. 2011. Role of theories of change and programme logic models in policy evaluation. African Journal of Public Affairs, 4(2): 36-53. ** Make notes for yourself in a notebook or use a piece of paper to draw a mind map. This helps make key connections throughout your readings and serves as a valuable resource to return to when completing your assessments. As you read the text, reflect on the following: - How do Theories of Change and Programme Logic Models contribute to improving the accountability and transparency of public policies, particularly in the South African context? - What are the key differences between Theories of Change and Programme Logic Models, and how do they complement each other in policy evaluation? - Why is it essential to align evaluation frameworks with societal needs and values, and how can stakeholder involvement enhance the effectiveness of these evaluations? Lesson 5: Testing a ToC ======================= *This activity aligns with Weekly Outcome 3* *Estimated time on task: ±5 minutes.* Sources such as Hodgson and Noble (2014) propose that the ToC be tested, to determine whether it will achieve its intended result(s). Testing a ToC involves systematically evaluating whether the underlying assumptions and causal pathways of the theory hold true in practice, and whether the programme is achieving its intended outcomes. There are several key steps involved in testing a ToC, which include: - Defining the programme\'s goals and objectives: The first step is to clearly define the programme\'s intended outcomes and the underlying assumptions that link programme activities to those outcomes. - Developing a logic model or ToC: This involves developing a graphical representation of the programme\'s logic, which outlines the causal pathways and key assumptions that underpin the programme\'s ToC. - Selecting appropriate indicators: Indicators are measurable variables that can be used to assess the programme\'s progress and effectiveness. Selecting appropriate indicators is critical to testing a ToC. - Collecting and analysing data: Data is collected and analysed to assess whether the programme is achieving its intended outcomes and to identify any challenges or areas for improvement. - Drawing conclusions and making recommendations: Based on the data analysis, conclusions are drawn about whether the programme is achieving its intended outcomes and whether the underlying assumptions of the ToC hold true. Recommendations are made for programme improvement based on the findings. - Iterating and refining the Theory of Change: Based on the findings of the evaluation, the Theory of Change may need to be refined or updated to better reflect the programme\'s actual outcomes and causal pathways. Testing a ToC is an ongoing process that involves continuous learning and improvement. It is an important tool for programme planning, implementation, and evaluation, as it helps to ensure that programmes are based on a sound and evidence-based ToC, and that they are implemented in a systematic and strategic manner. The table below provides some guidelines to test a ToC. Table 7. Theory of Change Testing Guidelines +-----------------------------------+-----------------------------------+ | **Guideline** | **Description** | +===================================+===================================+ | **Is it meaningful?** | - Does it describe the | | | institution's strategy | | | accurately in ways that | | | officials and stakeholders | | | agree with? | +-----------------------------------+-----------------------------------+ | **Is it well-defined?** | - Are clear target groups | | | articulated? | | | | | | - Is it clear what the | | | institution's strategy wants | | | to do? | +-----------------------------------+-----------------------------------+ | **Is it comprehensible?** | - Does it enable delegates to | | | give someone the 'two-minute | | | story' of the institution's | | | strategy? | | | | | | - Would a member of the public | | | understand the theory? | +-----------------------------------+-----------------------------------+ | **Is it do-able?** | - Are the outputs and | | | activities likely to | | | contribute to the ultimate | | | outcomes and impact? | +-----------------------------------+-----------------------------------+ | **Is it plausible?** | - Is it realistic? Does it take | | | into account the | | | institution's capacity? It | | | should be something that the | | | institution could really do, | | | not just wish it could. | +-----------------------------------+-----------------------------------+ | **Is it credible?** | - Are people outside the | | | institution likely to believe | | | it? | +-----------------------------------+-----------------------------------+ | **Is it testable?** | - Can the theory be tested | | | through a series of testable | | | hypotheses? All elements | | | should theoretically be | | | assessed by using research. | +-----------------------------------+-----------------------------------+ Source: (NSG, 2018b) The true test for the ToC will be to evaluate an intervention to determine if the assumptions hold true. Lesson 6: Tools used to develop ToCs ==================================== *This activity aligns with Weekly Outcome 4* *Estimated time on task: ±10 minutes.* To develop an effective Theory of Change, it's critical to conduct a thorough **situational analysis**. A situational analysis involves gathering and analysing information to understand the context in which your programme operates. It enables you to identify the key factors that could influence your project's success or failure. These factors can be internal, such as the organisation's capacity or stakeholder relationships, or external, such as political or economic conditions. One of the most widely used tools for situational analysis is the **SWOT analysis**, which stands for Strengths, Weaknesses, Opportunities, and Threats. This tool allows you to assess both internal and external factors that can affect your project. For example, in an education programme, the strengths might include strong community support and well-trained teachers, while weaknesses could include a lack of resources. Opportunities might arise from government funding initiatives, whereas threats could stem from political instability or changing education policies. In tandem with SWOT, another powerful framework is the **PESTLE analysis**. This tool helps you consider the Political, Economic, Social, Technological, Legal, and Environmental factors that could influence your project. For instance, a health programme aimed at reducing maternal mortality might be affected by political decisions on healthcare funding, economic fluctuations impacting the affordability of care, social norms surrounding childbirth, or technological advancements in medical equipment. The PESTLE framework gives you a broader view of the environment in which you are operating, enabling more informed decision-making. While SWOT and PESTLE help you map out the context, the next step in developing your Theory of Change is identifying the root causes of the problems you are trying to solve. Often, we tend to focus on the symptoms of a problem rather than its underlying causes, which can lead to interventions that only address surface-level issues. This is where the **5 Why's technique** becomes useful. The 5 Why's is a simple but effective method for getting to the root of a problem by repeatedly asking "Why?" until the fundamental cause is uncovered. For example, if a water and sanitation project is failing to deliver results, you might begin by asking, "Why are communities not using the newly built latrines?" The answer might be that they are inconveniently located. You then ask, "Why are they inconveniently located?" and so on, until you reach the root cause---perhaps inadequate consultation with the community during the planning phase. Another diagnostic tool that can help you identify root causes is the **fishbone diagram**, also known as the Ishikawa diagram. This tool enables you to map out all the potential causes of a problem, grouping them into categories such as people, processes, materials, and environment. This visual representation helps you identify not only the immediate causes but also secondary or even tertiary factors that contribute to the issue. For example, in a programme aimed at reducing school dropouts, the fishbone diagram might reveal causes like poor teacher quality, lack of parental support, inadequate school infrastructure, and socio-economic challenges. Once you have identified the root causes of the problems, you can move on to mapping out potential solutions. This is where **problem and solution trees** come into play. A **problem tree** allows you to break down the problem into its causes and effects, providing a visual representation of how different factors are interconnected. For example, in a programme aiming to improve access to clean water, the problem tree might show that contaminated water sources lead to increased illness, which in turn reduces productivity and increases healthcare costs. The tree helps you see the broader impact of the issue and how solving one part of the problem can lead to wider benefits. A **solution tree** is the inverse of the problem tree. It helps you map out potential interventions and their expected outcomes. For instance, addressing contaminated water sources by providing water treatment facilities could lead to reduced illness, increased productivity, and ultimately improved economic conditions for the community. This process not only helps in designing interventions but also in clarifying the assumptions that underpin your Theory of Change. Each branch of the solution tree should be grounded in realistic assumptions about how and why change will occur. Developing a Theory of Change is both a process and a product. It requires a deep understanding of the context, the stakeholders involved, and the underlying causes of the issues you are trying to address. The tools we've introduced---situational analysis, SWOT, PESTLE, 5 Why's, fishbone diagrams, and problem and solution trees---will help you build a solid foundation for your Theory of Change. These tools will be explored in greater detail later, but for now, consider them as key components in the diagnostic process that informs the development of effective, evidence-based interventions. By using these tools, you will not only be better equipped to map out how change is expected to occur, but you will also have a clearer understanding of the assumptions that need to hold true for your interventions to succeed. In monitoring and evaluation (M&E), conducting a **situational analysis** and **stakeholder analysis** are critical steps in the early stages of planning any intervention. These processes lay the groundwork for understanding the context within which a programme will operate and ensuring that all relevant parties are identified and considered. This week, we will focus on introducing these two essential components---situational analysis and stakeholder analysis---as they provide the foundation for more in-depth planning and the development of tools like the Theory of Change, which we will explore in detail later. 5.1 Situational Analysis ------------------------ A **situational analysis** is the process of systematically examining the current conditions in which a programme or intervention will take place. This analysis identifies key factors influencing the success or failure of an intervention, offering insights into the needs, challenges, opportunities, and resources present in the environment. Understanding the situation at hand allows us to tailor interventions to the real-world context, increasing the likelihood of successful implementation. Situational analysis can be conducted at various stages of a programme---before implementation to inform planning, during implementation to adjust and refine strategies, or as part of an evaluation process to assess the outcomes. By analysing the current situation, programme designers and evaluators can avoid assumptions and instead rely on evidence-based understanding to guide decision-making. **Key Aspects of Situational Analysis** When conducting a situational analysis, the following aspects are typically considered: 1. **Needs Assessment**: Understanding the gaps and needs of the target population is fundamental. For example, in a health intervention, this could mean identifying the specific healthcare challenges faced by the community, such as a lack of access to clean water or insufficient medical facilities. 2. **Resource Availability**: Identifying the resources---both financial and human---that are available to support the programme. This includes assessing whether there are sufficient funds, personnel, and materials to achieve the desired outcomes. 3. **Strengths and Weaknesses**: Every situation has inherent strengths and weaknesses. Strengths might include existing community support for a programme or the presence of skilled staff, while weaknesses might involve a lack of infrastructure or inadequate communication channels. 4. **Opportunities and Threats**: These are external factors that could impact the success of the intervention. Opportunities might arise from changes in government policy that support your programme's goals, while threats could come from economic instability or opposition from local groups. A comprehensive situational analysis is the cornerstone of good project planning, ensuring that decisions are based on a clear understanding of the context and challenges faced. In government and large organisations, tools like **Scenario Planning**, **SWOT analysis**, and **PESTLE analysis** are often used to facilitate this process. We will discuss these tools in detail later, but they each serve to help break down and categorise the information gathered during a situational analysis. 5.2 Stakeholder Analysis ------------------------ Alongside the situational analysis, a **stakeholder analysis** is crucial in identifying and understanding the people, groups, and organisations that have an interest in or influence over the programme. Stakeholders can significantly affect the success or failure of an intervention, and understanding their roles, interests, and relationships is essential for effective planning and implementation. We have discussed stakeholder analysis in detail in CME4161 - Monitoring & Evaluation Fundamentals. Stakeholders may be internal, such as the staff or management team responsible for delivering the programme, or external, such as government bodies, community groups, or donors. Each stakeholder will have a different level of influence and interest in the programme, and their perspectives must be considered during the planning process. **Distinguishing Stakeholders and Target Groups** One important distinction to make during stakeholder analysis is between **stakeholders** and **target groups**. - **Stakeholders** are any parties that have an interest in or can influence the intervention. These could include investors, employees, government agencies, civil society organisations, or community leaders. Stakeholders may have varying degrees of power and influence over the programme, which makes it important to understand their potential roles and interests early on. - **Target groups**, on the other hand, refer to the specific population that the programme seeks to benefit. For example, in an educational programme, the target group would be the students, while stakeholders could include teachers, parents, government officials, and funding organisations. While the target group is often the primary focus of programme design, understanding the broader network of stakeholders is just as important. Failure to account for stakeholder interests and influence can lead to conflicts, delays, or even failure of the intervention. **Key Considerations in Stakeholder Analysis** A stakeholder analysis involves several key steps to ensure all relevant parties are considered. These include: 1. **Identifying Stakeholders**: This step involves listing all the people, groups, or organisations that have an interest in the programme. This can include internal stakeholders such as staff members, as well as external stakeholders such as community groups, government departments, and donors. Identifying stakeholders early helps ensure that their needs and expectations are considered throughout the planning and implementation process. 2. **Assessing Stakeholder Characteristics**: Once stakeholders are identified, it is important to evaluate their characteristics. This can include their knowledge of the programme or institution, their attitude towards it, and their potential for collaboration or opposition. Understanding these characteristics helps to anticipate how each stakeholder might support or hinder the programme. 3. **Evaluating Stakeholder Influence**: Stakeholder influence refers to the amount of power a stakeholder has over the programme or institution. Some stakeholders may have a high level of influence but little interest in the programme's day-to-day operations, such as government regulatory bodies. Others may be highly invested in the programme's success but lack formal power, such as community leaders or beneficiaries. Evaluating influence helps in determining how much effort should be put into engaging each stakeholder group. 4. **Assessing Stakeholder Interest**: Stakeholders will have varying levels of interest in the programme. Some may be highly engaged, while others may have a more peripheral interest. Understanding this helps in prioritising engagement efforts and ensuring that key stakeholders remain informed and supportive throughout the project lifecycle. 5. **Understanding Stakeholder Linkages**: Relationships between stakeholders can significantly affect the programme. Some stakeholders may have formal partnerships or alliances, while others may be in conflict with each other. These dynamics need to be considered when planning stakeholder engagement strategies. By conducting a thorough stakeholder analysis, you can ensure that your programme accounts for the needs, expectations, and potential contributions of all relevant parties. Moreover, understanding the relationships between stakeholders can help in managing conflicts or leveraging alliances to achieve the programme's goals. In summary, both situational analysis and stakeholder analysis are critical components in the early stages of planning an intervention. A situational analysis helps you understand the environment in which your programme will operate, while a stakeholder analysis ensures that all interested parties are identified and considered in the planning process. These analyses lay the foundation for more detailed planning tools, such as the Theory of Change, which we will discuss later. By taking the time to thoroughly assess the situation and identify stakeholders, you can create more effective, evidence-based interventions that are more likely to achieve their desired outcomes. These analyses not only provide a clearer understanding of the context but also enable more informed decision-making as you move forward with your programme planning. Lesson 6: PESTLE Analysis in-depth ================================== *This activity aligns with Weekly Outcome 4* *Estimated time on task: ±10 minutes.* In monitoring and evaluation (M&E), a key challenge is understanding the external environment in which a project or programme operates. This is where a PESTLE analysis becomes highly valuable. PESTLE, an acronym for Political, Economic, Social, Technological, Legal, and Environmental factors, is a tool used to identify and analyse external influences that may impact the success of a project or initiative. In this context, it is instrumental in informing the development of a **Theory of Change** (ToC). By providing a structured way to examine the external environment, a PESTLE analysis helps to ensure that the interventions being planned are relevant, feasible, and sustainable in the face of potential external changes. In this lesson, we will explore how PESTLE analysis can be applied to the process of developing a Theory of Change and how it can inform strategic decisions. By the end of this discussion, you will have a clear understanding of how to use this tool effectively, the strengths and weaknesses of the PESTLE framework, and its application in real-world M&E scenarios. 6.1 What is PESTLE Analysis --------------------------- A PESTLE analysis allows an organisation to examine the macro-environmental factors that may influence its operations. It encourages a holistic understanding of external conditions, ensuring that strategic decisions are informed by a wide variety of influences. The six components of PESTLE---political, economic, social, technological, legal, and environmental---capture different facets of the external environment, providing a comprehensive view of the context in which the organisation operates. +-----------------------------------+-----------------------------------+ | **Political factors** | What is the current political | | | situation? | | | | | | Government policies: National, | | | provincial, local; Government | | | resource allocations; Changes in | | | power, influence, connectedness | | | of key relevant actors/groups; | | | Expected direction of future | | | political change; among others. | +===================================+===================================+ | **Economic factors** | What are the prevalent economic | | | factors? | | | | | | Economic situation: local, | | | national, regional, global; | | | Financial situation of key | | | stakeholders or other relevant | | | entities; Availability of private | | | sector resources relevant for the | | | project/initiative; Expected | | | direction of economic change; | | | among others. | +-----------------------------------+-----------------------------------+ | **Social factors** | What is the current social | | | environment? | | | | | | Demographics and population | | | trends; Education levels; Access | | | to essential services; Public | | | perceptions; Knowledge, attitudes | | | and practices of a particular | | | population group; among others. | +-----------------------------------+-----------------------------------+ | **Technological factors** | What technological innovations | | | are likely to affect the | | | institution? | | | | | | Population groups' access to | | | technologies; New technologies | | | that could affect the context | | | significantly, or that could be | | | used to achieve objectives; | | | Potential for innovation; among | | | others. | +-----------------------------------+-----------------------------------+ | **Legal factors** | Is there legislation that | | | influences an institution, or are | | | there any changes in the | | | legislation that may affect an | | | institution? | | | | | | Human rights; existing | | | legislation having an impact on | | | other factors, or affecting | | | population groups, or the work of | | | the institution; international | | | agreements; among others. | +-----------------------------------+-----------------------------------+ | **Environmental factors** | What are the environmental | | | concerns that should be | | | considered? | | | | | | Contextually relevant | | | environmental issues; | | | Environmental impacts of planned | | | or ongoing activities; Relevant | | | environmental regulations or | | | requirements; trends or expected | | | future developments in the | | | environment; among others. | +-----------------------------------+-----------------------------------+ Adapted from NSG (2018) **[Download Editable template here]** 6.2 How PESTLE Analysis Supports the Theory of Change ----------------------------------------------------- A **Theory of Change** outlines the pathway by which a programme is expected to achieve its outcomes. It articulates the assumptions underlying the intervention, the activities required to bring about change, and the external factors that might influence these processes. This is where the PESTLE analysis becomes critical: it helps project designers and managers identify external factors that can either support or hinder the desired change. For example, political instability (a **political factor**) may derail the progress of an educational programme that relies on consistent government support. Similarly, an economic recession (an **economic factor**) might limit the availability of funding or resources for a health intervention. By identifying these factors early on, a PESTLE analysis enables programme designers to build in contingencies or mitigate risks, thereby strengthening the overall Theory of Change. A PESTLE analysis also helps organisations anticipate **opportunities**. For instance, advancements in mobile technology (a **technological factor**) might provide new avenues for delivering educational content to remote areas. Identifying such opportunities early in the planning process allows organisations to adapt their Theory of Change to take advantage of these external factors, potentially improving the effectiveness of the intervention. 6.3 Key Stregnths & Weaknesses of the PESTLE Analysis ----------------------------------------------------- **Strengths** **Weaknesses** ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Provides a comprehensive view of the environment in which a project will operate. This helps ensure that no critical influences are overlooked, and it reduces the likelihood of unforeseen challenges derailing the project (NSG, 2018). Can be a time-consuming process that requires significant expertise, particularly when the external environment is complex. As a result, organisations may need to hire external facilitators to guide the process (NSG, 2018). This can be costly, particularly for smaller organisations or projects with limited resources. helps to align the organisation's strategy with the broader context, ensuring that the intervention is responsive to both opportunities and challenges in the environment. This, in turn, improves stakeholder buy-in, as the project is seen to be both relevant and sustainable. The effectiveness of a PESTLE analysis is highly dependent on the quality and availability of data. In some contexts, reliable information about political or economic factors may be difficult to obtain, making it harder to draw accurate conclusions. By identifying potential threats early on, a PESTLE analysis enables project managers to develop strategies to mitigate these risks. For example, if a legal change is anticipated, the project can adjust its operations to remai

Week 2 Building Blocks (M&E) - Postgraduate Diploma

Document Details

Tags

Related

Summary

Full Transcript

Upgrade to continue