Systematic Intervention Design Notes Summary PDF

**Systematic intervention design notes summary** [Introduction to systematic psychological design & psychology] The science of psychology concerns - Explaining - Predicting - Influencing (What SPD focuses on) - Behaviour Roles of an SPD'er - Designer - Researcher - Adviser [...

**Systematic intervention design notes summary** [Introduction to systematic psychological design & psychology] The science of psychology concerns - Explaining - Predicting - Influencing (What SPD focuses on) - Behaviour Roles of an SPD'er - Designer - Researcher - Adviser [Core concepts of SPD] What is SPD: 'Can be considered as the discipline that encompasses knowledge and skills to systematically develop psychological interventions and to use or apply these interventions in order to solve psychological problems.' 5 core concepts of SPD 1. Psychological problem 2. Intervention 3. Behavioural change 4. Psychological knowledge 5. Systematic (Psychological design) What is a psychological problem?: "A psychological problem follows from the observation that there is a difference between an actual situation and a desired situation and that this difference can be decreased by means of an intervention aimed at change behaviour." Undesired behaviour is stopped by a behavioural intervention and then changed into desired behaviour. We design for society A psychological problem = a societal problem = related to the behaviour and functioning of large social groups which are a part of society. Intervention = 'a set of measures, resources and people which is employed to influence or change people's behaviour.' What is behaviour? 1. You can do it 2. Directly observable for you and others 3. It is concrete ASCE model Analysis - Problem analysis - Behavioural analysis - Analysis of determinants Synthesis - Defining objectives - Methods & strategies Construction - Intervention design - Implementation Evaluation - Effect evaluation - Process evaluation [A brief overview of the ASCE model ] ASCE model involves a logical, controllable and stepwise approach or method in order to design a psychological intervention. Characteristics of a systematic approach: - A blueprint (description of elements that are part of the intervention) - Transparent design process (written intervention report) - Structure - Systematically record all design choices - Reflection Circles of the ASCE model 1. Involvement: \- Designer informs environment about activities \- Designer considers feelings and views of the environment \- Environment trusts designer and her / his activities \- Liaison group / linkage group -\> contains representatives from all stakeholders and is involved and consulted during the design process. 2\. Accountability: \- Is every step correctly executed? \- Are all choices and decisions based on reliable and scientific sources? [What is the problem analysis?] It is an in-depth description of the problem 6 Guiding questions: 1. What is the problem? 2. Why is it a problem? 3. How common is the problem? 4. What are the consequences of the problem? 5. Who is the at-risk group? 6. Who is the target group? Possible relations between target group and at-risk group: 1. At-risk group = target group 2. Target group is a part of the at-risk group 3. At-risk group and target group are separate; only possible when changing the behaviour of the target group indirectly changes the behaviour of the at-risk group. Problem statement: - A compact description of the psychological problem that needs to be solved, preferable in one sentence - Formulated after 6 guiding questions have been answered A clear problem definition... -... Provides insight in what needs to be explained -... Facilitates starting points for literature research -... Is a guideline for the design process of the intervention [How to carry out the problem analysis?] How do you write the problem analysis? There are 3 ingredients: - (Scientific) sources - Funnel structure - The art of writing Funnel structure: - Black box -\> a device, system, or object which produces useful information without revealing any information about its internal workings Communication and writing process which results in a problem analysis is done in this structure: 1. Meeting with the problem owner 1. What is the psychological problem from the client's perspective? 2. Is it a psychological problem? 3. Can it be solved by behavioural exchange? 4. What are the mutual expectations? 2. Explorative literature search 5. Websites, books, scientific databases 3. Reading, selecting, processing, analysing & combining 6. Making choices! 4. Drafting, writing 5. End result: problem statement 7. End result: problem statement 8. A clear, concise and comprehensive written, in-depth description of the actual situation of the psychological problem in the form of a funnel structure in which academic argumentation is applied. [Behavioural analysis] What is behaviour? 1. You can do it 2. Directly observable for you and others 3. It is concrete 3 components: 1. Undesired behaviour (of the at-risk and/ or target group) 9. Identification on basis of scientific literature 2. Environmental influences 10. Five environments 1. Social (ex. Parents, friends...) 2. Physical (availability of...) 3. Economic (available money for...) 4. Political (law) 5. Technological environment 3. Desired behaviour of the target group 11. Need the analysis of undesired behaviour to describe the desired behaviour All is dependent on selected at-risk group and target group Intervention objective: -... Has to be measurable -... Has to be achievable How to write it down: \[Behaviour Y\] of \[Target group Z\] is decreased (or increased) by X% within X months (or days, weeks, years) after the intervention. [Analysis of determinants] Determinants: "... Factors that underlie behaviour..." - Can be changed - Related to cognitive processes 12. What causes the behaviour? 13. What promotes or detracts behaviour? Type of determinants - Proximal determinants 14. Direct effect on behaviour 15. Cognitive determinants - Distal determinants 16. Indirect effect on behaviour 17. They influence proximal determinants - Ultimate determinants 18. Cannot be changed 19. Have an influence on distal determinants which influence proximal determinants which has an influence on behaviour Models that explain behaviours - Combine distal- and ultimate determinants into 'background variables' 20. Health belief model 21. Protection motivation theory 22. Social cognitive theory 23. Theory of planned behaviour [Defining objectives ] Synthesis: 'the combination of components or elements to form a connected whole.' Undesired behaviour -\> desired behaviour -\> behavioural objective Behavioural objectives describe desired behaviour in terms of concrete observable behaviour -\> what should the target group do? Formulate behavioural objectives (they have to be SMART): - Specific 24. What exactly should the target group do? (expected behaviour, clear and concrete) - Measurable 25. To check whether a goal has been achiever or not - Acceptable 26. It makes sense 27. Is socially acceptable - Realistic 28. What is feasible and what is too easy? - Timely 29. Indicate when you expect a change Change objective = what does the target group need to learn or change based on the determinants in order to achieve the behavioural objective - Combination of behavioural objective & determinants - Schematic representation [Schematic representation] Target group Determinant 1 Determinant 2 Determinant 3 ----------------------------- ------------------ ------------------ ------------------... Behavioural objective 1 Change objective Change objective... Behavioural objective 2 Change objective... Behavioural objective 3 Change objective Change objective Formulate change objective: - Attitude 30. "Think it is important that..." 31. "Are convinced that it is important to..." - Subjective norm 32. "Know that others think that it is normal to..." 33. "Have the idea that others expect them to..." - Perceived behavioural control 34. "Feel capable of..." 35. "Trust their ability to..." [Methods & strategies] 1. What do we want to achieve in an intervention? - Behavioural objectives and change objectives 2. How do we want to achieve behavioural and change objectives? - Schematic representation with important determinants -\> relevant, applied package of methods and strategies 3. Why do we want an applied package of strategies? - Effective systematic evidence-based intervention -\> circle of accountability Method: "a theoretical process for influencing changes in the determinants of behaviour and environmental conditions." - Theories for behavioural change - Active ingredient = psychological mechanism Theoretical method: - Includes a psychological mechanism - What does a theory for behavioural change imply? - A psychological mechanism: "X has an influence on Y" A method: -... Is based on theory -... Includes a psychological mechanism -... Is abstract -... Is not likely to be mentioned in academic literature A method is based on: -... Change objectives and determinants -... Are deducted from theories of behavioural change -\> derive from scientific literature Examples of theories of behavioural change: - Elaboration likelihood model: based on the notion that there are two routes in information processing: indirect & direct - Theoretical model: states that there are several stages of change, if you know in which stage of change the target group is, you can select methods & strategies that are proven to work in that stage of change. - Social cognitive theory: learning theory that states that you learn by observing others Parameters of modelling: - Personal relevance - Identification - Demonstration of behaviour - Support, appreciation and reward - Coping Now choose strategy based on the method Practical strategy = 'a specific technique for the application of theoretical methods in ways that fit the intervention population and the context in which the intervention will be conducted.' A strategy: -... Fits intervention population -... Fits the context of the intervention -... Is concrete -... Is likely to be mentioned in academic literature A strategy is based on: -... The intervention population & context -... Method -... Conditions and limitation for optimal use of theory (parameters) 36. Connection with method and its theory needs to be clear and logical A method describes what you are going to do, the strategy describes how you are going to do this. Difference between methods and strategies - A method is always derived from a theory - A method always contains a psychological mechanism For one method: - You can choose more than 1 strategy A strategy: - Can fit with more than 1 method Pitfalls selecting methods and strategies: - Forget to take into account the parameters of theoretical method - Only select strategies How to choose method and strategies: 1. Select a change objective 2. Which determinant belongs to the change objective? 3. Select a suitable method for the change objective 4. Select a suitable strategy for the method [Intervention design] Intervention design: "The design of the set of measures, resources and people which is employed to influence or change people's behaviour." An intervention design: -... Is a combination of strategies -... Consists of elements 37. Combination of two or more strategies -... Is a creative process -... Is a blueprint Intervention design is not equal to separate strategies When you know what your elements are -\> make a timeline Creative process: - Innovative - Stand out - Tailored Blueprint = "A written detailed outline of the intervention programme." - Written visualisation of the intervention Pre-test -\> can test the effectiveness of certain elements in the programme Pilot-test -\> tests the final programme Supporting elements of intervention design: - Channels & media - Message - Materials - Culture - Involvement & accountability - Scope How to write the intervention design chapter: - Use logical structured arguments to combine the strategies into elements - In-depth description of the elements - Account for (all) design choices - Add a timeline - Think about the pre/pilot test and write down your thoughts - Check if all objectives can be achieved - It is a practical visualisation of the design [Implementation] Aim of the implementation: how do we ensure that the target group participates in the intervention? "Intervention within an intervention" Important questions: - Who is going to use the intervention? (the target group of the intervention) 38. Innovators (2,5%) 39. Early adopters (13,5%) 40. Early majority (34%) 41. Late majority (34% 42. Laggards (16%) - Which stakeholders have to be involved? - Who provides the resources? - Who is going to implement the programme? - Who is responsible for the continuation of the programme? - Identifying intermediaries Stakeholder = a person or organization that has an influence or may influence the intervention Intermediary = a person or organization that has an influence or may influence the intervention and is part of the implementation plan Advantages of group involvement: - Different views of participants are heard and can be taken into account - Identifying 'champions'/ 'change agents' - Offer support to each other (workshop, advice etc) How do we ensure that the target group participates in our intervention? - How do we ensure that the intervention is conducted? - How do we ensure that the intervention is conducted as intended? This is achieved by: 43. Internal consistency - Designing in a systematic and scientific supported manner (circle of accountability) 44. Relational consistency - Designing for and with your target group, liaison group (circle of involvement) 45. Implementation plan - Designing a new intervention with a different objective: ensuring that the target group participates in the intervention - Identifying stakeholders and intermediaries - Formulation implementation objectives - Selection of relevant determinants - Selection of relevant methods - Selection of relevant strategies - (This is all linked to the diffusion of innovations theory) Diffusion of innovations theory (DIT) "Explains how innovations are taken up, accepted and sustained in a population." There are 4 phases in the DIT 1. Dissemination - The target group knows about the existence of the intervention 2. Adoption - The target group decides to participate 3. Implementation - Is the intervention conducted as intended? - Fidelity = the extent to which the programme elements are carried out according to the guidelines of intervention design - Completeness = how many programme components are actually implemented of the intervention design 4. Continuation - The intervention is continuously offered or used Institutionalization = a routinization, or the progression of an innovation to an indistinguishable part of the individual or organization host's practices (degree of intensiveness) Components of institutionalization: - Passages = annual celebration of the continuation of the intervention - Routines = operating structures and functions in to which programme protocols are embedded - Niche saturation = a complete integration to a subsystem structure and functions [Evaluation] Evaluation: "To judge the value, meaning or importance of a product or process." Why would we evaluate? - Justification - Learning for the future - Improving intervention theory Evaluation - Applying (social) research methods Evaluation plan: 46. (Evaluation) objectives - Short-term objectives: change objectives, behavioural objectives - Long-term objectives: Intervention objective - Implementation objectives: from the implementation plan - Clear critical!! 47. Research design - What is a suitable research design? 48. Measures - Which measures are suitable? (Questionnaire, observation, interviews, physical measures) - Validated measures v. non-validated measures 49. Respondents - What are suitable respondents? - Who are the respondents? - Which sampling method do you apply? - What is the size of your experimental and control group? 50. Time of measurement - At which moment in time do you measure? - Before the intervention? - After the intervention? - Before and after the intervention? - Repeated measures 51. Data analysis - Which data analysis methods are suitable? - Descriptive statistics: percentages, frequencies, averages (T-test, ANOVA, Regression) Types of Evaluation: - Effect evaluation "was the intervention effective?" (refers to objectives) - Process evaluation "was the intervention conducted as intended?" (refers to implementation plan) Effect evaluation: 52. What do we want to achieve with the intervention 53. Was the intervention effective? - Are the objectives achieved? (intervention objective, behavioural objectives, change objectives) Process evaluation: 1. How do we ensure that the target group participated in the intervention? 2. Was the intervention conducted as intended? - Is the implementation plan correctly executed? - Are all design steps correctly executed? (summative evaluation) - Was there a formative evaluation as well? (any evaluation that takes place before or during the intervention's implementation with the aim of improving the intervention's design and effectiveness) - Appreciation of target group and intermediaries? Formulate evaluation objectives with measurable criteria