Week 1-6 总结 Research Evaluation

Week 1 - Evaluation and Research Class 2025

• The class covers the basics of research and evaluation
• Class times are scheduled for either January 7th or January 8th

Course Overview

• Primary goal is to understand the core differences between research and evaluation
• Students will learn the research design process and data collection methods
• The importance of research ethics as outlined in TCPS 2 training will be covered
• Students will learn to write a research proposal

Research vs. Evaluation

Research

• Its goal is to discover new knowledge and build or test theories
• Employs systematic investigation, experiments, and data analysis
• Results in new findings that can be published or used to guide practice

Evaluation

• Aims to assess the effectiveness of a project, program, or policy
• Employs data analysis, interviews, and surveys
• Results in recommendations for improvement and influence decisions

Case Examples

• Research: Studying how to improve mental health for long-term care patients
• Research: Investigating how new therapies affect Alzheimer's
• Evaluation: Assessing the effectiveness of a mental health plan in a nursing home
• Evaluation: Assessing the effectiveness of current treatment programs

Key Terms

• Hypothesis: A prediction made before conducting research
• Variables: Elements that influence the outcomes of a research study
• Quantitative Research: Employs statistical analysis and surveys
• Qualitative Research: uses interviews and observations

Week 2 - Evaluation and Research Design Process

Course information

• Reviews Week 1 topics, including research terms and ethics
• Covers the evaluation and research design process
• Analyzes case studies like the Stay Active program and Mohawk College research projects
• Research teams complete contracts and develop research proposals

Research Terminology

• Consent: Participants must fully understand and voluntarily agree to take part in research
• Confidentiality: Data must be protected and not disclosed to unauthorized individuals
• Conflict of Interest: Researchers must not let financial or personal interests affect research

Evaluation & Research Process

• Key questions include what the main issue is and what specific goals are sought

Six Steps of Research Design

• Research Question: Clearly define the main problem the research aims to solve
• Objectives: Identify specific goals to be achieved through the research
• Methodology: Decide whether to use quantitative or qualitative methods
• Data Collection: Gather data through questionnaires, interviews, observations, or experiments
• Data Analysis: Analyze data using tools like SPSS, NVivo, or Excel
• Research Report: Compile findings into a research paper or report

Case Study: Stay Active Program

• Aims to increase activity and well-being of hospitalized patients
• Uses pre- and post-assessments to measure changes
  • Sense of Belonging Questionnaire to assess patients' social belonging
• Satisfaction surveys to gather feedback on the program using Qualtrics
• Retention and Registration Data collected from hospital records

Research Team Tasks

• Teams create contracts outlining roles, goals, methods, and data collection

Week 2 - RT Research Projects and Proposal Ideas

Course Goals

• Students learn RT research projects in areas such as music and exercise therapy
• Focuses on creating ideas for research proposals and writing grant applications

Research Project Examples

• Music Therapy: Examines its effects on the mental well-being of seniors, using qualitative interviews
• Exercise for Arthritis: Studies the impact of pedal exercises on elderly arthritis; employs quantitative surveys

Essential Proposal Elements

• Novelty: Research should be innovative and not duplicate existing work
• Relevance: Should be relevant to recreation therapy
• Feasibility: Projects must be realistic and doable within set limits

Week 3 - Research Grants and Grant Application

Objectives

• The course assists in learning the grant application procedure and where to find resources
• The course enforces the use of ethical and research standards
• Students are to finalize their research team contract and start writing the first three segments of the grant application

Key grant providers

• Research Institute for Aging: Centers on elder care, brain disorder, and wellbeing of workers.
• Centre for Elder Research: Centers on growing old safely, new methods of long-term care, and awareness.
• Ontario Centres for Learning, Research, and Innovation in Long-Term Care: Centers on care in the long term

Key Research Terms

• Methodologies: Ways of doing research
• Systematic Review: Organized, step-by-step analysis
• Scoping Review: An outline of existing research

Grant Application Process

Section 1: Background

• Explain research topics
• State how the research is important and its effects on RT
• Support with references
• Uniqueness(Novelty)

Week 4 Data Collection Methods Topics

• Recap research terms
• Discusses ways to amass data for research
• Discusses Bramm Research and their take on survey design

Data Collection Methods Overview

• Data gathering defines the consistency(Reliability) and accuracy(Validity)of the project
• Sections 4/5 of a template would require details of both resources and ways of collection
• Most assignments will need over 2 different ways of retrieving information

Common Methods of Data Collection

• Surveys(Survey): Organized, mass collection - Fast and simple to analyze, Risk of answers being untruthful
• Interviews(Interviews): Direct, over the phone, and detailed - Highly insightful, Takes time and is hard to analyze
• Observation(Observation): A recording of a subject - Real and no risk of skew influence, Results may be skewed nonetheless
• Experiments(Experiments): A adjustment to the subjects/scenario - Causal link is certain, Results may be too clean/sterile

Tips Survey Design According to Bramm Research

• Purpose: A well defined aim
• Intended Viewers(Target Audience): A survey tailored to those answering
• Survey Layout(Survey Format): Virtual versus physical

Sections 4 & 5: Research Proposal

• Section 4 asks where facts will come from and who/what your target audience is
• Section 5 asks about the ways data will be amassed

Week 5: Data Collection Methods 2 & PROMS

What is included:

• Gathering methods/Focus Groups
• Client results in reports
• Gathering availabilities

Poorly Designed Questions

• Avoid questions that are unclear: "Do you favor raising camper fees for trip programs but not for other camp programs?"
• Avoid questions that point to an answer: "Camp encourages character development. Did you attend camp as a child?"
• Avoid questions that don't give sufficient information: Currently, the United Way supports 10% of the agency camp budget. Do you feel this amount should be:
  • a. Decreased
  • b. Stay the same
  • c. Increased somewhat
  • d. Increased greatly
• Avoid questions that are full of acronyms: "Did you use the ACA, CCI, or AEE Camp Directories when selecting the camp for your child?”

Data Collection - Overview

• Qualitative collections allows:
  • A deep look into attitudes and feelings
  • Ability to answer "why" questions
  • Responses to be thoughtful

Discussion Format:

• Moderator sets up the questions and posts a few questions to get the discussion rolling

Interview Guide

• Semi-structured, allows for both formal and informal communication

Patient Results

• Standard surveys which report the result in numbers