Monitoring and Review of Student Engagement in Brightspace.docx

**[Monitoring and Review of Student Engagement in Brightspace]** **Unit Overview Widget** The Unit Overview widget is a dashboard on your unit homepage that allows you to see some data about unit access and engagement. This widget is available for staff only. The widget displays high-level aggreg...

**[Monitoring and Review of Student Engagement in Brightspace]** **Unit Overview Widget** The Unit Overview widget is a dashboard on your unit homepage that allows you to see some data about unit access and engagement. This widget is available for staff only. The widget displays high-level aggregate information about the unit and links to unit-specific reports. For example, the widget displays a visualisation of weekly unit access (the Unit Access report as a bar chart) and how many students submitted quizzes today. In addition, the widget includes links to the Class Engagement tool, Course (Unit) Access and Tool Access reports. **Benefits of using the Unit Overview Widget** - Get a quick overview of how many students have accessed your unit this week.  - Use the **Class Engagement** report to see which students have accessed your unit, whether they are participating in discussion boards as well as the current distribution of grades in your unit. You can click on the Grade Distribution chart to filter students in specific ranges and click on any of the columns for further sorting. \ **Note: **The \'current grade\' will be drawn from the \'Final Calculated grade\' in the Gradebook. This grade is calculated from the weighted scores recorded in the Gradebook and is not visible to students. *Class Engagement Report* - Use the **Course (Unit) Access** report to find out when students are accessing your unit. This can be a useful insight in relation to any asynchronous tasks or assessments that you have scheduled. You can zoom in on specific time frames by clicking and dragging across the lower graph, as well as filtering by specific roles. *Course (Unit) Access Report* - Use the **Tool Access** report to see which tools are being most accessed by students. Benefits of this report are deeply rooted in the context of your unit and how it is delivered, but may reveal student behaviours that correlate to specific tasks that you have set. **Student Progress overview** **The Class Progress report** **How to Access:\ **The Class Progress tool is quick and easy\ to access from the **Analytics **link on the** \ navigation bar** of your unit. The **Class Progress** tool allows you to track the overall progress of students enrolled on a unit. It provides you with a view of all students with some basic indicators from which you can delve into the details by simply clicking on a student name or activity to view an individual\'s progress in more detail. And if you have a large cohort, use the **search function** to find individual students. Students see their own version of Class Progress, called My Progress, which shows just their own progress data. Example: use Class Progress to quickly check how many times a student has logged into Brightspace in the past month, or to see how they have been engaging with discussion forums. **Benefits of using the Class Progress report:** - View the overall percentage of total content visited per student, or broken down via each module and topic - View the Login history for Brightspace of your students for the last month, or a breakdown of the dates and times each student was online in the unit - See an overview of a student\'s interaction with Discussion forums displaying what has been read, and threads created or replied to - Check a student\'s Quiz attempts, Checklist or Survey completions by clicking on any student name to view further details. **Student Interaction\ with Discussions** **Discussion statistics** Discussion statistics give an overview of student activity in your discussion topics and forums. With this information you can easily monitor student participation levels and determine which topics stimulate conversation and which do not. Access Discussion statistics by clicking on **Communication **in the navigation bar and selecting **Discussions**. Select the **Statistics **tab. Example: use statistics around Discussions to encourage students who have not been contributing to participate, or to recognise and acknowledge those who are regularly engaging with content. **Benefits of using the Discussion statistics:** - Under the **Forums and Topics tab**, view the activity for each discussion at forum and topic level - View individual and group student discussion interactions against the overall totals - Sort statistics by clicking on any column heading - Statistics do not include unapproved and deleted posts. **Student content engagement** **Using the Content Usage report** The **Content Usage** report provides statistics on the number of students visiting each piece of content on a unit with the average amount of time spent. Content is broken down into module and topic areas. Drill down into each individual content area to view the **students who have visited** and **total time** spent **per student** name. The **Users tab** provides a breakdown by individual student. The list of topics with number of visits and the average time spent on each can also be **exported to CSV** file. **How to Access:\ **From your unit home page nav bar,\ click on **Analytics** \> **Content Usage** **Report**  Example: use the Content Usage report to monitor how students are engaging with particular learning materials such as lecture recordings. **Benefits of using the Content Usage report** - Each piece of content is displayed with an icon enabling you to quickly identify the nature of the content; whether it is a Word document, a PowerPoint, a web page etc. - Content access information is restricted to student roles so no teaching team access will be distorting the statistics. - **Panopto engagement** - **Analysing views and downloads of\ Panopto recordings** - - Use Panopto\'s **analytics dashboard** to view statistics around recorded and uploaded videos, including the **number of views** or **downloads** for your unit. For each video you can see the attention span and drop out rate of students when viewing particular recordings. Pre-populated graphs also show you the number of minutes delivered (i.e. number of minutes streamed and downloaded combined) and where students have engaged with the recording by adding notes. Statistics can also be viewed for your Panopto recording folder as a whole. - Example: use Panopto analytics to view student engagement with a recording of a guest lecture, or to determine the use of video revision resources. **Gradebook statistics** **Viewing class statistics in the Gradebook** For each grade column in the Gradebook you can view the grade statistics, including: - Grade distribution - Mean - Median  - Mode and - Standard deviation for the class. You can also drill down further into individual student grades via the User Statistics tab. To access gradebook statistics, click on Grades in the unit nav bar. From your chosen grade column, click on the drop down menu in the column heading and select Statistics. Example**:** use the Gradebook statistics tool to view the grade distribution for a particular assignment before publishing grades. **Benefits of looking at gradebook statistics:** - Quickly view the grade distribution and statistics for a particular assignment or any graded activity. **Quiz activity** **Review student engagement with quizzes** Use the Quiz Statistics report to view the **overall class scores** and **grade averages** on an online quiz. View the **average grade for** **individual quiz questions** and delve into **question response details**.  Access the reports by going to **Unit Admin** on the navigation bar and selecting **Quizzes **(under Assessment). Click on the **drop down next to your quiz** and select **Statistics.** Example: use the quiz statistics report to review the effectiveness of quiz questions. For example, perhaps a low range of correct responses means a question needs rewording or that further learning material is required for a particular topic. **Benefits of reviewing quiz statistics:** - View quiz statistics via User statistics, Question statistics or Question details - be aware that statistics are calculated based on a students\' first attempt on a quiz - The **Question** **Details** tab displays each question with the spread of submitted responses, including written text answers - View a breakdown of the access time and number of attempts per student by clicking on **Attempt** **Logs** in the drop down menu next to the quiz. **Automate reporting with Intelligent Agents** **Monitor large cohorts using Intelligent Agents** Use Intelligent Agents to automate the monitoring of activity on a unit. Intelligent agents can be set to report on where activity has (or hasn\'t) taken place, for example around login activity or where content has been visited. **Automated notifications** can be sent to yourself, **emailed** **directly** **to** **students**, or set up to be **run** **manually** as required. The content of notification emails could include pre-determined feedback, appended files or even a Video Note. To set up agents, click on **Unit** **Admin** in the navigation bar of the unit then select **Intelligent** **Agents** (under Communication). Example*: s*et up an Intelligent Agent to let you know each week which students haven\'t logged into your unit in the past 7 days. **Benefits of using Intelligent Agents:** - Save yourself time by using Intelligent Agents to automate messaging to students - these can be reminders to access content, pointers to further resources where students have received a low score or to congratulate good performance - Build reports to get a view on progress in your unit, for example identify students with high grades or low grades, or students that have not visited the majority of content at a mid point in the unit - Make it easier to manage large cohorts by running reports across all students on the unit. - Remember, Intelligent Agents can work well when used to congratulate and encourage engagement - don\'t just use them for  negative purposes! *Intelligent Agent list on a unit* Use analytics reporting as a guide but be aware that figures will never be totally reliable. For example, a student may have engaged with learning materials via a friend\'s login screen, or a student may have clicked on a document but not have read it in its entirety.  **Unit Analytics report overview**