Generative AI in Education Policy Paper PDF

22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK GOV.UK Home Education, training and skills Generative artificial int...

22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK GOV.UK Home Education, training and skills Generative artificial intelligence (AI) in education Department for Education Policy paper Generative artificial intelligence (AI) in education Updated 26 October 2023 Applies to England https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 1/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK Contents Understanding generative AI Opportunities for the education sector Using AI effectively © Crown copyright 2023 Protecting data, pupils This publication is licensed under the terms of the Open Government Licence v3.0 except where otherwise and staff stated. To view this licence, visit nationalarchives.gov.uk/doc/open-government-licence/version/3 or write to the Information Policy Team, The National Archives, Kew, London TW9 4DU, or email: Formal assessments [email protected]. Knowledge and skills for Where we have identified any third party copyright information you will need to obtain permission from the the future copyright holders concerned. This publication is available at https://www.gov.uk/government/publications/generative-artificial- intelligence-in-education/generative-artificial-intelligence-ai-in-education https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 2/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK This document sets out the position of the Department for Education (DfE) on the use of generative artificial intelligence (AI), including large language models (LLMs) like ChatGPT or Google Bard, in the education sector. This statement: is informed by the government’s white paper on a pro-innovation approach to AI regulation (https://www.gov.uk/government/publications/ai-regulation-a-pro-innovation- approach) follows the government’s announcement to set up an expert Frontier AI Taskforce (https://www.gov.uk/government/publications/frontier-ai-taskforce-first-progress-report) to help the UK adopt the next generation of safe AI Understanding generative AI Generative AI refers to technology that can be used to create new content based on large volumes of data that models have been trained on from a variety of works and other sources. ChatGPT and Google Bard are generative artificial intelligence (AI) tools built on large language models (LLMs). Tools such as ChatGPT and Google Bard can: answer questions complete written tasks respond to prompts in a human-like way Other forms of generative AI can produce: audio https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 3/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK code images text simulations videos AI technology is not new and we already use it in everyday life for: email spam filtering media recommendation systems navigation apps online chatbots However, recent advances in technology mean that we can now use tools such as ChatGPT and Google Bard to produce AI-generated content. This creates opportunities and challenges for the education sector. Opportunities for the education sector Generative AI tools are good at quickly: analysing, structuring, and writing text turning prompts into audio, video and images When used appropriately, generative AI has the potential to: reduce workload across the education sector free up teachers’ time, allowing them to focus on delivering excellent teaching https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 4/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK However, the content produced by generative AI could be: inaccurate inappropriate biased taken out of context and without permission out of date or unreliable Using AI effectively Teacher workload is an important issue and we are committed to helping teachers spend less time on non-pupil facing activities. We are working with the education sector and with experts to identify opportunities to improve education and reduce workload using generative AI. Having access to generative AI is not a substitute for having knowledge in our long- term memory. To make the most of generative AI, we need to have the knowledge to draw on. We can only: learn how to write good prompts if we can write clearly and understand the domain we are asking about sense-check the results if we have a schema against which to compare them Generative AI tools can make certain written tasks quicker and easier, but cannot replace the judgement and deep subject knowledge of a human expert. It is more https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 5/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK important than ever that our education system ensures pupils acquire knowledge, expertise and intellectual capability. The education sector should: make the most of the opportunities that technology provides use technology safely and effectively to deliver excellent education that prepares pupils to contribute to society and the future workplace The limitations of generative AI tools Generative AI tools can produce unreliable information, therefore any content produced requires professional judgement to check for appropriateness and accuracy. Generative AI: returns results based on the dataset it has been trained on – for example, a generative AI tool may not have been trained on the English curriculum may not provide results that are comparable with a human-designed resource developed in the context of our curriculum Whatever tools or resources are used to produce plans, policies or documents, the quality and content of the final document remains the professional responsibility of the person who produced it and the organisation they belong to. Schools and colleges may wish to review homework policies and other types of unsupervised study to account for the availability of generative AI. Higher education institutions may wish to review the intellectual asset management guide (https://www.gov.uk/government/publications/intellectual-asset-management-for- https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 6/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK universities) in regards to developing student policies on the IP they create, and how they interact and use IP of others in light of generative AI use. Protecting data, pupils and staff Generative AI: stores and learns from the data it is given – any data entered should not be identifiable can create believable content, including more credible scam emails requesting payment – people interact with generative AI differently and the content may seem more authoritative and believable Schools and colleges should: protect personal and special category data in accordance with data protection legislation not allow or cause intellectual property, including pupils’ work, to be used to train generative AI models, without appropriate consent or exemption to copyright review and strengthen their cyber security by referring to the cyber standards (https://www.gov.uk/guidance/meeting-digital-and-technology-standards-in-schools-and- colleges/cyber-security-standards-for-schools-and-colleges) – generative AI could increase the sophistication and credibility of attacks ensure that children and young people are not accessing or creating harmful or inappropriate content online, including through generative AI - keeping children safe in education (https://www.gov.uk/government/publications/keeping-children-safe-in- education--2) provides schools and colleges with information on: what they need to do to protect pupils and students online https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 7/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK how they can limit children’s exposure to risks from the school’s or college’s IT system refer to the filtering and monitoring standard (https://www.gov.uk/guidance/meeting- digital-and-technology-standards-in-schools-and-colleges/filtering-and-monitoring-standards- for-schools-and-colleges) to make sure they have the appropriate systems in place Find out more on: ChatGPT and LLMs: what’s the risk (https://www.ncsc.gov.uk/blog-post/chatgpt-and- large-language-models-whats-the-risk) the principles for the security of machine learning (https://www.ncsc.gov.uk/collection/machine-learning) Data privacy It is important to be aware of the data privacy implications when using generative AI tools, as is the case with any new technology. Personal and special category data must be protected in accordance with data protection legislation. If it is strictly necessary to use personal and special category data in generative AI tools within their setting, the education institution must ensure that the products and procedures comply with data protection legislation and their existing data privacy policies to protect the data. Education institutions should also be open and transparent, ensuring the data subjects (pupils) understand their personal or special category data is being processed using AI tools. Find out more about: https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 8/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK personal data (https://ico.org.uk/for-organisations/uk-gdpr-guidance-and- resources/personal-information-what-is-it/what-is-personal-data/what-is-personal-data/) special category data (https://ico.org.uk/for-organisations/uk-gdpr-guidance-and- resources/lawful-basis/special-category-data/what-is-special-category-data/) Intellectual property Most generative tools will use the inputs submitted by users to further train and refine their models. However, pupils own the intellectual property (IP) rights to original content they create. Original content is likely to include anything that shows working out or is beyond multiple choice questions. Intellectual property can only be used to train AI if there is consent from the rights holder or an exemption to copyright applies. Some tools allow users to opt out of inputs being used to train the models. Education institutions must not allow or cause pupils’ original work to be used to train generative AI models unless they have appropriate consent or exemption to copyright. Consent would need to be from the student if over 18, and from their parent or legal guardian if under 18. Exemptions to copyright are limited, and education institutions may wish to take legal advice to ensure they are acting within the law. Formal assessments https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 9/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK Schools, colleges, universities and awarding organisations need to continue to take reasonable steps where applicable to prevent malpractice involving the use of generative AI. The Joint Council for Qualifications has published guidance on AI use in assessments (https://www.jcq.org.uk/exams-office/malpractice/artificial-intelligence/) to support teachers and exam centres in protecting the integrity of qualifications. This guidance includes information on: what counts as AI misuse the requirements for teachers and exam centres to help prevent and detect malpractice Knowledge and skills for the future To harness the potential of generative AI, students will benefit from a knowledge-rich curriculum which allows them to become well-informed users of technology and understand its impact on society. Strong foundational knowledge ensures students are developing the right skills to make best use of generative AI. The education sector needs to: prepare students for changing workplaces teach students how to use emerging technologies, such as generative AI, safely and appropriately At different stages of education, this teaching may include: the limitations, reliability, and potential bias of generative AI https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 10/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK how information on the internet is organised and ranked online safety to protect against harmful or misleading content understanding and protecting IP rights creating and using digital content safely and responsibly the impact of technology, including disruptive and enabling technologies foundational knowledge about how computers work, connect with each other, follow rules and process data The Office for AI (https://www.gov.uk/government/organisations/office-for-artificial-intelligence) is currently conducting research into the skills that will be needed for future workforce training. The education system should: support students, particularly young pupils, to identify and use appropriate resources to support their ongoing education encourage effective use of age-appropriate resources (which, in some instances, may include generative AI) prevent over-reliance on a limited number of tools or resources DfE will continue to work with experts to: consider and respond to the implications of generative AI and other emerging technologies support primary and secondary schools to teach a knowledge-rich computing curriculum to children up to the age of 16 Back to top https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 11/12 22/02/2024, 09:27 Generative artificial intelligence (AI) in education - GOV.UK All content is available under the Open Government Licence v3.0, except where otherwise stated © Crown copyright https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education 12/12