GPT-3: Language Model and Potential Implications Quiz

GPT-3 is a third-generation language model that is 10 times larger than Microsoft's Turing NLG.

The training data for GPT-3 comes from a filtered version of Common Crawl.

GPT-3 was trained on hundreds of billions of words and is also capable of coding in CSS, JSX, and Python.

A 2022 review again highlighted that the training continues to include review of Wikipedia.

GPT-3 is "eerily good" at writing "amazingly coherent text" with only a few simple prompts.

GPT-3 is a machine learning algorithm that has the potential to advance both the beneficial and harmful applications of language models.

The potential harmful effects of GPT-3 include the spread of misinformation, spam, phishing, abuse of legal and governmental processes, fraudulent academic essay writing and social engineering pretexting.

The authors call for research on risk mitigation in order to avoid these dangers.