What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata

By - The Royal Institution
Overview
Practice
Certification
Reminders

Description

How are technologies like ChatGPT created? And what does the future hold for AI language models? This talk was filmed at the Royal Institution on 29th September 2023, in collaboration with The Alan Turing Institute. Subscribe for regular science videos: http://bit.ly/RiSubscRibe Donate to the Ri and help us bring you more scientific lectures: https://www.rigb.org/support-us/donate-ri Watch the Q&A: https://youtu.be/9i2x2HyeW-Y Generative AI refers to a type of artificial intelligence that involves creating new and original data or content. Unlike traditional AI models that rely on large datasets and algorithms to classify or predict outcomes, generative AI models are designed to learn the underlying patterns and structure of the data and generate novel outputs that mimic human creativity. ChatGPT is perhaps the most well-known example, but the field is far larger and more varied than text generation. Other applications of generative AI include image and video synthesis, speech generation, music composition, and virtual reality. In this lecture, Mirella Lapata will present an overview of this exciting—sometimes controversial—and rapidly evolving field. Mirella Lapata is professor of natural language processing in the School of Informatics at the University of Edinburgh. Her research focuses on getting computers to understand, reason with, and generate natural language. She is the first recipient (2009) of the British Computer Society and Information Retrieval Specialist Group (BCS/IRSG) Karen Sparck Jones award and a Fellow of the Royal Society of Edinburgh, the ACL, and Academia Europaea. 00:00 Intro 2:38 Generative AI isn’t new – so what’s changed? 8:43 How did we get to ChatGPT? 12:38 How are Large Language Models created? 22:48 How good can a LLM become? 26:57 Unexpected effects of scaling up LLMs 28:05 How can ChatGPT meet the needs of humans? 32:30 Chat GPT demo 38:07 Are Language Models always right or fair? 40:21 The impact of LLMs on society 42:54 Is AI going to kill us all? -- A very special thank you to our Patreon supporters who help make these videos happen, especially: modsiw, Anton Ragin, Edward Unthank, Robert L Winer, Andy Carpenter, William Hudson Don McLaughlin, efkinel lo, Martin Paull, Ben Wynne-Simmons, Ivo Danihelka, Kevin Winoto, Jonathan Killin, Stephan Giersche, William Billy Robillard, Jeffrey Schweitzer, Frances Dunne, jonas.app, Tim Karr, Alan Latteri, David Crowner, Matt Townsend, THOMAS N TAMADA, Andrew McGhee, Paul Brown, David Schick, Dave Ostler, Osian Gwyn Williams, David Lindo, Roger Baker, Rebecca Pan -- The Ri is on Twitter: http://twitter.com/ri_science and Facebook: http://www.facebook.com/royalinstitution and TikTok: https://www.tiktok.com/@ri_science Listen to the Ri podcast: https://podcasters.spotify.com/pod/show/ri-science-podcast Our editorial policy: https://www.rigb.org/editing-ri-talks-and-moderating-comments Subscribe for the latest science videos: http://bit.ly/RiNewsletter Product links on this page may be affiliate links which means it won't cost you any extra but we may earn a small commission if you decide to purchase through the link.

Chapters

Intro
Intro
2 min
Generative AI isn’t new – so what’s changed?
Generative AI isn’t new – so what’s changed?
6 min
How did we get to ChatGPT?
How did we get to ChatGPT?
3 min
How are Large Language Models created?
How are Large Language Models created?
10 min
How good can a LLM become?
How good can a LLM become?
4 min
Unexpected effects of scaling up LLMs
Unexpected effects of scaling up LLMs
1 min
How can ChatGPT meet the needs of humans?
How can ChatGPT meet the needs of humans?
4 min
Chat GPT demo
Chat GPT demo
5 min
Are Language Models always right or fair?
Are Language Models always right or fair?
2 min
The impact of LLMs on society
The impact of LLMs on society
2 min
Is AI going to kill us all?
Is AI going to kill us all?
3 min
⚡️ AI Mentor