GPT3 & Beyond: Key concepts and open questions in a golden age for natural language understanding

Listen in as Professor Christopher Potts discusses the significance and implications of recent Natural Language Understanding developments including GPT-3. He describes the fundamental building blocks of these systems and describes how we can reliably assess and understand them.

Learn more about the AI Professional Program: https://stanford.io/3kYThd2

View the slides for this webinar here: https://stanford.io/potts-GPT3-webinar2023

#gpt3 #stanfordwebinar

Chapters:

0:00 Opening

00:09 Introduction for Chris Potts

1:09 Chris Potts - Welcome to the webinar

03:43 Quick Demo of GPT-3

06:41 GLUE benchmark

10:26 How can you contribute to NLU in this era of these gargantuan models?

11:44 The last mile problem

13:35 GPT example

14:50 Contrast In-Context learning with the standard paradigm of standard supervision

16:47 What are the mechanisms behind this?

18:18 Why does this work so well?

18:35 Self-Supervision

21:08 The role of human feedback

21:32 Chat GPT Diagram

23:42 Step-by-step reasoning

28:13 LLMs for everything approach

41:29 AI Courses at Stanford

46:28 Predictions about the future