13: LLMs

Objectives

• Explain what problem a language model is designed to solve.
• Explain how instruction tuning and human feedback alter how language models work.
• Use an API to generate text from a language model.

Reading

Intro to what problem a language model is trying to solve:

• Text + Image Generation playlist (just the first two)
• GPT from Scratch - NYTimes (original link)

And one of these:

• Chatbots May ‘Hallucinate’ More Often Than Many Realize - The New York Times
• The Secret Ingredient of ChatGPT Is Human Advice - The New York Times
• Mental Models for Advanced ChatGPT Prompting with Riley Goodside | The TWIML AI Podcast

Optional Activities

Get an OpenAI account. Try out the Chat API on the Playground.