Reading 15: LLMs and Agents

Readings

• • Slides
• • FCA - Section 8.5.5
• • PML - Section 15.5
• • D2L - Section 11.7

Videos

• • Harvard CS50 (54:15 - end)
• • 3b1b
• • Cornell CS4780
• • Transformers (StatQuest)
• • Deep Dive into LLMs like ChatGPT
• What is Agentic AI?
• The Big LLM Architecture Comparison (Optional but highly recommended)
• Reasoning Models and DeepSeek R1 from scratch
• Reinforcement Learning with Human Feedback (RLHF), Clearly Explained!!! (Statquest)

Notebooks

Blogposts

• • GPT3 (Alammar)
• • MoE (Maarten)
• • LLM Reasoning (Maarten)
• • Deepseek (Alammar)
• • LLM Agents (Lilian)
• • A History of Large Language Models