Guide contents

LLM Fundamentals

The key concepts behind modern AI explained for beginners: AI, machine learning, and neural networks, large and small language models, vision-language and multimodal models, frontier models and AGI, parameters and weights, tokens and tokenizers, the context window, and what goes into a model's context.

57 lessons in 10 sections

Start with AI, Machine Learning, and Neural Networks →

Kinds of Models

What AI, machine learning, and neural networks are, and the kinds of models built on them: large and small language models, vision-language models, multimodal assistants, frontier models, and AGI.

  1. 1.AI, Machine Learning, and Neural Networks
  2. 2.Large and Small Language Models
  3. 3.Vision-Language Models
  4. 4.Multimodality
  5. 5.Frontier Models
  6. 6.Artificial General Intelligence (AGI)

How Models Work

What a model is made of and what it reads: parameters and weights, tokens, tokenizers, the context window, and the context sent with every request.

  1. 7.Parameters and Weights
  2. 8.Tokens
  3. 9.Tokenizers and Tokenization
  4. 10.The Context Window
  5. 11.Context: What Goes Into a Request
  6. 12.Temperature and Sampling
  7. 13.Mixture of Experts (MoE)

Training Models

How models are built and changed: training and inference, pre-training and post-training, fine-tuning, LoRA, synthetic data, RLHF, distillation, and data poisoning.

  1. 14.Training vs Inference
  2. 15.Pre-training vs Post-training
  3. 16.Fine-tuning
  4. 17.LoRA and Parameter-Efficient Fine-tuning
  5. 18.Synthetic Data
  6. 19.Reinforcement Learning from Human Feedback (RLHF)
  7. 20.Distillation
  8. 21.Data Poisoning

Running Models

What affects speed, cost, and quality when a model runs: reasoning models, caching, quantization, and model routing.

  1. 22.Reasoning Models
  2. 23.Caching
  3. 24.Quantization
  4. 25.Model Routing

Prompts and APIs

How to talk to a model: prompts, prompt engineering, context engineering, structured outputs, and APIs for AI models.

  1. 26.Prompts
  2. 27.Prompt Engineering
  3. 28.Context Engineering
  4. 29.Structured Outputs
  5. 30.APIs for AI Models

Agents

How a model becomes an agent: models versus agents, tools, the agent loop, and the harness.

  1. 31.Models vs AI Agents
  2. 32.AI Agents
  3. 33.Tools
  4. 34.The Agent Loop
  5. 35.The Harness

Knowledge and Memory

How models get facts right and keep track of long work: hallucinations, grounding, RAG, vector databases and embeddings, memory, compaction, and context rot.

  1. 36.Hallucinations
  2. 37.Grounding
  3. 38.Retrieval-Augmented Generation (RAG)
  4. 39.Vector Databases and Embeddings
  5. 40.Memory
  6. 41.Compaction
  7. 42.Context Rot

Agent Tooling

What agents are connected to and how people work with them: MCP, agent skills, computer use, sandboxes, agentic search, human in the loop, agentic engineering, and vibe coding.

  1. 43.Model Context Protocol (MCP)
  2. 44.Agent Skills
  3. 45.Computer Use
  4. 46.Sandboxes
  5. 47.Agentic Search
  6. 48.Human in the Loop
  7. 49.Agentic Engineering
  8. 50.Vibe Coding

Quality and Safety

How models are measured and attacked: benchmarks, evals, prompt injection, data exfiltration, and open-weights and open-source models.

  1. 51.Benchmarks
  2. 52.Evals
  3. 53.Prompt Injection
  4. 54.Data Exfiltration
  5. 55.Open Weights and Open-Source Models

Interview Practice

Interview questions on every topic of the course: concept questions with short answers and follow-ups, and scenario, design, and spot-the-mistake questions.

  1. 56.LLM Fundamentals Interview Questions: Concepts
  2. 57.LLM Fundamentals Interview Questions: Scenarios and Design