codeloopback
Guide contents

Training Models

How models are built and changed: training and inference, pre-training and post-training, fine-tuning, LoRA, synthetic data, RLHF, distillation, and data poisoning.

8 lessons

  1. 14.Training vs Inference
  2. 15.Pre-training vs Post-training
  3. 16.Fine-tuning
  4. 17.LoRA and Parameter-Efficient Fine-tuning
  5. 18.Synthetic Data
  6. 19.Reinforcement Learning from Human Feedback (RLHF)
  7. 20.Distillation
  8. 21.Data Poisoning