Fine-Tuning & Model Customization
When and how to customize LLMs — prompting vs. RAG vs. fine-tuning, and the practical techniques (LoRA, QLoRA, SFT, DPO) — without the classic mistake of using fine-tuning to add facts.
Fine-tuning is powerful and widely misunderstood. The most common mistake is reaching for it to add knowledge — which is RAG's job — when fine-tuning is really for shaping behavior, style, and format. This course teaches ML engineers and technical practitioners the decision framework (prompting → RAG → fine-tuning), the real techniques (LoRA, QLoRA, SFT, RLHF vs. DPO), the tooling, and the pitfalls (catastrophic forgetting, safety degradation).
It is grounded in the primary research and current practice, and honest about what fine-tuning can and can't do. Current for 2026; specific model and tool details change fast, so the course emphasizes durable concepts over version numbers.
What you'll be able to do
- Decide when to prompt, use RAG, or fine-tune
- Understand and apply LoRA, QLoRA, SFT, and preference optimization (DPO)
- Prepare data and evaluate fine-tuned models properly
- Avoid the pitfalls — catastrophic forgetting, overfitting, and safety degradation
Curriculum
Module 1: Foundations
FreeThe customization spectrum, when to fine-tune, fine-tuning vs. RAG, and the cost/tradeoffs.
Module 2: Fine-Tuning Techniques
PremiumFull vs. PEFT, LoRA and QLoRA, instruction tuning/SFT, and preference optimization (RLHF, DPO).
- Full fine-tuning vs. parameter-efficient fine-tuning12 min
- LoRA and QLoRA15 min
- Supervised fine-tuning and instruction tuning12 min
- Preference optimization: RLHF and DPO15 min
Module 3: Data, Tooling & Evaluation
PremiumData quality and formatting, the tooling ecosystem, quantization, and evaluating fine-tuned models.
- Data quality and formatting15 min
- The fine-tuning tooling ecosystem12 min
- Quantization for efficient models12 min
- Evaluating fine-tuned models12 min
Module 4: Pitfalls & Responsible Practice
PremiumCatastrophic forgetting, safety degradation, when smaller fine-tuned models win, and the road ahead.
- Catastrophic forgetting and overfitting12 min
- Fine-tuning and safety alignment12 min
- When a smaller fine-tuned model wins12 min
- The road ahead12 min
Get the full course — one-time $29.
Start Module 1 free today. Buy once for lifetime access to the remaining 3 modules — no subscription.
Want all 53? Get the All-Access Bundle for $99 — one purchase, every course.