AI Engineering · 200-level
RAG Quality & Retrieval Evals
AIE-2032 creditselectivebadge: rag-iiprereqs: AIE-202
Start this course — free
Earn the rag-ii credential
What's inside
Sections & lessons
01
Retrieval quality metrics
- Precision, recall, and rank-position scoringconcept45 min
02
Hybrid search + reranking
- Combining keyword and vector signals, then reorderingconcept60 min
03
Hallucination & confident wrongness
- Fluent tone is not evidence of truthconcept60 min
04
Spot-the-fabrication drill
- Tapping the fabricated answer against the clockconcept90 min
05
Citation grounding & confidence thresholds
- Refusing to answer below a confidence barconcept60 min
06
Quiz: RAG failure-mode diagnosis
- Checkpoint on naming the retrieval failure that produced a bad answerconcept30 min
07
Lab + eval-gate: retrieval eval suite
- Score a RAG system against a golden set (RAG II badge)concept120 min
Learn it from the inside
This module's playgrounds
Vocabulary
Key concepts in this course
Precision@k Recall@k Mean Reciprocal Rank (MRR) Hybrid Search Reciprocal Rank Fusion (RRF) Semantic Search Reranking Hallucination Citation and Attribution
Compare related approaches
This module ends in a gate you can fail.
That's what makes passing it mean something. Take the DSAT, get placed, and start earning.