New Cohort Starts:

Donate
← Back to the skill map
AI Systems/AI & reliability

Retrieval (RAG)

8 micro-topics in AI Systems, each with the evidence that proves you have it and the written reason behind every link. Before you start, it rests on 5 other domains. Downstream, it holds up 1 domain.

8 topics  ·  depth 12–14 of 16  ·  8 internal links  ·  7 in  ·  2 out

Before you start

Load-bearing links first. Each one says what in this domain rests on what outside it, and why.

LLM Evals

2 links

load-bearing

Measure retrieval quality rests on Build an evaluation dataset

Metrics are computed over an evaluation set.

load-bearing

Measure generation faithfulness rests on Use a model as a judge

Faithfulness is scored by a judge.

Embeddings & Vectors

2 links

load-bearing
load-bearing

Combine keyword and semantic search rests on Filter retrieval by metadata

Fusing results requires filtered vector search.

Context Engineering

1 link

load-bearing

Design a retriever-generator system rests on Treat the context window as a budget

Retrieval is a decision about what goes in the window.

Model Integration

1 link

load-bearing

Inject retrieved context rests on Maintain chat context

Retrieved text is placed into the request.

SQL

1 link

load-bearing

Combine keyword and semantic search rests on Query rows with SELECT

The keyword half is a text query.

What you will be able to do

In prerequisite order. Each idea names the artifact that closes it, the market demand that put it on the map, and what it stands on.

Depth 12  ·  conceptual  ·  unassisted  ·  M19 §19.1

Design a retriever-generator system

Separates retrieval from generation

Evidence
Diagrams a RAG system and names its failure points
Market anchor
Retrieval-augmented generation
Rests on
load-bearing

Store and query vectors in Postgres · Embeddings & Vectors

Retrieval needs stored vectors.

load-bearing

Treat the context window as a budget · Context Engineering

Retrieval is a decision about what goes in the window.

Depth 13  ·  procedural  ·  unassisted  ·  M19 §19.1

Inject retrieved context

Places retrieved text where the model will use it

Evidence
Answers are grounded in retrieved chunks
Market anchor
Retrieval-augmented generation
Rests on
load-bearing

Design a retriever-generator system

Injection is the generation half of the design.

load-bearing

Maintain chat context · Model Integration

Retrieved text is placed into the request.

Depth 13  ·  conceptual  ·  scaffolded  ·  M19 §19.3

Combine keyword and semantic search

Runs hybrid retrieval and fuses results

Evidence
Hybrid beats vector-only on a held-out query set
Market anchor
Search · retrieval
Rests on
load-bearing

Query rows with SELECT · SQL

The keyword half is a text query.

load-bearing

Filter retrieval by metadata · Embeddings & Vectors

Fusing results requires filtered vector search.

supporting

Inject retrieved context

Retrieval quality work starts once the pipeline runs.

Depth 13  ·  conceptual  ·  guided  ·  M19 §19.3

Expand and rewrite queries

Improves recall for badly phrased questions

Evidence
Poorly worded queries return the right documents
Market anchor
Retrieval
Rests on
load-bearing

Design a retriever-generator system

Query rewriting sits in front of retrieval.

Depth 13  ·  meta  ·  scaffolded  ·  M19 §19.4

Measure retrieval quality

Applies precision at k, recall at k and MRR

Evidence
Reports retrieval metrics before and after a change
Market anchor
Information retrieval
Rests on
load-bearing

Design a retriever-generator system

You measure a system that exists.

load-bearing

Build an evaluation dataset · LLM Evals

Metrics are computed over an evaluation set.

Depth 14  ·  conceptual  ·  guided  ·  M19 §19.3

Rerank retrieved candidates

Refines the top-k with a stronger model

Evidence
Precision at k improves on the eval set
Market anchor
Retrieval · ranking
Rests on
load-bearing

Combine keyword and semantic search

Reranking refines a candidate set.

Depth 14  ·  representational  ·  scaffolded  ·  M19 §19.5

Return grounded citations

Attributes each claim to its source chunk

Evidence
Every answer links to the chunk supporting it
Market anchor
Retrieval-augmented generation
Rests on
load-bearing

Inject retrieved context

Citations point at the chunks you injected.

Depth 14  ·  meta  ·  scaffolded  ·  M19 §19.4

Measure generation faithfulness

Detects answers unsupported by context

Evidence
Catches a fabricated answer with a scored check
Market anchor
LLM evaluation
Rests on
load-bearing

Use a model as a judge · LLM Evals

Faithfulness is scored by a judge.

load-bearing

Inject retrieved context

Faithfulness compares an answer to its context.

supporting

Measure retrieval quality

Retrieval quality is measured before generation quality.

What rests on this domain

Everything downstream that names an idea here as a prerequisite, grouped by where it lives.

AI Safety & Governance

2 links

load-bearing

Defend against prompt injection rests on Inject retrieved context

Retrieved content is untrusted input in the prompt.

load-bearing

Prevent PII leakage rests on Inject retrieved context

Retrieval can pull personal data into a prompt.

Retool. Retrain. Relaunch.

375 ideas. 17 weeks. No tuition, ever.

Vets Who Code is a veteran-run 501(c)(3). The accelerator is free, remote, and we don’t take a share of your first paycheck.

Free · Remote · 17 weeks · EIN 86-2122804