New Cohort Starts:

Donate
← Back to the skill map
Data & Storage/Data & services

Embeddings & Vectors

6 micro-topics in Data & Storage, each with the evidence that proves you have it and the written reason behind every link. Before you start, it rests on 5 other domains. Downstream, it holds up 2 domains.

6 topics  ·  depth 2–12 of 16  ·  5 internal links  ·  6 in  ·  3 out

Before you start

Load-bearing links first. Each one says what in this domain rests on what outside it, and why.

Data Ingestion

1 link

load-bearing

Chunk documents for retrieval rests on Clean and normalize records

You chunk cleaned documents.

Model Foundations

1 link

load-bearing

Explain embeddings rests on Explain tokenization

Embeddings operate on tokenized text.

Data Modeling

1 link

load-bearing

Store and query vectors in Postgres rests on Model one-to-many and many-to-many

Vectors live in a schema alongside their metadata.

SQL

2 links

load-bearing

Filter retrieval by metadata rests on Query rows with SELECT

The filter half is an ordinary predicate.

supporting

Choose a vector index rests on Reason about indexes

Index tradeoffs are the same shape you met in SQL.

Production Python

1 link

supporting

Generate embeddings at scale rests on Run async calls concurrently

Embedding a corpus is a batch of concurrent calls.

What you will be able to do

In prerequisite order. Each idea names the artifact that closes it, the market demand that put it on the map, and what it stands on.

Depth 2  ·  conceptual  ·  unassisted  ·  M14 §14.4

Explain embeddings

Knows what a dense vector represents

Evidence
Explains why two texts are near in vector space
Market anchor
Embeddings · machine learning
Rests on
load-bearing

Explain tokenization · Model Foundations

Embeddings operate on tokenized text.

Depth 9  ·  conceptual  ·  unassisted  ·  M19 §19.1

Chunk documents for retrieval

Splits text so chunks are self-contained

Evidence
Chooses a chunk size and defends it against retrieval results
Market anchor
Retrieval-augmented generation
Rests on
load-bearing

Explain embeddings

Chunk size is chosen against what gets embedded.

load-bearing

Clean and normalize records · Data Ingestion

You chunk cleaned documents.

Depth 10  ·  procedural  ·  scaffolded  ·  M19 §19.1

Generate embeddings at scale

Batches, rate-limits and stores vectors

Evidence
Embeds a corpus without exceeding limits or cost
Market anchor
Embeddings
Rests on
load-bearing
supporting

Run async calls concurrently · Production Python

Embedding a corpus is a batch of concurrent calls.

Depth 11  ·  procedural  ·  unassisted  ·  M19 §19.2

Store and query vectors in Postgres

Uses pgvector alongside relational data

Evidence
Runs a similarity query joined to metadata
Market anchor
pgvector · Postgres
Rests on
load-bearing

Generate embeddings at scale

Vectors must exist before they are stored.

load-bearing

Model one-to-many and many-to-many · Data Modeling

Vectors live in a schema alongside their metadata.

Depth 12  ·  conceptual  ·  scaffolded  ·  M19 §19.2

Choose a vector index

Trades recall against latency with IVF or HNSW

Evidence
Justifies an index choice with measured recall
Market anchor
Vector search
Rests on
load-bearing

Store and query vectors in Postgres

An index is built over stored vectors.

supporting

Reason about indexes · SQL

Index tradeoffs are the same shape you met in SQL.

Depth 12  ·  procedural  ·  scaffolded  ·  M19 §19.2

Filter retrieval by metadata

Combines vector similarity with structured predicates

Evidence
Restricts results to a tenant or date range
Market anchor
Vector search
Rests on
load-bearing

Store and query vectors in Postgres

Metadata filtering combines vector and relational predicates.

load-bearing

Query rows with SELECT · SQL

The filter half is an ordinary predicate.

What rests on this domain

Everything downstream that names an idea here as a prerequisite, grouped by where it lives.

Retrieval (RAG)

2 links

load-bearing
load-bearing

Combine keyword and semantic search rests on Filter retrieval by metadata

Fusing results requires filtered vector search.

Agents

1 link

supporting

Persist long-term memory rests on Store and query vectors in Postgres

Semantic recall is usually vector retrieval.

Retool. Retrain. Relaunch.

375 ideas. 17 weeks. No tuition, ever.

Vets Who Code is a veteran-run 501(c)(3). The accelerator is free, remote, and we don’t take a share of your first paycheck.

Free · Remote · 17 weeks · EIN 86-2122804