5 micro-topics in Data & Storage, each with the evidence that proves you have it and the written reason behind every link. Before you start, it rests on 4 other domains. Downstream, it holds up 3 domains.
5 topics · depth 7–10 of 16 · 4 internal links · 4 in · 3 out
Load-bearing links first. Each one says what in this domain rests on what outside it, and why.
1 link
Build a repeatable ingestion pipeline rests on Choose primary and foreign keys
Idempotent loads require a key to upsert on.
1 link
Ingest from files and APIs rests on Read and write files
Ingestion reads files.
1 link
Ingest from files and APIs rests on Call HTTP APIs asynchronously
Ingestion pulls from APIs.
1 link
Schedule and monitor batch jobs rests on Configure alerts
Unattended jobs need alerting to be trustworthy.
In prerequisite order. Each idea names the artifact that closes it, the market demand that put it on the map, and what it stands on.
Depth 7 · procedural · unassisted · M22 §22.1
Pulls data from CSV, JSON and HTTP sources
Read and write files · Python Core
Ingestion reads files.
Call HTTP APIs asynchronously · Production Python
Ingestion pulls from APIs.
Depth 8 · procedural · unassisted · M22 §22.1
Handles nulls, duplicates and inconsistent types
You clean what you have loaded.
Depth 9 · conceptual · scaffolded · M22 §22.1
Makes ingestion idempotent and resumable
A pipeline formalizes ingestion and cleaning.
Choose primary and foreign keys · Data Modeling
Idempotent loads require a key to upsert on.
Depth 10 · conceptual · scaffolded · M22 §22.1
Records progress so work resumes
Build a repeatable ingestion pipeline
Checkpointing makes a pipeline resumable.
Depth 10 · meta · guided · M22 §22.1
Runs work on a cadence with failure alerts
Build a repeatable ingestion pipeline
Scheduling automates a pipeline that already runs.
Configure alerts · Observability
Unattended jobs need alerting to be trustworthy.
Everything downstream that names an idea here as a prerequisite, grouped by where it lives.
1 link
Recognize data poisoning risk rests on Build a repeatable ingestion pipeline
Poisoning targets the ingestion path.
1 link
Chunk documents for retrieval rests on Clean and normalize records
You chunk cleaned documents.
1 link
Checkpoint and resume agent state rests on Checkpoint long-running jobs
Resumability is the same pattern as in batch jobs.
Retool. Retrain. Relaunch.
375 ideas. 17 weeks. No tuition, ever.
Vets Who Code is a veteran-run 501(c)(3). The accelerator is free, remote, and we don’t take a share of your first paycheck.
Free · Remote · 17 weeks · EIN 86-2122804