Ingest health
Atlas view
Ingest health
api_v1.ingest_healthOne row per source: its most recent completed ingest run, and whether that run succeeded.
Built from
This Atlas view joins data from the following upstream sources. Click through for provenance, methodology, and citation.
No direct dbt parents recorded.
Columns
| Column | Description |
|---|---|
| source_id | Atlas source identifier, e.g. 'ssb-08764' or 'redcross'. Unique within this table — one row per source. Joins back to raw.ingest_runs.source_id. |
| last_run_at | finished_at of the most recent COMPLETED ingest run for this source. NULL rows from raw.ingest_runs (in-flight or aborted runs) are filtered out upstream. |
| last_status | Status of the most recent COMPLETED run. 'ok' = the scraper finished and wrote rows; 'fail' = it errored or completed with the expected output shape missing. |
Sample query
Live PostgREST query that returns the first 5 rows. URL adapts to the current host — local dev shows api-atlas.localhost; the deployed site shows the configured API base.
https://api-atlas.urbalurba.com/ingest_health?limit=5
About this view
One row per source: its most recent completed ingest run, and whether that run succeeded.
Per-source ingest-run health. One row per scraper or API-source,
showing the most recent COMPLETED run (finished_at IS NOT NULL).
Minimal v1 surface per Q14 of
INVESTIGATE-ngo-scraping-infrastructure.md — just the three columns
needed to answer "which sources are failing?" and "which sources
haven't refreshed recently?". Empty until the first scraper writes
to raw.ingest_runs.