Eval evidence

The pipeline, validated — every weekday

I sell “an eval harness with golden examples, latency and cost monitoring.” Here is one running in the open. The macro-data pipeline doesn’t just pull numbers — a validation pass checks every series against its source for freshness, value tolerance, and release-window timing, then commits the result. Same discipline I bring to a client AI feature: explicit thresholds, fail loud, keep the receipt.

PASSoverall status
27series validated
100%pass rate
0open failures + warnings

Last run August 24, 2026 at 02:04 PM UTC · evaluated month 2026-08 · latest data 2026-08. Generated and committed by a GitHub Action in this repository.

Per-series checks

IndicatorSourceLatestLagMax Δ vs sourceToleranceRelease windowStatus
Unemployment RateFRED:UNRATE2026-070 mo0.00000.15PASSPASS
Avg Weeks UnemployeedFRED:UEMPMEAN2026-070 mo0.00001.992PASSPASS
Job OpeningsFRED:JTSJOL2026-080 mo0.0000662.31PASSPASS
Unemployed 27 weeksFRED:UEMP27OV2026-070 mo0.0000300PASSPASS
Unemployeed CountFRED:UNEMPLOY2026-070 mo0.0000414.96PASSPASS
Fed RateFRED:FEDFUNDS2026-070 mo0.00000.2PASSPASS
15 year mortgageFRED:MORTGAGE15US2026-080 mo0.00000.15PASSPASS
30 year mortgageFRED:MORTGAGE30US2026-080 mo0.00000.15PASSPASS
S&P 500FRED:SP5002026-080 mo0.0000613.9496PASSPASS
Labor Participation RateFRED:CIVPART2026-070 mo0.00000.2PASSPASS
Housing Price IndexFRED:CSUSHPINSA2026-070 mo0.00005.0266PASSPASS
CPIFRED:CPIAUCSL2026-070 mo0.00002.3297PASSPASS
GDPFRED:GDP2026-080 mo0.0000487.1281PASSPASS
Stock Market (b)FRED:NCBCEL2026-050 mo0.00006256.0465PASSPASS
National Debt (b)FRED:GFDEBTN2026-050 mo0.0000976.6355PASSPASS
10Y TreasuryFRED:DGS102026-080 mo0.00000.15PASSPASS
2Y TreasuryFRED:DGS22026-080 mo0.00000.15PASSPASS
Consumer SentimentFRED:UMCSENT2026-060 mo0.00005PASSPASS
Retail SalesFRED:RSAFS2026-070 mo0.000015272.04PASSPASS
Personal Savings RateFRED:PSAVERT2026-060 mo0.00002PASSPASS
PCE Price IndexFRED:PCEPI2026-060 mo0.00001PASSPASS
Avg Hourly EarningsFRED:CES05000000032026-070 mo0.00000.3PASSPASS
Initial ClaimsFRED:ICSA2026-080 mo0.000030000PASSPASS
Housing StartsFRED:HOUST2026-070 mo0.0000185.85PASSPASS
Building PermitsFRED:PERMIT2026-070 mo0.0000129.87PASSPASS
Existing Home SalesFRED:EXHOSLUSM495S2026-070 mo0.0000203000PASSPASS
Industrial ProductionFRED:INDPRO2026-070 mo0.00001.5449PASSPASS

How to read this: each weekday the harness re-pulls every series from FRED and compares it to what’s committed. Max Δ vs source is the largest discrepancy found; it must stay under tolerance. Lag is months behind the source. Release windowconfirms the data arrived when the official calendar said it would. A single failure flips the overall status and surfaces here.