howto data engineering
Live Flight Data Step by Step - Part 5 - Silver, and the trap a backfill sets
Turning raw OpenSky answers into clean, typed positions with airline names – incrementally. And the bug that would have silently dropped 2,150 snapshots: a time watermark meets a backfill.
· 13 min read