Sensor to screen in under 100 ms: building and breaking a Kafka pipeline
A real-time Kafka pipeline that gets 95% of updates from event to pixel in under 100 ms, then every component restarted or killed mid-stream: 0 of 42,950 readings lost.
Series
Building a Real-Time Pipeline
How I built a real-time pipeline that gets 95% of updates on screen in under 100 ms, then broke it on purpose to see what survives. Each post covers one engineering decision: the options, what I chose, what it cost, and the numbers I measured. It starts with Kafka and failure drills and moves on to AWS and AI features.
