SaaS · Data platform
Realtime Analytics Suite
Event pipeline and dashboard for 40M monthly events using Node.js streaming workers, MongoDB aggregations and a React data layer.
- Role
- Senior Software Engineer
- Year
- 2024
- Timeline
- 6 months
- Team
- 3 engineers
The problem
Product teams waited a day for usage data, and the existing batch job collapsed whenever a customer sent a traffic spike.
Approach
- 01
Replaced the batch job with streaming Node.js workers that apply backpressure and can replay a window on demand.
- 02
Pre-computed hourly MongoDB aggregation pipelines so dashboards read from summaries, not raw events.
- 03
Virtualised the React chart layer so 50k-point series stay interactive.
What shipped
- Streaming ingestion workers with backpressure and replay
- Chart layer virtualised for 50k-point series
- Aggregation pipelines pre-computed hourly