A serverless, event-driven pipeline built for resilience and precision. No infrastructure overhead, just pure data flow.
Ingestion & API logic
Analytical storage
Service orchestration
SQLX Modelling
Sensors transmit readings via a dedicated 4G/LTE connection. To ensure the hardware isn't kept waiting, a Go Cloud Function immediately hands the payload to Pub/Sub. Independent subscribers then handle the parallel writes to Firestore for real-time state and BigQuery for long-term telemetry.
A GCP Workflow orchestrates the transformation cycle. It fetches local atmospheric snapshots, then triggers Dataform to run version-controlled SQLX models. This merges the raw sensor telemetry with weather data to produce rolling statistics.
Once the Dataform models complete, the Workflow triggers a final synchronisation. Aggregated weekly and monthly stats are pushed back to Firestore, ensuring the Public API never touches an analytical table, maintaining sub-second response times.
Venue owners retain full ownership. All data is available via raw CSV export from the management console at any time.
Served via Firebase Hosting and Google’s Global CDN, ensuring minimal latency from the towpath to the sofa.