Kafka & Kpow
Kafka cluster with Kpow for visibility, management, and monitoring.
Flink & Flex
A unified platform for stream (Flink with Flex) and batch (Spark) processing on a shared lakehouse architecture
Real-time OLAP
Apache Pinot cluster for real-time analytics on large-scale event data
Observability
Data Lineage & Observability with OpenLineage (via Marquez) and Prometheus