Overview
Overview of Factor House Local labs
Lab 1: Kafka Clients - Producing and Consuming Kafka Messages with Schema Registry
Produce and consume Avro Kafka messages using Python clients and Schema Registry
Lab 2: Kafka Connect - Managing Kafka Source and Sink Connectors via Kpow UI and API
Manage Kafka Connect source and sink connectors via Kpow UI and API
Lab 3: Kafka Streams - Supplier Stats with Live Topology View via Kpow Streams Agent
Build a Kafka Streams app for real-time supplier stats with live topology view
Lab 4: Flink SQL - Aggregating Supplier Stats from Kafka Topic
Aggregate supplier stats from Kafka orders using Flink SQL
Lab 5: Flink DataStream API - Real-Time Analytics from Orders to Supplier Stats
Implement a Flink DataStream job for real-time analytics on Kafka orders
Lab 6: Flink SQL - Writing Kafka Order Records to MinIO as Parquet Files
Write Kafka order records as Parquet files to MinIO using Flink SQL
Lab 7: Flink SQL - Ingesting Kafka Order Records into Iceberg Table
Ingest Kafka order records into an Iceberg table via Flink SQL
Lab 8: Flink Table API - Loading Order Events from Kafka into Iceberg
Build a Kafka-to-Iceberg pipeline using Flink Table API
Lab 9: Kafka Connect - Streaming Order Data from Kafka into Iceberg
Stream Kafka order data into Iceberg using Kafka Connect
Lab 10: Spark Structured Streaming - Delivering Kafka Order Records into Iceberg Table
Deliver Kafka order data to Iceberg with a PySpark Structured Streaming
Lab 11: Flink SQL Gateway - Serving Real-Time Supplier Stats via REST API
Serve real-time supplier stats via Flink SQL Gateway REST API
Lab 12: Apache Pinot - Real-Time Analytics of Supplier Stats from Kafka
Stream Kafka orders into Pinot and run real-time analytics via Python client