Skip to main content

Overview

Factor House Local is a collection of pre-configured Docker Compose environments that demonstrate modern data platform architectures. Each setup is purpose-built around a specific use case and incorporates widely adopted technologies such as Kafka, Flink, Spark, Iceberg, and Pinot. These environments are further enhanced by enterprise-grade tools from Factor House: Kpow, for Kafka management and control, and Flex, for seamless integration with Flink.

Factor House Local Labs

Kafka development & monitoring with Kpow​

Build and manage event-driven systems with a full-featured Kafka environment, including a three-node Kafka cluster, Zookeeper, Schema Registry, and Kafka Connect. The setup is complemented by Kpow, which provides deep visibility, streamlined management, and advanced monitoring capabilities for Kafka and its ecosystem.

Unified analytics platform with Flex, Flink, Spark, Iceberg & Hive Metastore​

This integrated environment combines an Apache Flink cluster for real-time stream processing with an Apache Spark engine for large-scale batch computation. Both operate on a unified data lakehouse built with Apache Iceberg and MinIO object storage. A central Hive Metastore, backed by PostgreSQL, acts as a shared catalog, enabling seamless interoperability and consistent data access. The Flink environment is enhanced by Flex for enterprise-grade management, making this stack ideal for building end-to-end pipelines on a single, ACID-compliant platform.

Apache Pinot real-time OLAP cluster​

Designed for sub-second analytics, this stack provisions an Apache Pinot cluster with Controller, Broker, and Server components. Ideal for powering real-time dashboards and operational analytics, it excels at querying large-scale event data with minimal latency.

Centralized Observability & Data Lineage

This Docker Compose stack deploys a powerful environment for data lineage and systems observability. It features Marquez, the reference implementation of the OpenLineage open standard for data lineage, alongside a complete observability suite from Prometheus, Grafana, and Alertmanager.