Main services
The enterprise editions of Kpow and Flex support multiple authentication providers, as outlined in the documentation below:
Among those, this project includes file-based authentication, and user credentials can be found in the following locations:
- Kpow:
resources/kpow/config/trial.env - Flex:
resources/flex/config/trial.env
For demonstration purposes, Kpow and Flex can be accessed using admin as both the username and password.
After successful authentication, users are redirected to the Overview page.
The following sections show key services and their associated port mappings.
Kafka with Kpow
| Service Name | Port(s) (Host:Container) | Description |
|---|---|---|
kpow | 3000:3000 | Kpow (Web UI for Kafka monitoring and management) |
schema | 8081:8081 | Confluent Schema Registry (manages Kafka message schemas) |
connect | 8083:8083 | Kafka Connect (framework for Kafka connectors) |
zookeeper | 2181:2181 | ZooKeeper (coordination service for Kafka) |
kafka-1 | 9092:9092 | Kafka Broker 1 (message broker instance) |
kafka-2 | 9093:9093 | Kafka Broker 2 (message broker instance) |
kafka-3 | 9094:9094 | Kafka Broker 3 (message broker instance) |
Unified analytics with Flex
| Service Name | Port(s) (Host:Container) | Description |
|---|---|---|
flex | 3001:3000 | Flex UI for enterprise Flink management and monitoring. |
jobmanager | 8082:8081 | Apache Flink JobManager UI & REST API for cluster coordination. |
sql-gateway | 9090:9090 | Apache Flink SQL Gateway for submitting interactive SQL queries. |
spark | 4040:404018080:18080 | Spark Web UI for monitoring running jobs. Spark History Server for reviewing completed jobs. |
minio | 9001:90019000:9000 | MinIO Console UI (at port 9001).MinIO S3-compatible API (at port 9000). |
postgres | 5432:5432 | PostgreSQL database, used as the Hive Metastore backend. |
hive-metastore | 9083:9083 | Apache Hive Metastore service, providing a central catalog for Flink and Spark. |
(Note: The taskmanager-* and mc services run in the background and do not expose ports to the host computer.)
Apache Pinot OLAP
| Service Name | Port(s) (Host:Container) | Description |
|---|---|---|
pinot-controller | 19000:9000 | Apache Pinot Controller (manages cluster state, UI/API) |
pinot-broker | 18099:8099 | Apache Pinot Broker (handles query routing and results) |
pinot-server | 18098:8098 | Apache Pinot Server (hosts data segments, executes queries) |
OpenLineage with Marquez & Prometheus
| Service Name | Port(s) (Host:Container) | Description |
|---|---|---|
marquez-web | 3003:3000 | Marquez Web UI (visualizes OpenLineage data) |
marquez-api | 5000:5000, 5001:5001 | Marquez backend and OpenLineage API endpoint |
marquez-db | 5433:5432 | PostgreSQL database for Marquez metadata |
prometheus | 19090:9090 | Prometheus (metrics collection and database) |
alertmanager | 19093:9093 | Alertmanager (handles alerts from Prometheus) |
grafana | 3004:3000 | Grafana (platform for metrics visualization & dashboards) |