Calinora Pilot

Pilot is a Kafka cluster monitoring and partition rebalancing tool. It provides real-time visibility into cluster health, automated rebalancing proposals, and safe partition reassignment execution - all from a single binary with no external database dependencies.

How It Works

graph TD
    K["Kafka Cluster"] -->|"metadata · watermarks · disk sizes"| S["Metadata Sampler"]
    S -->|"7 metrics per broker"| P["Proposal Engine"]
    P -->|"multi-phase pipeline"| R["Rebalancing Proposal"]
    R -->|"apply"| E["Streaming Executor"]
    E -->|"per-broker concurrency · live-adjustable throttle"| K

Pilot connects to your cluster, samples partition activity from watermarks and log directory sizes, and generates rack-aware rebalancing proposals through a multi-phase optimizer. Proposals can be applied manually or automatically via self-healing. See Architecture for details.

Quick Links

• Getting Started - Install Pilot and run your first cluster scan
• Configuration - Environment variables, TLS, SASL, and authentication
• Features - Monitoring, proposals, reassignments, self-healing, and more
• API Reference - REST API documentation
• Deployment - Docker, Docker Compose, Kubernetes, and standalone
• Guides - Tutorials and best practices
• Reference - Metrics, licensing, and changelog

Questions or feedback? Reach us at [email protected].