A command-line interface the simplifies interaction with Kafka.

• kafkactl @ GitHub.

Manage & view data inside your Apache Kafka ® cluster

Kafka GUI for Apache Kafka ® to manage topics, topics data, consumers group, schema registry, connect and more...

• AKHQ @ GitHub.

S3-native event streaming. One binary, zero ops.

StreamHouse is an Apache Kafka alternative that stores events directly in S3. No broker fleet, no disk management, no replication — just S3's 99.999999999% durability out of the box.

S3-native streaming platform. A Kafka alternative with infinite scalability, 10x lower cost, and Kafka-compatible APIs. Written in Rust.

🦭 High Performance kafka alternative written in rust.

Walrus is a distributed message streaming platform built on a high-performance log storage engine. It provides fault-tolerant streaming with automatic leadership rotation, segment-based partitioning, and Raft consensus for metadata coordination.

Easy-to-run demo of a CDC pipeline using Debezium (Kafka Connect), PostgreSQL, Redpanda, and ClickHouse.

A model for event interoperability between event producers and their consumers to favor better developer experience, robust integration, and infrastructural efficiency.

• Event Destinations Initiative @ GitHub.

The best way of working with Protocol Buffers. Kafka and gRPC for the modern age.

Store directly to Apache Iceberg™ tables and guarantee data quality with Bufstream, a drop-in replacement for Apache Kafka® deployed entirely in your own VPC on AWS, GCP, or Azure.

The buf CLI is the best tool for working with Protocol Buffers. It provides:

• A linter that enforces good API design choices and structure.

• A breaking change detector that enforces compatibility at the source code or wire level.

• A generator that invokes your plugins based on configuration files.

• A formatter that formats your Protobuf files in accordance with industry standards.

• Integration with the Buf Schema Registry, including full dependency management.

• Buf @ GitHub.

The fastest Postgres change data capture.

Stream data from Postgres directly to Kafka, Redis, and more. Replace complex tools like Debezium and consolidate workflows.

• Sequin @ GitHub.

Related contents:

• Change Data Capture Tools @ Dev Genius' Medium.

This is Maxwell's daemon, a change data capture application that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms.

• Maxwell's Daemon @ GitHub.

Related contents:

• Change Data Capture Tools @ Dev Genius' Medium.

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Related contents:

• Why Was Apache Kafka Created? @ Big Data Stream.

• Apache Kafka @ GitHub.

Related contents:

• The New Look and Feel of Apache Kafka 4.0 @ The New Stack.
• Kafka: The End of the Beginning @ Materialized View.
• Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance @ New Relic.
• Introducing Apache Kafka® 4.1.0: What’s New and How to Upgrade @ Confluent.
• Testing Kafka-based Asynchronous Workflows Using OpenTelemetry @ Signadot.
• Kafka is fast -- I'll use Postgres @ TopicPartition.
• The KFC Architecture Blueprint: Kafka, Flink, and ClickHouse @ Big Data Boutique.
• Episode #147 - RabbitMQ, Kafka et les messages brokers @ Code Garage :fr:.

A robust message queue system for Rust applications, designed as a Rust alternative to Celery.

Currently Redis-backed, with planned support for RabbitMQ, Kafka, and other message brokers. This is by no means a finished product, but we're actively working on it and would love your feedback and contributions!

The best way of working with Protocol Buffers. Elastic, self-hosted Kafka with Advanced Semantic Intelligence Guarantee streaming data quality and slash cloud costs 10x with Bufstream, a drop-in replacement for Apache Kafka®.

Bufstream is a Kafka-compatible streaming system which stores records directly in an object storage service like S3.

• Buf @ GitHub.
• Bufstream 0.1.0 @ Jebsen.

Open-source framework for building asynchronous web services that interact with event streams.

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

• FastStream @ GitHub.

Open source analytics infrastructure. Fast and scalable. No bloat. GDPR compliant.

A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events, users, page views, and interactions.

• Trench @ GitHub.

Source Available Reinvented Kafka. 10x Cost Efficiency.

AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.

AutoMQ is a stateless Kafka on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

• AutoMQ @ GitHub.

Related contents:

• What If We Could Rebuild Kafka From Scratch? @ Gunnar Morling.

API Management Platform. Govern, Secure & Manage APIs and Event Streams.

Try the first-ever event-native API Management solution that natively supports synchronous REST APIs, asynchronous APIs, and event brokers like Kafka and MQTT.

• Gravitee.io @ GitHub.

Flow collector, enricher and visualizer. This program receives flows (currently Netflow/IPFIX and sFlow), enrice them with interface names (using SNMP), geo information (using MaxMind), and exports them to Kafka, then ClickHouse. It also exposes a web interface to browse the collected data.

Apache Kafka on Kubernetes in a few minutes. Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.

Strimzi @ GitHub.