Real-Time Event Streaming Platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.

RisingWave is a real-time event streaming platform designed to offer the simplest and most cost-effective way to process, analyze, and manage real-time event data — with built-in support for the Apache Iceberg™ open table format. It provides both a Postgres-compatible SQL interface and a DataFrame-style Python interface.

RisingWave can ingest millions of events per second, continuously join and analyze live streams with historical data, serve ad-hoc queries at low latency, and persist fresh, consistent results to Apache Iceberg™ or any other downstream system.

• RisingWave @ GitHub.

Related contents:

• The Case for Hybrid Cache for Object Stores @ Data Engineer Things' Medium.

Your data lakehouse, built like software.

Bauplan is a cloud-native lakehouse platform for engineering teams who treat data like software. Ship pipelines without managing infrastructure, using a specialized Python runtime, Git-for-Data built on Apache Iceberg, and just a few simple APIs.

Related contents:

• Bauplan: Operate your lakehouse with zero infrastructure @ Data Engineer Things.

Fastest way to Replicate your Database data in Data Lake. OLake makes data replication faster by parallelizing full loads, leveraging change streams for real-time sync, and pulling data in a database-native format for efficient ingestion.

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL

• OLake @ GitHub.

Related contents:

• Change Data Capture Tools @ Dev Genius' Medium.