Biapy's Bookmarks

data-integration

Apache Kafka

https://kafka.apache.org/

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Related contents:

The New Look and Feel of Apache Kafka 4.0 @ The New Stack.
Kafka: The End of the Beginning @ Materialized View.
Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance @ New Relic.
Introducing Apache Kafka® 4.1.0: What’s New and How to Upgrade @ Confluent.
Testing Kafka-based Asynchronous Workflows Using OpenTelemetry @ Signadot.
Kafka is fast -- I'll use Postgres @ TopicPartition.

apache2-licensed big-data data-integration data-pipeline data-stream event-stream foss kafka open-source self-hosted

Added 7 months ago

Airbyte

https://airbyte.com/

Open-Source Data Movement for LLMs. AI Platform. Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Airbyte @ GitHub.

data-integration data-pipeline etl llm self-hosted source-available

Added 9 months ago