database
Index your Gmail account to a SQLite DB and play with the data.
This is a script to download emails from Gmail and store them in a SQLite database for further analysis. I find it extremely useful to have all my emails in a database to run queries on them. For example, I can find out how many emails I received per sender, which emails take the most space, and which emails from which sender I never read.
SQLite Multitenancy With Rails.
Related contents:
A MySQL-compatible relational database with a storage agnostic query engine. Implemented in pure Go.
go-mysql-server is a data-source agnostic SQL engine and server which runs queries on data sources you provide, using the MySQL dialect and wire protocol. A simple in-memory database implementation is included, and you can query any data source you want by implementing your own backend.
Related contents:
Database Relationship Diagrams Design Tool.
Draw Entity-Relationship Diagrams, Painlessly 😎 A free, simple tool to draw ER diagrams by just writing code. Designed for developers and data analysts.
Scale PostgreSQL horizontally. Postgres scales with PgDog. Horizontal scaling for PostgreSQL with automatic sharding.
PgDog is the missing routing layer for PostgreSQL. It moves data between nodes and directs query traffic, transparently to the application.
PgDog is a transaction pooler and logical replication manager that can shard PostgreSQL. Written in Rust, PgDog is fast, secure and can manage hundreds of databases and hundreds of thousands of connections.
Related contents:
SQLite is a C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine. SQLite is the most used database engine in the world. SQLite is built into all mobile phones and most computers and comes bundled inside countless other applications that people use every day. More Information...
Related contents:
- SQLite File Format Viewer.
- SQLite Transactions and Virtual Tables @ Misframe.
- A faster way to copy SQLite databases between computers @, alexwlchan.
- Scaling SQLite to 4M QPS on a single server (EC2 vs Bare Metal) @ Expensify.
- PSA: SQLite WAL checksums fail silently and may lose data @ blag.
- Lessons learned from building a sync-engine and reactivity system with SQLite @ Antoine's blog.
- From 19k to 4.2M events/sec: story of a SQLite query optimisation @ mnt.io.
- SQLite Is ULTIMATE Choice For 99% of Projects @ DevOps Toolbox's YouTube.
- Subtleties of SQLite Indexes @ Evan Schwartz.
- SQLite concurrency and why you should care about it @ Jellyfin.
- 100000 TPS over a billion rows: the unreasonable effectiveness of SQLite @ anders murphy.
- The Silent Standard: Why the World’s Most Deployed Database Is Killing the Custom File Format @ WebProNews.
- SQLite JSON Superpower: Virtual Columns + Indexing @ DB Pro.
- I don't buy SQLite in the cloud @ Monroe Clinton.
- SQLite 3.52 Released With WAL Corruption Fix and CLI Improvements @ linuxiac.
- Gotchas with SQLite in Production @ Anže's Blog.
- Modern SQLite: Features You Didn’t Know It Had @ slicker.me.
- SQLite is All You Need for Durable Workflows @ Obelisk.
- SQLite improving performance with pre-sort @ anders murphy.
- Detecting Full Table Scans With SQLite @ Tenderlove Making.
- SQLite should have (Rust-style) editions @ Mort's Ramblings.
ER Diagrams, Reinvented for Simplicity.
Automatically generate and explore your database schema with a powerful interactive viewer. Liam ERD generates beautiful, interactive ER diagrams from your database. Whether you're working on public or private repositories, Liam ERD helps you visualize complex schemas with ease.
The easiest way to build a multiplayer app. Multiplayer at the speed of light.
You can think of SpacetimeDB as both a database and server combined into one. It is a relational database system that lets you upload your application logic directly into the database by way of fancy stored procedures called "modules."
Related contents:
Scalable, Open Source, Logs DB & Logging Solution.
Related contents:
Graft is an open-source transactional storage engine optimized for lazy, partial, and strongly consistent replication—perfect for edge, offline-first, and distributed applications.
Related contents:
PostgreSQL Model Context Protocol (PG-MCP) Server.
A Model Context Protocol (MCP) server for PostgreSQL databases with enhanced capabilities for AI agents.
Fastest way to Replicate your Database data in Data Lake. OLake makes data replication faster by parallelizing full loads, leveraging change streams for real-time sync, and pulling data in a database-native format for efficient ingestion.
Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL
Related contents:
The fastest Postgres change data capture.
Stream data from Postgres directly to Kafka, Redis, and more. Replace complex tools like Debezium and consolidate workflows.
Related contents:
Migrate Databases and Stream Data Between Database Systems.
DBConvert Streams (DBS) is a cutting-edge distributed platform designed for data migration between heterogeneous databases and real-time data replication. It simplifies the process of transferring data between on-premises or cloud databases, including relational databases and data warehouses.
Related contents:
Open-source vector similarity search for Postgres.
Related contents:
A ledger implementation in PostgreSQL.
Related contents:
An embeddable, scalable, extremely fast graph database.
Embeddable property graph database management system built for query speed and scalability. Implements Cypher. Kuzu is an embedded graph database built for query speed and scalability. Kuzu is optimized for handling complex analytical workloads on very large databases and provides a set of retrieval features, such as a full text search and vector indices. Our core feature set includes:
Related contents:
1000x Faster Analytics in Postgres. Postgres-native Data Warehouse.
pg_mooncake is a Postgres extension that adds columnar storage and vectorized execution (DuckDB) for fast analytics within Postgres. Postgres + pg_mooncake ranks among the top 10 fastest in ClickBench.
Related contents:
Postgre SQL Operator for Kubernetes. Run PostgreSQL. The Kubernetes way.
CloudNativePG is the Kubernetes operator that covers the full lifecycle of a highly available PostgreSQL database cluster with a primary/standby architecture, using native streaming replication.
Related contents:
- Plongez dans le monde de CloudNativePG #4 - Les sauvegardes ! @ Dalibo :fr:.
- Making Postgres scale to zero with CNPG @ xata.
- Kubernetes Finally Solves Its Biggest Problem: Managing Databases @ The New Stack. https://medium.com/@nejdetkadir/how-i-built-my-own-home-lab-a-single-node-kubernetes-platform-34bdf6a08a26
Lightweight NoDB for Deno & React.
GoatDB is a real-time, version-controlled database for Deno, React, and low-friction deployments. It’s ideal for prototyping, self-hosting, single-tenant apps, as well as ultra light multi-tenant setups without heavy backends or complex DBs.
Distributed SQLite.
LiteFS is a distributed file system that transparently replicates SQLite databases. You can run your application like it’s running against a local on-disk SQLite database but behind the scenes the database is replicated to all the nodes in your cluster. With LiteFS, you can run your database right next to your application on the edge. You can run LiteFS anywhere!
SQL Indexing and Tuning e-Book for developers. Use The Index, Luke covers Oracle, MySQL, PostgreSQL, SQL Server, ...
A site explaining SQL indexing to developers—no crap about administration. SQL indexing is the most effective tuning method—yet it is often neglected during development. Use The Index, Luke explains SQL indexing from grounds up and doesn’t stop at ORM tools like Hibernate.
A database backup management and automation tool. Velld provides a user-friendly interface for scheduling, managing, and monitoring database backups, ensuring data security and easy recovery.
A PostgreSQL assistant for developers designed to help understand and optimize PostgreSQL database performance.
PgAssistant is an open-source tool designed to help developers understand and optimize their PostgreSQL database performance. It provides insights into database behavior, identifies schema-related issues, and assists in correcting them. Additionally, PgAssistant makes it easy to manage a library of specific SQL queries useful for your project through a simple JSON file.
Parseable is a disk less, cloud native database for logs, observability, security, and compliance. Parseable is built with focus on simplicity & resource efficiency.
A Minimalistic Wrapper for IndexedDB.
Dexie.js is a wrapper library for indexedDB - the standard database in the browser. IndexedDB is the portable database for all browser engines. Dexie.js makes it fun and easy to work with.
Visual tool to explore SQLite databases page-by-page, the way they're stored on disk and the way SQLite sees them. A small GUI application built in redbean that lets you explore your SQLite databases "page by page" the way SQLite sees them.
Database Change Management & CI/CD Automation, Database DevOps.
Automated, secure, and compliant database change management pipelines that accelerate delivery and reduce toil. Liquibase helps millions of developers track, version, and deploy database schema changes.
A powerful, AI-native Python client library for Redis. Leverage the speed, flexibility, and reliability of Redis for real-time data to supercharge your AI application.
Related contents:
DocumentDB offers a native implementation of document-oriented NoSQL database, enabling seamless CRUD operations on BSON data types within a PostgreSQL framework. Powering vCore-based Azure Cosmos DB for MongoDB.
Related contents:
Visualizing and understanding PostgreSQL EXPLAIN plans made easy.
A VueJS component to show a graphical vizualization of a PostgreSQL execution plan.
review Postgres query plans quickly.
A simple yet powerful tool to help you speed up queries. pgMustard speeds up your journey from knowing which query is a problem to working out what can be done about it.
Amazon DynamoDB is a fully managed NoSQL database service that provides fast and predictable performance with seamless scalability. You can use Amazon DynamoDB to create a database table that can store and retrieve any amount of data, and serve any level of request traffic. Amazon DynamoDB automatically spreads the data and traffic for the table over a sufficient number of servers to handle the request capacity specified by the customer and the amount of data stored, while maintaining consistent and fast performance.
Related contents:
Kronotop is a Redis-compatible, distributed and transactional document database backed by FoundationDB.
Kronotop's main focus is building a document database that supports MQL-like query language, ACID transactions and on-disk storage engine with a primary-standby replication model.
A native MacOS Postgres client.
Searchlight is a native macOS, open-source PostgreSQL client designed to be simple, lightweight, and developer-friendly. It offers a clean and intuitive interface for managing databases and running queries without the complexity of full-scale database management tools. Searchlight focuses on delivering a smooth and efficient experience for developers who need quick and easy access to their PostgreSQL databases.
The lightweight, user-friendly, distributed relational database built on SQLite. Fault tolerance and high availability with zero hassle.
Related contents:
Open Source Metrics Engine. Distributed TSDB and Query Engine, Prometheus Sidecar, Metrics Aggregator, and more such as Graphite storage and query engine.
M3 is a Prometheus compatible, easy to adopt metrics engine that provides visibility for some of the world’s largest brands.
Related contents:
Open Source Airtable Alternative & Backend as a Service. 🚀 Private first self-hosted no code database & BaaS.
UNDB is a no-code platform that can also serve as a Backend as a Service (BaaS). It is based on SQLite and can be packaged into a binary file using Bun for backend service. Additionally, it can be deployed as a service via Docker, offering a UI for table management.
Data Runs Better on SDF. Transform Data Better with SDF. SDF is the fastest way to build a scalable, reliable, and optimized data warehouse.
SDF is a developer platform for data that scales SQL understanding across an organization, empowering all data teams to unlock the full potential of their data.
SDF is a multi-dialect SQL compiler, transformation framework, and analytical database engine. It natively compiles SQL dialects, like Snowflake, and connects to their corresponding data warehouses to materialize models.
✨A CLI tool for analyzing queries and DB tables for MySQL.
The Database Toolkit for Python.
SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL.
It provides a full suite of well known enterprise-level persistence patterns, designed for efficient and high-performing database access, adapted into a simple and Pythonic domain language.
Distributed SQL Databases
Fastest serverless distributed SQL database for always available applications.
Self-hosted street address database
A SQLite3 database file with over 150 million U.S. and Canada address records. Indexed for fast queries, even on fairly slow hardware.
Open-source sQL AI Agent. Text2SQL made Easy!
Wren AI is an open-source SQL AI Agent that empowers data, product, and business teams to access insights through AI chat, built-in well designed intuitive UI and UX, integrating seamlessly with tools like Excel and Google Sheets.
Build Reliable Backends 10x Faster, Scale to Millions with 1 Click.
DBOS is a serverless platform for building highly reliable applications. What takes days to build on AWS takes minutes on DBOS.
Related contents:
Limbo is a work-in-progress, in-process OLTP database management system, compatible with SQLite.
Related contents:
How to reduce complexity and move faster? Just Postgres for everything.
The goal of this repository is to demonstrate how to use Postgres for Everything.
Type safe queries using the Rust type system.
The goal of this library is to allow writing relational database queries using familiar Rust syntax. The library should guarantee that a query can not fail if it compiles. This already includes preventing use after free for row ids passed between queries and even database migrations!
The open table format for analytic datasets.
Iceberg is a high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time.
Related contents:
- PyIceberg: Current State and Roadmap @ Ju Data Engineering Newsletter.
- The Equality Delete Problem in Apache Iceberg @ Data Engineer Things's Medium.
- How I Saved Millions by Restructuring Iceberg Metadata @ Gautham Gondi's Medium.
- High Throughput Ingestion with Iceberg @ Adobe Tech Blog's Medium.
- Scaling Iceberg Writes with Confidence: A Conflict-Free Distributed Architecture for Fast, Concurrent, Consistent Append-Only Writes @ e6data.
- Postgres Is the Gateway Drug @ Vignesh Ravichandran.
Powerful Database Client.
Outerbase Studio is a fully-featured, lightweight GUI client for managing Turso, LibSQL, Cloudflare D1, rqlite, MySQL, and PostgreSQL. It runs entirely in your browser, so there's no need to download anything.
The world's most advanced open source database.
Related contents:
- You Just Need Postgres.
- Postgres Locks Explained.
- What I Wish Someone Told Me About Postgres @ ChallahScript.
- Logical replication in Postgres: Basics @ EDB.
- Database sharding case study: PostgreSQL @ The Polymathic Engineer.
- I Tried Every Open Source Database and Found Only One That is Actually Useful @ Hacker Noon.
- How direct TLS can speed up your connections @ Marc Bowes.
- PostgreSQL pour remplacer Redis @ Rodolphe Bréard :fr:.
- One more reason to choose Postgres over MySQL @ tanin.
- From 99.9% to 99.99%: Building PostgreSQL Resilience into Your Product Architecture @ Stormatics.
- Handling unique indexes on large data in PostgreSQL @ Volodymyr Potiichuk.
- Postgres Internals Deep Dive: Process Architecture @ EDB Postgres.
- PostgreSQL maintenance without superuser @ boringSQL.
- Postgres’ Original Project Goals: The Creators Totally Nailed It @ Chunchy Data.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- PostgreSQL MVCC Explained (Simply!) @ SauravDhakal's Substack.
- Postgres Partitioning Best Practices: Sofia's Story @ Karen Jex.
- Tuning AIO in PostgreSQL 18 @ Tomas Vondra.
- Advanced PostgreSQL Indexing: Multi-Key Queries and Performance Optimization @ Frontend Masters.
- The best worst hack that saved our bacon @ Jefferson Heard.
- Going down the rabbit hole of Postgres 18 features @ xata.
- JIT: so you want to be faster than an interpreter on modern CPUs… @ Pinaraf's website.
- Postgres 18: OLD and NEW Rows in the RETURNING Clause @ crunchy data.
- Benchmarking Postgres 17 vs 18 @ PlanetScale.
- Is Postgres Read Heavy or Write Heavy? (And Why You Should You Care) @ crunchy data.
- Pipelining in psql (PostgreSQL 18) @ PostgreSQL Notes - Daniel Vérité.
- Kafka is fast -- I'll use Postgres @ TopicPartition.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Absurd Workflows: Durable Execution With Just Postgres @ Armin Ronacher's Thoughts and Writings.
- Don't give Postgres too much memory @ Tomas Vondra.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Postgres Internals Hiding in Plain Sight @ crunchy data.
- #PostgresMarathon 2-013: Why keep your index set lean @ PostgresAI.
- [99% of Developers Don't Get PostgreSQL @ The Coding Gopher's YouTube](https://www .youtube.com/watch?v=P8rrhZTPEAQ).
- PostgreSQL DBA @ Developer Roadmaps.
- How/Why to Sweep Async Tasks Under a Postgres Table @ taylor.town.
- Instant database clones with PostgreSQL 18 @ boringSQL.
- Go ahead, self-host Postgres @ Pierce Freeman.
- PostgreSQL 18 RETURNING Enhancements: A Game Changer for Modern Applications @ pgEdge.
- The hidden cost of PostgreSQL arrays @ boringSQL.
- Life Altering Postgresql Patterns @ mccue.dev.
- Unconventional PostgreSQL Optimizations @ Haki Benita.
- I Replaced Redis with PostgreSQL (And It's Faster) @ Polliog's dev.to.
- Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems @ Diljit's Corner.
- Introduction to PostgreSQL Indexes @ Dalto Curvelano.
- Introducing: Postgres Best Practices @ supabase.
- Postgres Postmaster does not scale @ recall.ai.
- Futureproofing Tines: Partitioning a 17TB table in PostgreSQL @ tines.
- Database Indexing @ AkashSDas' Medium.
- Scaling PostgreSQL to power 800 million ChatGPT users @ OpenAI.
- Unlocking High-Performance PostgreSQL: Key Memory Optimizations @ Stormatics.
- Six Signs That Postgres Tuning Won't Fix Your Performance Problems @ TigerData.
- PostgreSQL Bloat Is a Feature, Not a Bug @ Roger Welin.
- Read efficiency issues in Postgres queries @ pg mustard.
- The real cost of random I/O @ Tomas Vondra.
- Production query plans without production data @ Boring SQL.
- Rust is slowly but surely eating PostgreSQL: Deep dive into Neon, ParadeDB, PgDog and more @ Sylvain Kerkour.
- How We Optimized Top K in Postgres @ ParadeDB.
- Using Rust and Postgres for everything: patterns learned over the years @ Sylvain Kerkour.
- Ctrl-C in psql gives me the heebie-jeebies @ Neon.
- When upserts don't update but still write: Debugging Postgres performance at scale @ Datadog.
- Introduction to PostgreSQL Indexes @ explain, analyze.
- Keeping a Postgres queue healthy @ PlanetScale.
- I replaced my entire stack with Postgres... @ The Coding Gopher.
- Does Postgres Scale? @ DBOS.
- The "Just Use Postgres" Trap @ CodeOpinion's YouTube.
- How we saved ~40GB of Postgres space wasted on indexes @ Ravi Ojha's peer list.
- Vos requêtes SQL jusqu'à 10000 fois plus rapides, durablement. - Alain LESAGE (DALIBO) @ Devoxx France's YouTube :fr:.
- Handling graphs with SQL/PGQ in PostgreSQL @ Cybertec.
- When failover isn’t safe: Building high-availability PostgreSQL on Kubernetes @ Datadog Engineering.
- The only scalable delete in Postgres is DROP TABLE @ Planetscale.
- The NULL in your NOT IN @ boringSQL.
- The feedback loops behind Kubernetes @ Planetscale.
- Too many tables are bad for you @ Cybertec.
- PostgreSQL and the OOM Killer: Why We Use Strict Memory Overcommit @ ubicloud.
- How to Achieve Pruning When Querying by Non-Partitioned Columns in PostgreSQL @ Haki Benita.
- The four horsemen behind thousands of Postgres outages @ malisper.me.
- PostgreSQL as a temporal database @ xata.
- Repeatable Read vs Snapshot Isolation @ jaymcor.github.io.
- The database that refused to die: How Postgres survived its own creators @ The Register.
- The startup's Postgres survival guide @ Hatchet.
- PostgreSQL's MVCC is bad. So is everyone else's @ Boring SQL.
- The dangers of Postgres subtransactions @ Planetscale.
- Massively parallel Postgres backups @ Planetscale.
NoSQL Database. Life is an Adventure — Your Database Shouldn't Be.
ACID Document Database.
Related contents:
The Fastest In-Memory Data Store. A modern replacement for Redis and Memcached.
Dragonfly is a drop-in Redis replacement that cuts costs and boosts performance. Designed to fully utilize the power of modern cloud hardware and deliver on the data demands of modern applications, Dragonfly frees developers from the limits of traditional in-memory data stores.