sql
csvkit is a suite of command-line tools for converting to and working with CSV, the king of tabular file formats.
It is inspired by pdftk, GDAL and the original csvcut tool by Joe Germuska and Aaron Bycoffe.
It provides in2csv to convert xlsx to csv, and csvsql to populate a database with a csv file contents.
Use SQL for everything. Query anything with old-school cool SQL.
Anyquery is a CLI tool to run SQL queries on any data source, no matter if it's a file, an API, logs, or a local app. See the integrations for the full extent of what you can do.
A CLI tool that executes SQL queries on xlsx files and outputs the results to various files, and also executes SQL queries on various files and outputs them to xlsx files.
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
SQLFluff is an open source, dialect-flexible and configurable SQL linter. Designed with ELT applications in mind, SQLFluff also works with Jinja templating and dbt. SQLFluff will auto-fix most linting errors, allowing you to focus your time on what matters.
Cloud-native stream processing. Distributed stream processing engine in Rust.
Transform, filter, aggregate, and join data streams by writing SQL, with sub-second results. Scale from zero to millions of events per second.
Arroyo is a distributed stream processing engine written in Rust, designed to efficiently perform stateful computations on streams of data. Unlike traditional batch processing, streaming engines can operate on both bounded and unbounded sources, emitting results as soon as they are available.
Related contents:
jSQL Injection is a Java application for automatic SQL database injection.
Fast SQL for time-series
QuestDB is an open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity. It supports schema-agnostic ingestion using the InfluxDB line protocol, PostgreSQL wire protocol, and a REST API for bulk imports and exports.
This domain name has been registered with Gandi.net. It is currently parked by the owner.
Open-source sQL AI Agent. Text2SQL made Easy!
Wren AI is an open-source SQL AI Agent that empowers data, product, and business teams to access insights through AI chat, built-in well designed intuitive UI and UX, integrating seamlessly with tools like Excel and Google Sheets.
A High Performance Open Source MySQL Proxy.
ProxySQL is an open source high performance, high availability, database protocol aware proxy for MySQL
A Model Context Protocol server that provides read-only access to PostgreSQL databases. This server enables LLMs to inspect database schemas and execute read-only queries.
Related contents:
GQL is a query language with a syntax very similar to SQL with a tiny engine to perform queries on .git files instance of database files, the engine executes the query on the fly without the need to create database files or convert .git files into any other format, note that all Keywords in GQL are case-insensitive similar to SQL.
A ledger implementation in PostgreSQL.
Related contents:
VillageSQL is the Innovation Platform for MySQL. A drop-in replacement for MySQL with extensions for the agentic AI era.
Related contents:
A Detective SQL Game
SQL Noir is an interactive mystery-solving game where you crack cases by writing SQL queries.
The Cloud Operational Data Store. Use SQL to transform, deliver, and act on fast-changing data.
Materialize is a cloud-native data warehouse purpose-built for operational workloads where an analytical data warehouse would be too slow, and a stream processor would be too complicated.
Using SQL and common tools in the wider data ecosystem, Materialize allows you to build real-time automation, engaging customer experiences, and interactive data products that drive value for your business while reducing the cost of data freshness.
Query your data in plain English.
Turn natural language questions into SQL queries with a small, local model that matches cloud LLM accuracy.
We fine-tuned a small language model to convert plain English questions into executable SQL queries. Because it's small, you can run it locally on your own machine, no API keys, no cloud dependencies, full privacy. Load your CSV files, ask questions, get answers.
SchemaSpy is a Java-based tool (requires Java 5 or higher) that analyzes the metadata of a schema in a database and generates a visual representation of it in a browser-displayable format. It lets you click through the hierarchy of database tables via child and parent table relationships as represented by both HTML links and entity-relationship diagrams. It's also designed to help resolve the obtuse errors that a database sometimes gives related to failures due to constraints.
🔱 A dynamic SQL query builder for MySQL, Postgres and SQLite.
SeaQuery is a query builder to help you construct dynamic SQL queries in Rust. You can construct expressions, queries and schema as abstract syntax trees using an ergonomic API. We support MySQL, Postgres and SQLite behind a common interface that aligns their behaviour where appropriate. MS SQL Server Support is available under SeaORM X.
meilibridge is a robust package designed to seamlessly sync data from both SQL and NoSQL databases to Meilisearch, providing an efficient and unified search solution.
Open-source low-code web application framework. Create full websites writing only simple database queries.
SQLpage is an SQL-only webapp builder. It is meant for data scientists, analysts, and business intelligence teams to build powerful data-centric applications quickly, without worrying about any of the traditional web programming languages and concepts.
With SQLPage, you write simple .sql files containing queries to your database to select, group, update, insert, and delete your data, and you get good-looking clean webpages displaying your data as text, lists, grids, plots, and forms.
SQuirreL SQL is an open-source Java SQL Client program for any JDBC compliant database
databow is a command-line tool for querying databases.
A command-line tool for querying databases via ADBC.
Python SQL Parser and Transpiler.
SQLGlot is a no-dependency SQL parser, transpiler, optimizer, and engine. It can be used to format SQL or translate between 31 different dialects like DuckDB, Presto / Trino, Spark / Databricks, Snowflake, and BigQuery. It aims to read a wide variety of SQL inputs and output syntactically and semantically correct SQL in the targeted dialects.
FerretDB allows you to use MongoDB drivers seamlessly with PostgreSQL as the database backend. Use all tools, drivers, UIs, and the same query language and stay open-source.
Open-source database client for PostgreSQL, MySQL/MariaDB and SQLite with SQL notebooks, visual EXPLAIN, AI and MCP built in. Hackable with plugins.
Tabularis is an open-source desktop SQL workspace for PostgreSQL, MySQL/MariaDB, and SQLite, with a built-in MCP server so Claude, Cursor, and Windsurf can read your schema and run queries through the same app you already use.
DuckDB is an in-process SQL OLAP database management system.
DuckDB is a high-performance analytical database system. It is designed to be fast, reliable, portable, and easy to use. DuckDB provides a rich SQL dialect, with support far beyond basic SQL DuckDB supports arbitrary and nested correlated subqueries, window functions, collations, complex types (arrays, structs, maps), and several extensions designed to make SQL easier to use.
Related contents:
- DuckDB - Le moteur SQL qui transforme vos données @ Korben :fr:.
- Why DuckDB is my first choice for data processing @ >robinlinacre.
- DuckDB is Probably the Most Important Geospatial Software of the Last Decade @ dbreunig.com.
- Why Semantic Layers Matter — and How to Build One with DuckDB @ MotherDuck.
- Querying Billions of GitHub Events Using Modal and DuckDB (Part 1: Ingesting Data) @ noreasontopanic.
- DuckDB beats Polars for 1TB of data @ Confessions of a Data Guy.
- Building Your Modern Data Analytics Stack with Python, Parquet, and DuckDB @ KD nuggets.
- Building an Obsidian RAG with DuckDB and MotherDuck @ MotherDuck.
- DuckDB Internals: Why is DuckDB Fast? (Part 1) @ Greybeam.
Create custom SQLite functions in JavaScript. Extend your database with scalars, aggregates, window functions, and collations directly in JavaScript.
SQLite-JS is a powerful extension that brings JavaScript capabilities to SQLite. With this extension, you can create custom SQLite functions, aggregates, window functions, and collation sequences using JavaScript code, allowing for flexible and powerful data manipulation directly within your SQLite database.
Get MySQL EXPLAIN plans that are understandable for humans.
MySQL Query optimization with the EXPLAIN command is unnecessarily complicated: The output contains a lot of cryptic information that is incomprehensible or entirely misleading.
This Laravel package collects many query metrics that will be sent to explainmysql.com and transformed to be much easier to understand.
review Postgres query plans quickly.
A simple yet powerful tool to help you speed up queries. pgMustard speeds up your journey from knowing which query is a problem to working out what can be done about it.
sqlcake is an automatic SQL injection exploitation kit written in Ruby. It's designed for system administration and penetration testing.
A web-based tool to easily generate customizable SQLMap commands for testing SQL injection vulnerabilities. Features include target configuration, connection options, detection levels, and various SQL injection techniques. Perfect for penetration testers and security enthusiasts.
NMIG is a database migration tool, written in Node.js and highly inspired by FromMySqlToPostgreSql. NMIG is an app, intended to make a process of migration from MySQL to PostgreSQL as easy and smooth as possible.
a free educational game that's inspired by Netflix's Squid Game, SQL Murder Mystery, and a few other SQL Games we love to play.
Dolt is Git for data. The world's first and only version-controlled SQL database.
Dolt is a SQL database that you can fork, clone, branch, merge, push and pull just like a Git repository.
Connect to Dolt just like any MySQL database to read or modify schema and data. Version control functionality is exposed in SQL via system tables, functions, and procedures.
Related contents:
SQL language server written in Go.
sqls aims to provide advanced intelligence for you to edit sql in your own editor.
Type safe queries using the Rust type system.
The goal of this library is to allow writing relational database queries using familiar Rust syntax. The library should guarantee that a query can not fail if it compiles. This already includes preventing use after free for row ids passed between queries and even database migrations!
Your agent's query language. One SQL interface over APIs, files, and live sources — built for agents.
Coral gives agents a local-first SQL runtime over APIs, files, and other data sources. Query it from the CLI, inspect schemas and tables, or expose the same runtime over MCP so agents can use it without bespoke tool glue.
DuckLake is an integrated data lake and catalog format
DuckLake delivers advanced data lake features without traditional lakehouse complexity by using Parquet files and your SQL database. It's an open, standalone format from the DuckDB team.
DuckLake is an open Lakehouse format that is built on SQL and Parquet. DuckLake stores metadata in a catalog database, and stores data in Parquet files. The DuckLake extension allows DuckDB to directly read and write data from DuckLake.
A modern open source language for analyzing, transforming, and modeling data.
Malloy is a modern open source language for describing data relationships and transformations. It is both a semantic modeling language and a query language that uses an existing SQL engine to execute queries. Malloy currently can connect to BigQuery, Snowflake, PostgreSQL, MySQL, Trino, or Presto, and natively supports DuckDB. We've built a Visual Studio Code extension to facilitate building Malloy data models, querying and transforming data, and creating simple visualizations and dashboards.
Related contents:
Knex.js is a batteries-included SQL query builder for JavaScript.
Knex.js (pronounced /kəˈnɛks/) is a "batteries included" SQL query builder for PostgreSQL, CockroachDB, MSSQL, MySQL, MariaDB, SQLite3, Better-SQLite3, Oracle, and Amazon Redshift designed to be flexible, portable, and fun to use.
Business Intelligence as Code. Build polished data products with SQL. Build fast, interactive data visualizations in pure SQL and markdown.
Evidence is a lightweight framework for building data apps. It's open source and free to get started.
The Headless CMS + Backend for Every Custom Build. Directus is a real-time API and App dashboard for managing SQL database content. The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, auth & more.
Built for developers who need more than just a CMS. Manage complex content structures, handle digital assets, and control user permissions – all through an intuitive Studio.
Related contents:
The type-safe SQL query builder for TypeScript.
Kysely (pronounce “Key-Seh-Lee”) is a type-safe and autocompletion-friendly TypeScript SQL query builder. Inspired by Knex.js. Mainly developed for Node.js but also runs on all other JavaScript environments like Deno, Bun, Cloudflare Workers and web browsers.
Related contents:
The world's most advanced open source database.
Related contents:
- You Just Need Postgres.
- Postgres Locks Explained.
- What I Wish Someone Told Me About Postgres @ ChallahScript.
- Logical replication in Postgres: Basics @ EDB.
- Database sharding case study: PostgreSQL @ The Polymathic Engineer.
- I Tried Every Open Source Database and Found Only One That is Actually Useful @ Hacker Noon.
- How direct TLS can speed up your connections @ Marc Bowes.
- PostgreSQL pour remplacer Redis @ Rodolphe Bréard :fr:.
- One more reason to choose Postgres over MySQL @ tanin.
- From 99.9% to 99.99%: Building PostgreSQL Resilience into Your Product Architecture @ Stormatics.
- Handling unique indexes on large data in PostgreSQL @ Volodymyr Potiichuk.
- Postgres Internals Deep Dive: Process Architecture @ EDB Postgres.
- PostgreSQL maintenance without superuser @ boringSQL.
- Postgres’ Original Project Goals: The Creators Totally Nailed It @ Chunchy Data.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- PostgreSQL MVCC Explained (Simply!) @ SauravDhakal's Substack.
- Postgres Partitioning Best Practices: Sofia's Story @ Karen Jex.
- Tuning AIO in PostgreSQL 18 @ Tomas Vondra.
- Advanced PostgreSQL Indexing: Multi-Key Queries and Performance Optimization @ Frontend Masters.
- The best worst hack that saved our bacon @ Jefferson Heard.
- Going down the rabbit hole of Postgres 18 features @ xata.
- JIT: so you want to be faster than an interpreter on modern CPUs… @ Pinaraf's website.
- Postgres 18: OLD and NEW Rows in the RETURNING Clause @ crunchy data.
- Benchmarking Postgres 17 vs 18 @ PlanetScale.
- Is Postgres Read Heavy or Write Heavy? (And Why You Should You Care) @ crunchy data.
- Pipelining in psql (PostgreSQL 18) @ PostgreSQL Notes - Daniel Vérité.
- Kafka is fast -- I'll use Postgres @ TopicPartition.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Absurd Workflows: Durable Execution With Just Postgres @ Armin Ronacher's Thoughts and Writings.
- Don't give Postgres too much memory @ Tomas Vondra.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Postgres Internals Hiding in Plain Sight @ crunchy data.
- #PostgresMarathon 2-013: Why keep your index set lean @ PostgresAI.
- [99% of Developers Don't Get PostgreSQL @ The Coding Gopher's YouTube](https://www .youtube.com/watch?v=P8rrhZTPEAQ).
- PostgreSQL DBA @ Developer Roadmaps.
- How/Why to Sweep Async Tasks Under a Postgres Table @ taylor.town.
- Instant database clones with PostgreSQL 18 @ boringSQL.
- Go ahead, self-host Postgres @ Pierce Freeman.
- PostgreSQL 18 RETURNING Enhancements: A Game Changer for Modern Applications @ pgEdge.
- The hidden cost of PostgreSQL arrays @ boringSQL.
- Life Altering Postgresql Patterns @ mccue.dev.
- Unconventional PostgreSQL Optimizations @ Haki Benita.
- I Replaced Redis with PostgreSQL (And It's Faster) @ Polliog's dev.to.
- Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems @ Diljit's Corner.
- Introduction to PostgreSQL Indexes @ Dalto Curvelano.
- Introducing: Postgres Best Practices @ supabase.
- Postgres Postmaster does not scale @ recall.ai.
- Futureproofing Tines: Partitioning a 17TB table in PostgreSQL @ tines.
- Database Indexing @ AkashSDas' Medium.
- Scaling PostgreSQL to power 800 million ChatGPT users @ OpenAI.
- Unlocking High-Performance PostgreSQL: Key Memory Optimizations @ Stormatics.
- Six Signs That Postgres Tuning Won't Fix Your Performance Problems @ TigerData.
- PostgreSQL Bloat Is a Feature, Not a Bug @ Roger Welin.
- Read efficiency issues in Postgres queries @ pg mustard.
- The real cost of random I/O @ Tomas Vondra.
- Production query plans without production data @ Boring SQL.
- Rust is slowly but surely eating PostgreSQL: Deep dive into Neon, ParadeDB, PgDog and more @ Sylvain Kerkour.
- How We Optimized Top K in Postgres @ ParadeDB.
- Using Rust and Postgres for everything: patterns learned over the years @ Sylvain Kerkour.
- Ctrl-C in psql gives me the heebie-jeebies @ Neon.
- When upserts don't update but still write: Debugging Postgres performance at scale @ Datadog.
- Introduction to PostgreSQL Indexes @ explain, analyze.
- Keeping a Postgres queue healthy @ PlanetScale.
- I replaced my entire stack with Postgres... @ The Coding Gopher.
- Does Postgres Scale? @ DBOS.
- The "Just Use Postgres" Trap @ CodeOpinion's YouTube.
- How we saved ~40GB of Postgres space wasted on indexes @ Ravi Ojha's peer list.
- Vos requêtes SQL jusqu'à 10000 fois plus rapides, durablement. - Alain LESAGE (DALIBO) @ Devoxx France's YouTube :fr:.
- Handling graphs with SQL/PGQ in PostgreSQL @ Cybertec.
- When failover isn’t safe: Building high-availability PostgreSQL on Kubernetes @ Datadog Engineering.
- The only scalable delete in Postgres is DROP TABLE @ Planetscale.
- The NULL in your NOT IN @ boringSQL.
- The feedback loops behind Kubernetes @ Planetscale.
- Too many tables are bad for you @ Cybertec.
- PostgreSQL and the OOM Killer: Why We Use Strict Memory Overcommit @ ubicloud.
- How to Achieve Pruning When Querying by Non-Partitioned Columns in PostgreSQL @ Haki Benita.
- The four horsemen behind thousands of Postgres outages @ malisper.me.
- PostgreSQL as a temporal database @ xata.
- Repeatable Read vs Snapshot Isolation @ jaymcor.github.io.
Analytics and data science notebook for teams. Jupyter notebook for the AI era.
-
Link Snowflake, BigQuery, CSVs, and 60+ data sources
-
Write in Python, SQL, R — or just prompt Deepnote Agent
-
Build powerful data apps and dashboards with AI
📊 Cube — The Semantic Layer for Building Data Applications. The Universal Semantic Layer.
Build trust with a semantic layer. Connect siloed data, define consistent metrics, and power AI and analytics with context.
Cube is the semantic layer for building data applications. It helps data engineers and application developers access data from modern data stores, organize it into consistent definitions, and deliver it to every application.
Cube was designed to work with all SQL-enabled data sources, including cloud data warehouses like Snowflake or Google BigQuery, query engines like Presto or Amazon Athena, and application databases like Postgres. Cube has a built-in relational caching engine to provide sub-second latency and high concurrency for API requests.
Allows you to easily execute SQL against structured text like CSV or TSV.
Free Online SQL Diagram & ERD Generator.
ER diagram generator. Paste CREATE TABLE statements and get a clean, interactive ERD — runs 100% in your browser, nothing uploaded
A consistent code style guide for SQL to ensure legible and maintainable projects.
Transform SQL queries into interactive visual flow diagrams.
SQL Crack is a VS Code extension that visualizes SQL queries as interactive execution flow diagrams. Understand complex queries at a glance, track data lineage across your entire workspace, and identify optimization opportunities with professional-grade visual analysis.
SQLite is a C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.
Related contents:
Visualizing and understanding PostgreSQL EXPLAIN plans made easy.
A VueJS component to show a graphical vizualization of a PostgreSQL execution plan.
A fast, lightweight replacement for SwiftData, powered by SQL and supporting CloudKit synchronization.
AdminerEvo is a web-based database management interface, with a focus on security, user experience, performance, functionality and size.
AdminerEvo works out of the box with MySQL, MariaDB, PostgreSQL, SQLite, MS SQL, Oracle, Elasticsearch and MongoDB. In addition, there are plugins for SimpleDB, Firebird and ClickHouse.
TypeScript ORM that feels like writing SQL.
Drizzle ORM is a TypeScript ORM for SQL databases designed with maximum type safety in mind. It comes with a drizzle-kit CLI companion for automatic SQL migrations generation. Drizzle ORM is meant to be a library, not a framework. It stays as an opt-in solution all the time at any levels. The ORM's main philosophy is "If you know SQL, you know Drizzle ORM". We follow the SQL-like syntax whenever possible, are strongly typed ground up, and fail at compile time, not in runtime.