sql
Write SQL. Ship confidence. SQL-first tooling for PostgreSQL Type-safe PostgreSQL client code generator.
pGenie validates SQL, manages indexes, and generates type-safe client SDKs — all derived from the migrations and queries in plain SQL.
A BIg Bench for Large-Scale Relational Database Grounded Text-to-SQLs.
BIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation) represents a pioneering, cross-domain dataset that examines the impact of extensive database contents on text-to-SQL parsing. BIRD contains over 12,751 unique question-SQL pairs, 95 big databases with a total size of 33.4 GB. It also covers more than 37 professional domains, such as blockchain, hockey, healthcare and education, etc.
Related contents:
Transform SQL queries into interactive visual flow diagrams.
SQL Crack is a VS Code extension that visualizes SQL queries as interactive execution flow diagrams. Understand complex queries at a glance, track data lineage across your entire workspace, and identify optimization opportunities with professional-grade visual analysis.
Open Source, SQL-driven Data Dashboards powered by DuckDB.
Build analytics dashboards simply by writing SQL.
Related contents:
Watch SQL traffic in real-time with a TUI. Real-time SQL traffic viewer — proxy daemon + TUI / Web client.
sql-tap sits between your application and your database (PostgreSQL, MySQL, or TiDB), capturing every query and displaying it in an interactive terminal UI. Inspect queries, view transactions, and run EXPLAIN — all without changing your application code.
Related contents:
VillageSQL is the Innovation Platform for MySQL. A drop-in replacement for MySQL with extensions for the agentic AI era.
Related contents:
Idempotent schema management for MySQL, PostgreSQL, SQLite, and SQL Server.
sqldef is a CLI tool for diffing two SQL schemas. You can use it to manage the migration of RDBMSs using regular SQL DDLs.
Supported databases: MySQL, MariaDB, TiDB, PostgreSQL, SQL Server, and SQLite3.
Query your data in plain English.
Turn natural language questions into SQL queries with a small, local model that matches cloud LLM accuracy.
We fine-tuned a small language model to convert plain English questions into executable SQL queries. Because it's small, you can run it locally on your own machine, no API keys, no cloud dependencies, full privacy. Load your CSV files, ask questions, get answers.
Unified Engine for large-scale data analytics.
Apache Spark™ is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
Related contents:
🔱 A dynamic SQL query builder for MySQL, Postgres and SQLite.
SeaQuery is a query builder to help you construct dynamic SQL queries in Rust. You can construct expressions, queries and schema as abstract syntax trees using an ergonomic API. We support MySQL, Postgres and SQLite behind a common interface that aligns their behaviour where appropriate. MS SQL Server Support is available under SeaORM X.
The type-safe SQL query builder for TypeScript.
Kysely (pronounce “Key-Seh-Lee”) is a type-safe and autocompletion-friendly TypeScript SQL query builder. Inspired by Knex.js. Mainly developed for Node.js but also runs on all other JavaScript environments like Deno, Bun, Cloudflare Workers and web browsers.
Related contents:
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
SQLFluff is an open source, dialect-flexible and configurable SQL linter. Designed with ELT applications in mind, SQLFluff also works with Jinja templating and dbt. SQLFluff will auto-fix most linting errors, allowing you to focus your time on what matters.
A user friendly TUI for SQL databases. Written in python. Supports SQL server, Mysql, PostreSQL and SQLite, Turso and more.
The lazygit of SQL databases. Connect to Postgres, MySQL, SQL Server, SQLite, Supabase, Turso, and more from your terminal in seconds.
Related contents:
The incremental computing engine for AI, ML and data teams.
Feldera is a fast query engine for incremental computation. Feldera has the unique ability to evaluate arbitrary SQL programs incrementally, making it more powerful, expressive and performant than existing alternatives like batch engines, warehouses, stream processors or streaming databases.
Related contents:
Fast PostgreSQL Client for Developers.
A minimal, fast SQL client desktop application with AI-powered querying. Built for developers who want to quickly peek at their data without the bloat. Supports PostgreSQL, MySQL, and Microsoft SQL Server.
Regression Testing your SQL queries.
The regresql tool implement a regression testing facility for SQL queries, and supports the PostgreSQL database system. A regression test allows to ensure known results when the code is edited.
Related contents:
Analytics and data science notebook for teams. Jupyter notebook for the AI era.
-
Link Snowflake, BigQuery, CSVs, and 60+ data sources
-
Write in Python, SQL, R — or just prompt Deepnote Agent
-
Build powerful data apps and dashboards with AI
A CLI tool that executes SQL queries on xlsx files and outputs the results to various files, and also executes SQL queries on various files and outputs them to xlsx files.
Your last data platform. Reliable data. 10x faster, 90% less complexity.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL & Python, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.
Related contents:
Dynamic data management framework. The foundation for your next high-performance database.
It contains many of the pieces that comprise a typical database management system but omits the storage primitives. It provides an industry standard SQL parser and validator, a customisable optimizer with pluggable rules and cost functions, logical and physical algebraic operators, various transformation algorithms from SQL to algebra (and the opposite), and many adapters for executing SQL queries over Cassandra, Druid, Elasticsearch, MongoDB, Kafka, and others, with minimal configuration.
Related contents:
Python SQL Parser and Transpiler.
SQLGlot is a no-dependency SQL parser, transpiler, optimizer, and engine. It can be used to format SQL or translate between 31 different dialects like DuckDB, Presto / Trino, Spark / Databricks, Snowflake, and BigQuery. It aims to read a wide variety of SQL inputs and output syntactically and semantically correct SQL in the targeted dialects.
The Doctrine Project is the home to several PHP libraries primarily focused on database storage and object mapping.
Related contents:
A fast, lightweight replacement for SwiftData, powered by SQL and supporting CloudKit synchronization.
A modern open source language for analyzing, transforming, and modeling data.
Malloy is a modern open source language for describing data relationships and transformations. It is both a semantic modeling language and a query language that uses an existing SQL engine to execute queries. Malloy currently can connect to BigQuery, Snowflake, PostgreSQL, MySQL, Trino, or Presto, and natively supports DuckDB. We've built a Visual Studio Code extension to facilitate building Malloy data models, querying and transforming data, and creating simple visualizations and dashboards.
Related contents:
A PostgreSQL SQL syntax beautifier that can work as a console program or as a CGI.
This SQL formatter/beautifier supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. Works with any other databases too.
A Model Context Protocol server that provides read-only access to PostgreSQL databases. This server enables LLMs to inspect database schemas and execute read-only queries.
Related contents:
The best dashboards are built with code. Create fast, beautiful data apps, dashboards, and reports from the command line. Write Markdown, JavaScript, SQL, Python, R… and any language you like. Free and open-source.
A static site generator for data apps, dashboards, reports, and more. Observable Framework combines JavaScript on the front-end for interactive graphics with any language on the back-end for data analysis.
csvkit is a suite of command-line tools for converting to and working with CSV, the king of tabular file formats.
It is inspired by pdftk, GDAL and the original csvcut tool by Joe Germuska and Aaron Bycoffe.
It provides in2csv to convert xlsx to csv, and csvsql to populate a database with a csv file contents.
Sirius is a GPU-native SQL engine. It plugs into existing databases such as DuckDB via the standard Substrait query format, requiring no query rewrites or major system changes. Sirius currently supports DuckDB and Doris (coming soon), other systems marked with * are on our roadmap.
Create custom SQLite functions in JavaScript. Extend your database with scalars, aggregates, window functions, and collations directly in JavaScript.
SQLite-JS is a powerful extension that brings JavaScript capabilities to SQLite. With this extension, you can create custom SQLite functions, aggregates, window functions, and collation sequences using JavaScript code, allowing for flexible and powerful data manipulation directly within your SQLite database.
LumoSQL is a modification (not a fork) of the SQLite embedded data storage library, which is among the most-deployed software. LumoSQL adds security, privacy, performance and measurement features to SQLite.
DuckLake is an integrated data lake and catalog format
DuckLake delivers advanced data lake features without traditional lakehouse complexity by using Parquet files and your SQL database. It's an open, standalone format from the DuckDB team.
DuckLake is an open Lakehouse format that is built on SQL and Parquet. DuckLake stores metadata in a catalog database, and stores data in Parquet files. The DuckLake extension allows DuckDB to directly read and write data from DuckLake.
Index your Gmail account to a SQLite DB and play with the data.
This is a script to download emails from Gmail and store them in a SQLite database for further analysis. I find it extremely useful to have all my emails in a database to run queries on them. For example, I can find out how many emails I received per sender, which emails take the most space, and which emails from which sender I never read.
Search input query parser and React component.
A powerful search query language parser with SQL output support, inspired by Elasticsearch and Tantivy query syntax.
All-in-One Desktop App to Analyze Data Locally.
TextQuery is an all-in-one desktop app to import, query, modify, and visualize your raw data with SQL.
A Doom-like game using DuckDB.
A 3D first-person shooter game implemented entirely in SQL using DuckDB-WASM.
SQLite is a C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine. SQLite is the most used database engine in the world. SQLite is built into all mobile phones and most computers and comes bundled inside countless other applications that people use every day. More Information...
Related contents:
- SQLite File Format Viewer.
- SQLite Transactions and Virtual Tables @ Misframe.
- A faster way to copy SQLite databases between computers @, alexwlchan.
- Scaling SQLite to 4M QPS on a single server (EC2 vs Bare Metal) @ Expensify.
- PSA: SQLite WAL checksums fail silently and may lose data @ blag.
- Lessons learned from building a sync-engine and reactivity system with SQLite @ Antoine's blog.
- From 19k to 4.2M events/sec: story of a SQLite query optimisation @ mnt.io.
- SQLite Is ULTIMATE Choice For 99% of Projects @ DevOps Toolbox's YouTube.
- Subtleties of SQLite Indexes @ Evan Schwartz.
- SQLite concurrency and why you should care about it @ Jellyfin.
- 100000 TPS over a billion rows: the unreasonable effectiveness of SQLite @ anders murphy.
- The Silent Standard: Why the World’s Most Deployed Database Is Killing the Custom File Format @ WebProNews.
- SQLite JSON Superpower: Virtual Columns + Indexing @ DB Pro.
- I don't buy SQLite in the cloud @ Monroe Clinton.
- SQLite 3.52 Released With WAL Corruption Fix and CLI Improvements @ linuxiac.
- Gotchas with SQLite in Production @ Anže's Blog.
- Modern SQLite: Features You Didn’t Know It Had @ slicker.me.
A collection of language tools and a Language Server Protocol (LSP) implementation for Postgres, focusing on developer experience and reliable SQL tooling.
Related contents:
A ledger implementation in PostgreSQL.
Related contents:
Cloud-native stream processing. Distributed stream processing engine in Rust.
Transform, filter, aggregate, and join data streams by writing SQL, with sub-second results. Scale from zero to millions of events per second.
Arroyo is a distributed stream processing engine written in Rust, designed to efficiently perform stateful computations on streams of data. Unlike traditional batch processing, streaming engines can operate on both bounded and unbounded sources, emitting results as soon as they are available.
Related contents:
The Headless CMS + Backend for Every Custom Build. Directus is a real-time API and App dashboard for managing SQL database content. The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, auth & more.
Built for developers who need more than just a CMS. Manage complex content structures, handle digital assets, and control user permissions – all through an intuitive Studio.
Related contents:
Open Source, Multi Cloud, Analytics, IaC, more. Provision. Query. Secure.
Query, provision and operate Cloud and SaaS resources and APIs using an extensible SQL based framework. Deploy, manage and query cloud resources and interact with APIs using SQL.
Related content:
SQL Indexing and Tuning e-Book for developers. Use The Index, Luke covers Oracle, MySQL, PostgreSQL, SQL Server, ...
A site explaining SQL indexing to developers—no crap about administration. SQL indexing is the most effective tuning method—yet it is often neglected during development. Use The Index, Luke explains SQL indexing from grounds up and doesn’t stop at ORM tools like Hibernate.
A Detective SQL Game
SQL Noir is an interactive mystery-solving game where you crack cases by writing SQL queries.
Efficient data transformation and modeling framework that is backwards compatible with dbt.
SQLMesh is a next-generation data transformation framework designed to ship data quickly, efficiently, and without error. Data teams can efficiently run and deploy data transformations written in SQL or Python with visibility and control at any size.
Related contents:
Visualizing and understanding PostgreSQL EXPLAIN plans made easy.
A VueJS component to show a graphical vizualization of a PostgreSQL execution plan.
review Postgres query plans quickly.
A simple yet powerful tool to help you speed up queries. pgMustard speeds up your journey from knowing which query is a problem to working out what can be done about it.
The lightweight, user-friendly, distributed relational database built on SQLite. Fault tolerance and high availability with zero hassle.
Related contents:
Easily ask questions about your Linux, Windows, and macOS infrastructure.
Related contents:
SQL-like Querying for Various Data Sources.
Musoq lets you use SQL-like queries on files, directories, images and other data sources without a database. It's designed to ease life for developers.
Musoq is a tool that lets developers and IT professionals query different data sources using SQL-like syntax, without needing to import data into a database first. It’s designed for scenarios where you need to analyze files, directories, archives, or other data sources quickly and efficiently.
Data Runs Better on SDF. Transform Data Better with SDF. SDF is the fastest way to build a scalable, reliable, and optimized data warehouse.
SDF is a developer platform for data that scales SQL understanding across an organization, empowering all data teams to unlock the full potential of their data.
SDF is a multi-dialect SQL compiler, transformation framework, and analytical database engine. It natively compiles SQL dialects, like Snowflake, and connects to their corresponding data warehouses to materialize models.
✨A CLI tool for analyzing queries and DB tables for MySQL.
The Database Toolkit for Python.
SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL.
It provides a full suite of well known enterprise-level persistence patterns, designed for efficient and high-performing database access, adapted into a simple and Pythonic domain language.
Distributed SQL Databases
Fastest serverless distributed SQL database for always available applications.
SQL language server written in Go.
sqls aims to provide advanced intelligence for you to edit sql in your own editor.
Open-source sQL AI Agent. Text2SQL made Easy!
Wren AI is an open-source SQL AI Agent that empowers data, product, and business teams to access insights through AI chat, built-in well designed intuitive UI and UX, integrating seamlessly with tools like Excel and Google Sheets.
Type safe queries using the Rust type system.
The goal of this library is to allow writing relational database queries using familiar Rust syntax. The library should guarantee that a query can not fail if it compiles. This already includes preventing use after free for row ids passed between queries and even database migrations!