sql
The lightweight, user-friendly, distributed relational database built on SQLite. Fault tolerance and high availability with zero hassle.
Related contents:
Easily ask questions about your Linux, Windows, and macOS infrastructure.
Related contents:
SQL-like Querying for Various Data Sources.
Musoq lets you use SQL-like queries on files, directories, images and other data sources without a database. It's designed to ease life for developers.
Musoq is a tool that lets developers and IT professionals query different data sources using SQL-like syntax, without needing to import data into a database first. It’s designed for scenarios where you need to analyze files, directories, archives, or other data sources quickly and efficiently.
Data Runs Better on SDF. Transform Data Better with SDF. SDF is the fastest way to build a scalable, reliable, and optimized data warehouse.
SDF is a developer platform for data that scales SQL understanding across an organization, empowering all data teams to unlock the full potential of their data.
SDF is a multi-dialect SQL compiler, transformation framework, and analytical database engine. It natively compiles SQL dialects, like Snowflake, and connects to their corresponding data warehouses to materialize models.
✨A CLI tool for analyzing queries and DB tables for MySQL.
The Database Toolkit for Python.
SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL.
It provides a full suite of well known enterprise-level persistence patterns, designed for efficient and high-performing database access, adapted into a simple and Pythonic domain language.
Distributed SQL Databases
Fastest serverless distributed SQL database for always available applications.
SQL language server written in Go.
sqls aims to provide advanced intelligence for you to edit sql in your own editor.
Open-source sQL AI Agent. Text2SQL made Easy!
Wren AI is an open-source SQL AI Agent that empowers data, product, and business teams to access insights through AI chat, built-in well designed intuitive UI and UX, integrating seamlessly with tools like Excel and Google Sheets.
Type safe queries using the Rust type system.
The goal of this library is to allow writing relational database queries using familiar Rust syntax. The library should guarantee that a query can not fail if it compiles. This already includes preventing use after free for row ids passed between queries and even database migrations!
The open table format for analytic datasets.
Iceberg is a high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time.
Related contents:
- PyIceberg: Current State and Roadmap @ Ju Data Engineering Newsletter.
- The Equality Delete Problem in Apache Iceberg @ Data Engineer Things's Medium.
- How I Saved Millions by Restructuring Iceberg Metadata @ Gautham Gondi's Medium.
- High Throughput Ingestion with Iceberg @ Adobe Tech Blog's Medium.
- Scaling Iceberg Writes with Confidence: A Conflict-Free Distributed Architecture for Fast, Concurrent, Consistent Append-Only Writes @ e6data.
- Postgres Is the Gateway Drug @ Vignesh Ravichandran.
The world's most advanced open source database.
Related contents:
- You Just Need Postgres.
- Postgres Locks Explained.
- What I Wish Someone Told Me About Postgres @ ChallahScript.
- Logical replication in Postgres: Basics @ EDB.
- Database sharding case study: PostgreSQL @ The Polymathic Engineer.
- I Tried Every Open Source Database and Found Only One That is Actually Useful @ Hacker Noon.
- How direct TLS can speed up your connections @ Marc Bowes.
- PostgreSQL pour remplacer Redis @ Rodolphe Bréard :fr:.
- One more reason to choose Postgres over MySQL @ tanin.
- From 99.9% to 99.99%: Building PostgreSQL Resilience into Your Product Architecture @ Stormatics.
- Handling unique indexes on large data in PostgreSQL @ Volodymyr Potiichuk.
- Postgres Internals Deep Dive: Process Architecture @ EDB Postgres.
- PostgreSQL maintenance without superuser @ boringSQL.
- Postgres’ Original Project Goals: The Creators Totally Nailed It @ Chunchy Data.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- PostgreSQL MVCC Explained (Simply!) @ SauravDhakal's Substack.
- Postgres Partitioning Best Practices: Sofia's Story @ Karen Jex.
- Tuning AIO in PostgreSQL 18 @ Tomas Vondra.
- Advanced PostgreSQL Indexing: Multi-Key Queries and Performance Optimization @ Frontend Masters.
- The best worst hack that saved our bacon @ Jefferson Heard.
- Going down the rabbit hole of Postgres 18 features @ xata.
- JIT: so you want to be faster than an interpreter on modern CPUs… @ Pinaraf's website.
- Postgres 18: OLD and NEW Rows in the RETURNING Clause @ crunchy data.
- Benchmarking Postgres 17 vs 18 @ PlanetScale.
- Is Postgres Read Heavy or Write Heavy? (And Why You Should You Care) @ crunchy data.
- Pipelining in psql (PostgreSQL 18) @ PostgreSQL Notes - Daniel Vérité.
- Kafka is fast -- I'll use Postgres @ TopicPartition.
- Redis is fast - I'll cache in Postgres @ Dizzy zone.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Absurd Workflows: Durable Execution With Just Postgres @ Armin Ronacher's Thoughts and Writings.
- Don't give Postgres too much memory @ Tomas Vondra.
- Moving tables across PostgreSQL instances @ Anantha Kumaran.
- Postgres Internals Hiding in Plain Sight @ crunchy data.
- #PostgresMarathon 2-013: Why keep your index set lean @ PostgresAI.
- [99% of Developers Don't Get PostgreSQL @ The Coding Gopher's YouTube](https://www .youtube.com/watch?v=P8rrhZTPEAQ).
- PostgreSQL DBA @ Developer Roadmaps.
- How/Why to Sweep Async Tasks Under a Postgres Table @ taylor.town.
- Instant database clones with PostgreSQL 18 @ boringSQL.
- Go ahead, self-host Postgres @ Pierce Freeman.
- PostgreSQL 18 RETURNING Enhancements: A Game Changer for Modern Applications @ pgEdge.
- The hidden cost of PostgreSQL arrays @ boringSQL.
- Life Altering Postgresql Patterns @ mccue.dev.
- Unconventional PostgreSQL Optimizations @ Haki Benita.
- I Replaced Redis with PostgreSQL (And It's Faster) @ Polliog's dev.to.
- Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems @ Diljit's Corner.
- Introduction to PostgreSQL Indexes @ Dalto Curvelano.
- Introducing: Postgres Best Practices @ supabase.
- Postgres Postmaster does not scale @ recall.ai.
- Futureproofing Tines: Partitioning a 17TB table in PostgreSQL @ tines.
- Database Indexing @ AkashSDas' Medium.
- Scaling PostgreSQL to power 800 million ChatGPT users @ OpenAI.
- Unlocking High-Performance PostgreSQL: Key Memory Optimizations @ Stormatics.
- Six Signs That Postgres Tuning Won't Fix Your Performance Problems @ TigerData.
- PostgreSQL Bloat Is a Feature, Not a Bug @ Roger Welin.
- Read efficiency issues in Postgres queries @ pg mustard.
- The real cost of random I/O @ Tomas Vondra.
- Production query plans without production data @ Boring SQL.
- Rust is slowly but surely eating PostgreSQL: Deep dive into Neon, ParadeDB, PgDog and more @ Sylvain Kerkour.
- How We Optimized Top K in Postgres @ ParadeDB.
- Using Rust and Postgres for everything: patterns learned over the years @ Sylvain Kerkour.
- Ctrl-C in psql gives me the heebie-jeebies @ Neon.
- When upserts don't update but still write: Debugging Postgres performance at scale @ Datadog.
- Introduction to PostgreSQL Indexes @ explain, analyze.
- Keeping a Postgres queue healthy @ PlanetScale.
- I replaced my entire stack with Postgres... @ The Coding Gopher.
- Does Postgres Scale? @ DBOS.
- The "Just Use Postgres" Trap @ CodeOpinion's YouTube.
- How we saved ~40GB of Postgres space wasted on indexes @ Ravi Ojha's peer list.
- Vos requêtes SQL jusqu'à 10000 fois plus rapides, durablement. - Alain LESAGE (DALIBO) @ Devoxx France's YouTube :fr:.
- Handling graphs with SQL/PGQ in PostgreSQL @ Cybertec.
- When failover isn’t safe: Building high-availability PostgreSQL on Kubernetes @ Datadog Engineering.
- The only scalable delete in Postgres is DROP TABLE @ Planetscale.
- The NULL in your NOT IN @ boringSQL.
- The feedback loops behind Kubernetes @ Planetscale.
- Too many tables are bad for you @ Cybertec.
- PostgreSQL and the OOM Killer: Why We Use Strict Memory Overcommit @ ubicloud.
- How to Achieve Pruning When Querying by Non-Partitioned Columns in PostgreSQL @ Haki Benita.
- The four horsemen behind thousands of Postgres outages @ malisper.me.
- PostgreSQL as a temporal database @ xata.
- Repeatable Read vs Snapshot Isolation @ jaymcor.github.io.
type safe SQL for TypeScript/JavaScript. Lightweight RDBMS agnostic TypeScript/JS abstraction for SQLite, PostgreSQL and MySQL.
SQL you know but type safe parameterized, expressive & portable.
litdb contains LINQ-like type-safe SQL builders for TypeScript/JavaScript for writing type-safe expressive SQL that's parameterized & portable across SQLite, MySQL & PostgreSQL.
The Query Builder Component for React.
React Query Builder is a fully customizable query builder component for React, along with a collection of utility functions for importing from, and exporting to, various query languages like SQL, MongoDB, and more.
A consistent code style guide for SQL to ensure legible and maintainable projects.
A web-based tool to easily generate customizable SQLMap commands for testing SQL injection vulnerabilities. Features include target configuration, connection options, detection levels, and various SQL injection techniques. Perfect for penetration testers and security enthusiasts.
Business Intelligence as Code. Build polished data products with SQL. Build fast, interactive data visualizations in pure SQL and markdown.
Evidence is a lightweight framework for building data apps. It's open source and free to get started.
Run SQL queries on CSV files directly in your browser. No data leaves your browser. Fast, private, and easy to use.
A (somewhat opinionated) list of SQL tips and tricks that I've picked up over the years.
There's so much you can you do with SQL but I've focused on what I find most useful in my day-to-day work as a data analyst and what I wish I had known when I first started writing SQL.
Use SQL for everything. Query anything with old-school cool SQL.
Anyquery is a CLI tool to run SQL queries on any data source, no matter if it's a file, an API, logs, or a local app. See the integrations for the full extent of what you can do.
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
Personalized AI SQL Agent. Let Vanna.AI write your SQL for you
The fastest way to get actionable insights from your database just by asking questions.
wrangle data.
sq is a command line tool that provides jq-style access to structured data sources: SQL databases, or document formats like CSV or Excel. It is the lovechild of sql+jq.
Proof of SQL is a high performance zero knowledge (ZK) prover developed by the Space and Time team, which cryptographically guarantees SQL queries were computed accurately against untampered data. It targets online latencies while proving computations over entire chain histories, an order of magnitude faster than state-of-the art zkVMs and coprocessors.
The Cloud Operational Data Store. Use SQL to transform, deliver, and act on fast-changing data.
Materialize is a cloud-native data warehouse purpose-built for operational workloads where an analytical data warehouse would be too slow, and a stream processor would be too complicated.
Using SQL and common tools in the wider data ecosystem, Materialize allows you to build real-time automation, engaging customer experiences, and interactive data products that drive value for your business while reducing the cost of data freshness.
FerretDB allows you to use MongoDB drivers seamlessly with PostgreSQL as the database backend. Use all tools, drivers, UIs, and the same query language and stay open-source.
meilibridge is a robust package designed to seamlessly sync data from both SQL and NoSQL databases to Meilisearch, providing an efficient and unified search solution.
Upon first encountering SQL after two decades of Fortran, C, Java, and Python, I thought I had stumbled into hell. I quickly realized that was optimistic: after all, hell has rules.
I have since realized that SQL does too, and that they are no more confusing or contradictory than those of most other programming languages. They only appear so because it draws on a tradition unfamiliar to those of us raised with derivatives of C. To quote Terry Pratchett, it is not mad, just differently sane.
Welcome, then, to a world in which the strange will become familiar, and the familiar, strange. Welcome, thrice welcome, to SQL.
DataFusion is a very fast, extensible query engine for building high-quality data-centric systems in Rust, using the Apache Arrow in-memory format.
DataFusion is great for building projects such as domain specific query engines, new database platforms and data pipelines, query languages and more. It lets you start quickly from a fully working engine, and then customize those features specific to your use.
Build APIs in 5 minutes. Build NodeJS / GO APIs in 5 minutes not weeks. A GraphQL-to-SQL converting app.
Just write simple GraphQL queries to define the data you need and GraphJin will auto-magically convert them into efficient SQL queries and fetch the data you need.
📊 Cube — The Semantic Layer for Building Data Applications. The Universal Semantic Layer.
Build trust with a semantic layer. Connect siloed data, define consistent metrics, and power AI and analytics with context.
Cube is the semantic layer for building data applications. It helps data engineers and application developers access data from modern data stores, organize it into consistent definitions, and deliver it to every application.
Cube was designed to work with all SQL-enabled data sources, including cloud data warehouses like Snowflake or Google BigQuery, query engines like Presto or Amazon Athena, and application databases like Postgres. Cube has a built-in relational caching engine to provide sub-second latency and high concurrency for API requests.
an open source Distributed SQL Database.
YDB is a versatile open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions. It accommodates transactional (OLTP), analytical (OLAP), and streaming workloads simultaneously.
AdminerEvo is a web-based database management interface, with a focus on security, user experience, performance, functionality and size.
AdminerEvo works out of the box with MySQL, MariaDB, PostgreSQL, SQLite, MS SQL, Oracle, Elasticsearch and MongoDB. In addition, there are plugins for SimpleDB, Firebird and ClickHouse.
Open Source SQL+noSQL Database Client. The Smartest SQL+noSQL Database Client.
Database manager for MySQL, PostgreSQL, SQL Server, MongoDB, SQLite and others. Runs under Windows, Linux, Mac or as web application
BigTesty: integration testing for BigQuery.
BigTesty is a framework that allows to create Integration Tests with BigQuery on a real and short-lived Infrastructure. Integration and End-to-End tests are a robust way to validate if SQL queries work as expected. There is no an emulator in this case and the queries are executed directly in the BigQuery Engine.
Dataherald is a natural language-to-SQL engine built for enterprise-level question answering over relational data. It allows you to set up an API from your database that can answer questions in plain English.
Transform Data in Your Warehouse. Build trusted data products faster.
Accelerate your data transformation process with dbt Cloud and start delivering data that you and your team can rely on. dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. Analysts using dbt can transform their data by simply writing select statements, while dbt handles turning these statements into tables and views in a data warehouse.
Sources:
GQL is a query language with a syntax very similar to SQL with a tiny engine to perform queries on .git files instance of database files, the engine executes the query on the fly without the need to create database files or convert .git files into any other format, note that all Keywords in GQL are case-insensitive similar to SQL.
SQLite is a C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.
Related contents:
SQLite for modern applications.libSQL is a fork of SQLite that is both Open Source, and Open Contributions.
libSQL is an open source, open contribution fork of SQLite, created and maintained by Turso. We aim to evolve it to suit many more use cases than SQLite was originally designed for, and plan to use third-party OSS code wherever it makes sense.
The ultimate multi-model database. Develop easier. Build faster. Scale quicker.
SurrealDB is an end-to-end cloud-native database designed for modern applications, including web, mobile, serverless, Jamstack, backend, and traditional applications. With SurrealDB, you can simplify your database and API infrastructure, reduce development time, and build secure, performant apps quickly and cost-effectively.
jSQL Injection is a Java application for automatic SQL database injection.
Serverless, Fault-Tolerant, Branchable Postgres.
The fully managed multi-cloud Postgres with a generous free tier. We separated storage and compute to offer autoscaling, branching, and bottomless storage.
Contribute to krishnaik06/The-Grand-Complete-Data-Science-Materials development by creating an account on GitHub.
Your Data Pipeline, Simplified. GlareDB: An analytics DBMS for distributed data.
Data exists everywhere: your laptop, Postgres, Snowflake and as files in S3. It exists in various formats such as Parquet, CSV and JSON. Regardless, there will always be multiple steps spanning several destinations to get the insights you need.
GlareDB is designed to query your data wherever it lives using SQL that you already know.
Dolt is Git for data. The world's first and only version-controlled SQL database.
Dolt is a SQL database that you can fork, clone, branch, merge, push and pull just like a Git repository.
Connect to Dolt just like any MySQL database to read or modify schema and data. Version control functionality is exposed in SQL via system tables, functions, and procedures.
Related contents:
CLI tool that can execute SQL queries on CSV, LTSV, JSON and TBLN. Can output to various formats.
Defog's SQLCoder is a state-of-the-art LLM for converting natural language questions to SQL queries.
Graph Database CLI based on PostgreSQL psql.
AgeSQL is a command-line interface (CLI) client for PostgreSQL that extends its capabilities to support Cypher queries along with traditional SQL. This tool leverages the Age extension for PostgreSQL, which enables graph queries within the database.
The aim of AgeSQL is to create a CLI tool that operates similarly to the existing PostgreSQL CLI (psql) and provides complete functionality for working with graph databases. In addition, AgeSQL wraps Cypher commands to simplify their usage within PostgreSQL.
A High Performance Open Source MySQL Proxy.
ProxySQL is an open source high performance, high availability, database protocol aware proxy for MySQL
SQLite Developer Experience in an Edge Database.
Turso is an edge-hosted, distributed database based on libSQL, an open-source and open-contribution fork of SQLite. It was designed to minimize query latency for applications where queries come from anywhere in the world. In particular, it works well with edge functions provided by cloud platforms such as CloudFlare, Netlify, and Vercel, by putting your data geographically close to the code that accesses it.
Related contents:
TypeScript ORM that feels like writing SQL.
Drizzle ORM is a TypeScript ORM for SQL databases designed with maximum type safety in mind. It comes with a drizzle-kit CLI companion for automatic SQL migrations generation. Drizzle ORM is meant to be a library, not a framework. It stays as an opt-in solution all the time at any levels. The ORM's main philosophy is "If you know SQL, you know Drizzle ORM". We follow the SQL-like syntax whenever possible, are strongly typed ground up, and fail at compile time, not in runtime.
A database modeling tool for creating Entity Relationship Diagrams, Relational Schemas, Star Schemas, and SQL DDL statements.
dbt™ is a SQL-first transformation workflow that lets teams quickly and collaboratively deploy analytics code following software engineering best practices like modularity, portability, CI/CD, and documentation. Now anyone on the data team can safely contribute to production-grade data pipelines.
Fast SQL for time-series
QuestDB is an open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity. It supports schema-agnostic ingestion using the InfluxDB line protocol, PostgreSQL wire protocol, and a REST API for bulk imports and exports.
Open-source low-code web application framework. Create full websites writing only simple database queries.
SQLpage is an SQL-only webapp builder. It is meant for data scientists, analysts, and business intelligence teams to build powerful data-centric applications quickly, without worrying about any of the traditional web programming languages and concepts.
With SQLPage, you write simple .sql files containing queries to your database to select, group, update, insert, and delete your data, and you get good-looking clean webpages displaying your data as text, lists, grids, plots, and forms.
Get MySQL EXPLAIN plans that are understandable for humans.
MySQL Query optimization with the EXPLAIN command is unnecessarily complicated: The output contains a lot of cryptic information that is incomprehensible or entirely misleading.
This Laravel package collects many query metrics that will be sent to explainmysql.com and transformed to be much easier to understand.
You no longer have to search for cryptic or incomprehensible information from MySQL query plans. All EXPLAIN outputs are transformed into data that is easier to grasp.