llm
The glamourous AI coding agent for your favourite terminal 💘
Your new coding bestie, now available in your favourite terminal. Your tools, your code, and your workflows, wired into your LLM of choice.
Related contents:
An open-source AI agent that brings the power of Grok directly into your terminal. A conversational AI CLI tool powered by Grok with intelligent text editor capabilities and tool usage.
Convert email newsletters into RSS feeds.
LetterFeed is a self-hosted application that transforms your email newsletters into RSS feeds.
It periodically scans your email inbox via IMAP for new emails from the senders you've configured. When it finds a new email, it processes it, and adds it as a new entry to the corresponding newsletter's RSS feed.
Enter a YouTube URL to get an AI-generated summary.
⚡ A lightweight, self-hosted YouTube video summarizer with Gemini AI
Rapidly build AI apps in Python.
Create web apps without the complexity of frontend development. Used at Google for rapid AI app development.
Mesop is a Python-based UI framework that allows you to rapidly build web apps like demos and internal apps.
Agents.md Guide for OpenAI Codex
Learn how to use Agents.md files to enhance OpenAI Codex and other AI agents in navigating your codebases, running tests, and adhering to your project's standard practices.
Related contents:
Communicate with an LLM provider using a single interface.
any-llm is a Python library providing a single interface to different llm providers.
Build Agents that Never Hallucinate. Deploy the most accurate RAG in the world in two lines of code.
The most accurate document search and store for building AI apps.
Related contents:
AI-Powered Web Scraping & Data Enrichment. AI-powered web search with instant results and follow-up questions.
🔥 Blazing-fast AI search engine with real-time citations, streaming responses, and live data powered by Firecrawl
Related contents:
Chainlit is an open-source Python package to build production ready Conversational AI.
Related contents:
React Native plugin for Apple Intelligence and Foundation Models.
A React Native plugin to access Apple Intelligence Foundation Models using native on-device LLM APIs. This module lets you check model availability, create sessions, generate structured outputs (JSON), and text using Apple's LLMs, all from React Native.
Orchestrate AI Coding Agents. Kanban board to manage your AI coding agents.
AI coding agents are increasingly writing the world's code and human engineers now spend the majority of their time planning, reviewing, and orchestrating tasks. Vibe Kanban streamlines this process.
Related contents:
A simple prompt playground to test and share your prompt templates.
A tool for testing, debugging, and refining AI prompts. Supports variables, templates to improve prompt quality and speed up development.
AI Powered Email, Built to Save You Time Zero is an AI-native email client that manages your inbox, so you don't have to.
Zero is an open-source AI email solution that gives users the power to self-host their own email app while also integrating external services like Gmail and other email providers. Our goal is to modernize and improve emails through AI agents to truly modernize emails.
Reflect the web through AI.
Automatically rewrites the websites into markdown optimised for viewing in the terminal. Read intro blog post here This is a proof-of-concept, bugs are to be expected but feel free to raise an issue or pull request.
Related contents:
Use AI to transform your messy commit history into clean, logical commits that reviewers will love.
Git Smart Squash uses AI to automatically organize your changes into logical, well-structured commits in seconds.
Related contents:
Generate realistic datasets for demos, learning, and dashboards. Instantly preview data, export as CSV or SQL, and explore with Metabase.
This is a tool for routing Claude Code requests to different models, and you can customize any request.
Use Claude Code as the foundation for coding infrastructure, allowing you to decide how to interact with the model while enjoying updates from Anthropic.
Open source real-time translation app for Android that runs locally.
RTranslator is an (almost) open-source, free, and offline real-time translation app for Android.
Connect to someone who has the app, connect Bluetooth headphones, put the phone in your pocket and you can have a conversation as if the other person spoke your language.
AI-powered Postgres Client. cursor for data ⚡️ - explore your postgresql db in seconds.
Standardized Serverless ML Inference Platform on Kubernetes. Highly scalable and standards based Model Inference Platform on Kubernetes for Trusted AI.
KServe provides a Kubernetes Custom Resource Definition for serving predictive and generative machine learning (ML) models. It aims to solve production model serving use cases by providing high abstraction interfaces for Tensorflow, XGBoost, ScikitLearn, PyTorch, Huggingface Transformer/LLM models using standardized data plane protocols.
Related contents:
A browser automation SDK built for developers and LLMs.
Most existing browser automation tools either require you to write low-level code in a framework like Selenium, Playwright, or Puppeteer, or use high-level agents that can be unpredictable in production. By letting developers choose what to write in code vs. natural language, Stagehand is the natural choice for browser automations in production.
An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.
Genkit is an open-source framework for building full-stack AI-powered applications, built and used in production by Google's Firebase. It provides SDKs for multiple programming languages with varying levels of stability
open-source LLM infrastructure.
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.
The AI Shell. AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models.
A comprehensive coding agent that integrates AI capabilities with your development environment.
Open Source, Distributed, Big Data Enterprise Search Engine.
Datafari is an open source enterprise search solution enriched with AI. It is the perfect product for anyone who needs to search and analyze its corporate data and documents, both within the content and the metadata. Plus, with its genAI modules, it allows to easily leverage mistral, openai, or local LLMs for your company data.
Core building blocks for AI apps. High-quality, accessible, and customizable components for AI interfaces.
Build chat experiences, AI agents, autonomous assistants, and more, quickly and beautifully.
A tool that adds small enhancements to Claude Code.
- Reduced interruptions: Auto-handles permission dialogs based on configurable rules
- Flexible control: Rulesets define which actions to allow automatically
- Tool management: Toolsets configure which tools Claude can use
- Enhanced visibility: System notifications keep you informed
🐝 AI-powered browser assistant ("Cline for web browsing").
The fast, Pythonic way to build MCP servers and clients.
The Model Context Protocol (MCP) is a new, standardized way to provide context and tools to your LLMs, and FastMCP makes building MCP servers and clients simple and intuitive. Create tools, expose resources, define prompts, and more with clean, Pythonic code.
Related contents:
Automated AI localization for web & mobile apps.
AI localization for teams who ship fast. Translate apps, websites, and entire databases using the best LLM models.
KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
CLI for running large numbers of coding agents in parallel with git worktrees
Related contents:
Manage multiple AI agents like Claude Code, Aider, Codex, and Amp. 10x your productivity.
Related contents:
A lightweight, zero-overhead implementation of the Model Context Protocol (MCP) server in pure Bash.
Why? Most MCP servers are just API wrappers with schema conversion. This implementation provides a zero-overhead alternative to Node.js, Python, or other heavy runtimes.
Run MCPs without the complexity ⚡️
OneMCP is an app that lets you run any MCP without the complexity of downloading repos, reading docs, or setting up servers.
Related contents:
A CLI utility and Python library for interacting with Large Language Models.
A CLI tool and Python library for interacting with OpenAI, Anthropic’s Claude, Google’s Gemini, Meta’s Llama and dozens of other Large Language Models, both via remote APIs and with models that can be installed and run on your own machine.
Related contents:
- Large Language Models can run tools in your terminal with LLM 0.26 @ Simon Willison’s Weblog.
- Using AI Without Leaving the Terminal: A Guide to llm @ Ashwin's Blog.
- Evaluating LLMs for my personal use case @ Graham King.
- Kimi K3, and what we can still learn from the pelican benchmark @ Simon Willison’s Weblog.
Video-Based AI Memory 🧠📹.
Video-based AI memory library. Store millions of text chunks in MP4 files with lightning-fast semantic search. No database needed.
Memvid revolutionizes AI memory management by encoding text data into videos, enabling lightning-fast semantic search across millions of text chunks with sub-second retrieval times. Unlike traditional vector databases that consume massive amounts of RAM and storage, Memvid compresses your knowledge base into compact video files while maintaining instant access to any piece of information.
🛡️ PII Guard is an LLM-powered tool that detects and manages Personally Identifiable Information (PII) in logs — designed to support data privacy and GDPR compliance
AI for Large Codebases
The first AI-native code platform that gives large projects compiler-grade context, so LLMs stay useful even when your repo spans millions of lines.
Brokk (the Norse god of the forge) is the first code assistant that understands code semantically, not just as chunks of text. Brokk is designed to allow LLMs to work effectively on large codebases that cannot be jammed entirely into working context.
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations.
KTransformers, pronounced as Quick Transformers, is designed to enhance your 🤗 Transformers experience with advanced kernel optimizations and placement/parallelism strategies.
KTransformers is a flexible, Python-centric framework designed with extensibility at its core. By implementing and injecting an optimized module with a single line of code, users gain access to a Transformers-compatible interface, RESTful APIs compliant with OpenAI and Ollama, and even a simplified ChatGPT-like web UI.
Semantic unit testing is a testing approach that evaluates whether a function's implementation aligns with its documented behavior. The code is analyzed using LLMs to assess whether the implementation matches the expected behavior described in the docstring.
Related contents:
On-device LLM execution in React Native with Vercel AI SDK compatibility.
Run LLMs on-device in React Native via MLC LLM Engine with compatibility for Vercel AI SDK.
Artificial Neural Engine Machine Learning Library.
ANEMLL (pronounced like "animal") is an open-source project focused on accelerating the porting of Large Language Models (LLMs) to tensor processors, starting with the Apple Neural Engine (ANE).
The PM for your AI agent. An AI-powered task-management system you can drop into Cursor, Lovable, Windsurf, Roo, and others.
Taskmaster is your AI's personal project manager. Organize, research, expand, prioritize, and ship tasks effortlessly. Enjoy permanent context, zero drift & instant clarity. It's free, open-source & API-friendly. Let's vibe productively.
free AI coding. Non-agentic 100% free & open source coding tool for AI-assisted programming.
Copy folders and files for chatbots or initialize them hands-free! Use built-in API Tools for code completions, file refactoring and applying chat responses.
I made my AI think harder by making it argue with itself repeatedly. It works stupidly well.
CoRT makes AI models recursively think about their responses, generate alternatives, and pick the best one. It's like giving the AI the ability to doubt itself and try again... and again... and again.
Transparent AI, Rooted in Research, Open to All. The Open Source Deep Researcher Tool. AI-Powered Online Data Information Synthesis Assistant.
CleverBee is a powerful Python-based research assistant agent using Large Language Models (LLMs) like Claude and Gemini, Playwright for web browsing, and Chainlit for an interactive UI. It performs research assistance by browsing the web, extracting content (HTML), cleaning it, and synthesizing findings based on user research topics.
A self-contained, lightweight and OOB research platform for modern ML.
Boson is a lightweight, fully containerized, and feature-rich machine learning research platform. It centralizes essential tools to help teams keep projects lean, organized, and reproducible—while reducing overhead and boosting productivity. Think Databricks/Sagemaker but local and free.
Boson enables engineers and researchers to iterate faster without getting bogged down by infrastructure or tooling complexity.
Open-Source Browser Agent for autonomously performing complex tasks on the web
AI-powered multi-agent builder. Let AI build multi-agent systems for you Build with Agents SDK. Connect MCP tools. Open-source.
AI Autonomous Coding Agent for VS Code.
Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.
Related contents:
Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.
Open Codex is a fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models like phi-4-mini.
Containerized versions of hundreds of MCP servers 📡 🧠
While experimenting with Model Context Protocol (MCP) servers, we found that setting them up could be a bit tedious and time-consuming. To simplify the process, we created containerized versions of these servers—making it quick, easy, and secure for anyone to get started.
Your agentic CLI developer.
Sidekick is an agentic CLI-based AI tool inspired by Claude Code, Copilot, Windsurf and Cursor. It's meant to be an open source alternative to these tools, providing a similar experience but with the flexibility of using different LLM providers while keeping the agentic workflow.
Exmeralda helps you ask questions about Elixir libraries and get accurate, version-specific answers. Powered by Retrieval-Augmented Generation (RAG), it combines the latest AI with real documentation to deliver helpful, grounded responses.
A 100-line minimalist LLM framework for Agents, Task Decomposition, RAG, etc.
Related contents: