llm
A dead-simple unix tool for lightweight open-source local agents.
Orla is a unix tool for running lightweight open-source agents. It is easy to add to a script, use with pipes, or build things on top of.
Related contents:
A curated catalogue of agentic AI patterns — real‑world tricks, workflows, and mini‑architectures that help autonomous or semi‑autonomous AI agents get useful work done in production.
Related contents:
Multi-agent orchestrator for Claude Code. Track work with convoys; sling to agents.
Related contents:
- Welcome to Gas Town @ Steve Yegge's Medium.
- Gas Town Decoded @ Andrew Lilley Brinker.
- How to think about Gas Town @ Steve Klabnik.
- Agent Psychosis: Are We Going Insane? @ Armin Ronacher's Thoughts and Writings.
- Gas Town’s Agent Patterns, Design Bottlenecks, and Vibecoding at Scale @ Maggie Appleton.
- Move Over Gas Town, Claude Has First-Party Agent Orchestration @ Andrew Lilley Brinker.
shared memory for agents. Get smarter alongside your AI.
Your intelligence shouldn't reset every conversation. Ensue is a persistent knowledge tree that grows with you - what you learn today enriches tomorrow's reasoning.
The World's First LLM-Native Language. the first intermediate language designed for machine authorship.
Reduce logs to their semantic anomalies.
Cordon uses transformer embeddings and density scoring to identify semantically unusual patterns in large log files, reducing massive logs to the most anomalous sections for analysis. Repetitive patterns (even errors) are considered "normal background." Cordon surfaces unusual, rare, or clustered events that stand out semantically from the bulk of the logs.
Related contents:
Layrr is the visual editor for real code. Design visually, edit any stack, own everything. A browser coding agent interface for selecting elements and sending instructions directly to Claude Code.
Open Source Locally Hosted Lovable with Full Stack Support. The Open-Source AI Development Platform Built for Self-Hosting.
AI-powered development environment with advanced agent orchestration - designed for complete data sovereignty and infrastructure control.
Unterminated Block Parsing.
Remend is a lightweight, standalone preprocessor that completes incomplete Markdown syntax.
Related contents:
Production-ready RAG in your infrastructure.
Skald gives you a production-ready RAG in minutes through a plug-and-play API, and then let's you configure your RAG engine exactly to your needs.
Our solid defaults will work for most use cases, but you can tune every part of your RAG to better suit your needs. That means configurable vector search params, reranking, models, query rewriting, chunking (soon), and more.
Related contents:
Metis is an open-source, AI-driven tool for deep security code review.
Metis is an open-source, AI-driven tool for deep security code review, created by Arm's Product Security Team. It helps engineers detect subtle vulnerabilities, improve secure coding practices, and reduce review fatigue. This is especially valuable in large, complex, or legacy codebases where traditional tooling often falls short.
Executable GenAI Prompt Templates.
Dotprompt is an executable prompt template file format for Generative AI. It is designed to be agnostic to programming language and model provider to allow for maximum flexibility in usage. Dotprompt extends the popular Handlebars templating language with GenAI-specific features.
Enforce the habit of self-documenting code through better commit messages.
smartcommit is an intelligent, AI-powered CLI tool that helps you write semantic, Conventional Commits messages effortlessly. It analyzes your staged changes, asks clarifying questions to understand the "why" behind your code, and generates a structured commit message for you.
The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
kit is a production-ready toolkit for codebase mapping, symbol extraction, code search, and building LLM-powered developer tools, agents, and workflows.
kit shines for getting precise, accurate, and relevant context to LLMs. Use kit to build code reviewers, code generators and graphs, even full-fledged coding assistants: all enriched with the right code context.
An open-source SQL-Native memory engine for AI. Open-Source Memory Engine for LLMs, AI Agents & Multi-Agent Systems.
One line of code to give any LLM persistent, queryable memory using standard SQL databases.
Memori enables any LLM to remember conversations, learn from interactions, and maintain context across sessions with a single line: memori.enable(). Memory is stored in standard SQL databases (SQLite, PostgreSQL, MySQL) that you fully own and control.
AI Browser Automation. Automate browser based workflows with AI.
Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows on a large number of websites, replacing brittle or unreliable automation solutions.
Emdash is an orchestration layer for running multiple coding agents in parallel in isolated Git worktrees.
An orchestration layer for running multiple coding agents in parallel, each isolated in its own Git worktree. Run several agent instances concurrently to tackle independent subtasks or experiments.
Emdash lets you develop and test multiple features with multiple agents in parallel. It’s provider-agnostic (we support 10+ CLIs, such as Claude Code and Codex) and runs each agent in its own Git worktree to keep changes clean; when the environment matters, you can run a PR in its own Docker container. Hand off Linear, GitHub, or Jira tickets to an agent, review diffs side-by-side, and keep everything local.
Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs.
Tokenflood is a load testing tool for instruction-tuned LLMs that allows you to run arbitrary load profiles without needing specific prompt and response data. Define desired prompt lengths, prefix lengths, output lengths, and request rates, and tokenflood simulates this workload for you.
🔂 Run Claude Code in a continuous loop, autonomously creating PRs, waiting for checks, and merging
Automated workflow that orchestrates Claude Code in a continuous loop, autonomously creating PRs, waiting for checks, and merging - so multi-step projects complete while you sleep.
Fully automatic censorship removal for language models.
Heretic is a tool that removes censorship (aka "safety alignment") from transformer-based language models without expensive post-training. It combines an advanced implementation of directional ablation, also known as "abliteration" (Arditi et al. 2024), with a TPE-based parameter optimizer powered by Optuna.
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
Enchanted is open source, Ollama compatible, elegant macOS/iOS/visionOS app for working with privately hosted models such as Llama 2, Mistral, Vicuna, Starling and more. It's essentially ChatGPT app UI that connects to your private models. The goal of Enchanted is to deliver a product allowing unfiltered, secure, private and multimodal experience across all of your devices in iOS ecosystem (macOS, iOS, Watch, Vision Pro).
Related contents:
Chat for Ollama, Private AI Chat.
Empowering LLM researchers and hobbyists with seamless control over self-hosted models. Connect remotely, customize prompts, manage chats, and fine-tune configurations. All in one intuitive app.
Related contents:
A desktop app to easily run Large Language Models locally.
CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, OpenRouter, or custom endpoints.
A fast, CLI-based tool to estimate token usage and API cost for prompts targeting various LLM providers (OpenAI, Claude, Mistral, etc.). Built in Rust for performance, portability, and safety.
AI-powered git commit message rewriter using GPT.
Automatically rewrite your entire git commit history with better, conventional commit messages using AI. Perfect for cleaning up messy commit histories before open-sourcing projects or improving repository maintainability.
Ollama Manager App.
Unofficial Ollama manager app for macOS, iOS, iPadOS, and visionOS, featuring server management, model management, and simple chat feature.
Related contents:
Fast, stateless LLM-powered assistant for your shell: qq answers; qa runs commands.
qq means quick question. qa means quick agent. Both are easy to type rapidly on QWERTY keyboards with minimal finger movement. That makes interacting with LLMs faster and more natural during real work.
Web Codegen Scorer is a tool for evaluating the quality of web code generated by LLMs.
JSON for LLM prompts at half the tokens. Spec, benchmarks & TypeScript implementation.
Token-Oriented Object Notation is a compact, human-readable serialization format designed for passing structured data to Large Language Models with significantly reduced token usage. It's intended for LLM input, not output.
TOON's sweet spot is uniform arrays of objects – multiple fields per row, same structure across items. It borrows YAML's indentation-based structure for nested objects and CSV's tabular format for uniform data rows, then optimizes both for token efficiency in LLM contexts. For deeply nested or non-uniform data, JSON may be more efficient.
Related contents:
Large language model made in Europe built to support all official 24 EU languages.
The EuroLLM project includes Instituto Superior Técnico, the University of Edinburgh, Instituto de Telecomunicações, Université Paris-Saclay, Unbabel, Sorbonne University, Naver Labs, and the University of Amsterdam. Together they created EuroLLM-9B, a multilingual AI model supporting all 24 official EU languages. Developed with support from Horizon Europe, the European Research Council, and EuroHPC, this open-source LLM aims to enhance Europe’s digital sovereignty and foster AI innovation. Trained on the MareNostrum 5 supercomputer, EuroLLM outperforms similar-sized models. It is fully open source and available via Hugging Face.
Related contents:
The Web Access Layer for AI Agents.
Connect Your Agent to the Web. Powering the Internet of Agents with fast, secure and reliable web access APIs.
Related contents:
The Intelligence Engine. Turn Natural Language Into Action. The Intelligence Layer for AI agents. Connect your models, tools, and data to create agentic apps that can think, act and talk to you.
An all-in-one toolkit to build agentic applications that turn natural language into real-world actions.
Want to build AI-native apps that respond to natural language? Dexto is the intelligence layer that makes it easy to build agentic apps like AI assistants and copilots. Describe your agents, plug in your tools, and watch them respond to plain English.
Butter is a cache that identifies patterns in LLM responses and saves you money by serving responses directly.
It's also deterministic, allowing your AI systems to consistently repeat past behaviors.
Build Frontier RAG Apps. The open-source RAG platform: built-in citations, deep research, 22+ file formats, partitions, MCP server, and more.
Ground AI agents in your knowledge base, minimize hallucinations, and impress out of the box. Agentset is the open-source platform to build, evaluate, and ship production-ready RAG and agentic applications. It provides end-to-end tooling: ingestion, vector indexing, evaluation/benchmarks, chat playground, hosting, and a clean API with first-class developer experience.
Related contents:
Customizable AI Research & Knowledge Management Assistant. The AI Workspace Built for Teams. Connect any LLM to your internal knowledge sources and chat with it in real time alongside your team.
Open Source Alternative to NotebookLM / Perplexity, connected to external sources such as Search Engines, Slack, Linear, Jira, ClickUp, Confluence, Notion, YouTube, GitHub, Discord and more.
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Lance is a modern columnar data format optimized for machine learning and AI applications. It efficiently handles diverse multimodal data types while providing high-performance querying and versioning capabilities.
Related contents:
Your AI.Your Data. Zero Cloud. Offline ChatGPT alternative: open-source, on-device, and 100% private.
By connecting to Ollama local LLMs, NativeMind delivers the latest AI capabilities right inside your favourite browser — without sending a single byte to cloud servers.
Related contents:
The best ChatGPT that $100 can buy.
This repo is a full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase. nanochat is designed to run on a single 8XH100 node via scripts like speedrun.sh, that run the entire pipeline start to end. This includes tokenization, pretraining, finetuning, evaluation, inference, and web serving over a simple UI so that you can talk to your own LLM just like ChatGPT. nanochat will become the capstone project of the course LLM101n being developed by Eureka Labs.
Related contents:
This course is intended to provide you with a comprehensive step-by-step understanding of how to engineer optimal prompts within Claude.
Artificial Intelligence Infrastructure-as-Code Generator.
aiac is a library and command line tool to generate IaC (Infrastructure as Code) templates, configurations, utilities, queries and more via LLM providers such as OpenAI, Amazon Bedrock and Ollama.
The CLI allows you to ask a model to generate templates for different scenarios (e.g. "get terraform for AWS EC2"). It composes an appropriate request to the selected provider, and stores the resulting code to a file, and/or prints it to standard output.
Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
Give Claude perfect recall - Redis-powered persistent memory for LLM. Give Claude perfect recall with persistent memory that survives context limits and session restarts.
Recall is a brain extension for Claude that stores memories in Redis.
Your AI assistant can now remember important context, decisions, and patterns across all conversations—no more repeating yourself or losing critical information when the context window fills up.
NOVA: The Prompt Pattern Matching. NOVA is a Python-based tool for detecting adversarial prompts - prompt injections, exfiltration, evasion and TTPs.
NOVA is an open-source prompt pattern matching system combining keyword detection, semantic similarity, and LLM-based evaluation to analyze and detect prompt content.
Related contents:
ChatKit is a framework for building high-quality, AI-powered chat experiences. It’s designed for developers who want to add advanced conversational intelligence to their apps fast—with minimal setup and no reinventing the wheel. ChatKit delivers a complete, production-ready chat interface out of the box.
Jules is an experimental coding agent that helps you fix bugs, add documentation, and build new features. It integrates with GitHub, understands your codebase, and works asynchronously — so you can move on while it handles the task.
Related contents:
Claude Code + Obsidian Starter Kit.
Turn your Obsidian vault into an AI-powered second brain using Claude Code.
Related contents:
Symfony AI is a set of components that integrate AI capabilities into PHP applications.
Related contents:
AI-Assisted Authoring Environment for WordPress Blocks.
Related contents:
The AI Toolkit for TypeScript.
From the creators of Next.js, the AI SDK is a free open-source library that gives you the tools you need to build AI-powered products.
Related contents:
Laravel Boost accelerates AI-assisted development by providing the essential context and structure that AI needs to generate high-quality, Laravel-specific code.
Related contents:
💬 Typebot is a powerful chatbot builder that you can self-host.
Hack the bot game: Build faster, Chat smarter.
Typebot is a no-code platform that enables you to effortlessly create and integrate advanced chatbots into websites and chat platforms like WhatsApp.
The Privacy-First Alternative to Ollama.
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Shimmy is a 5.1MB single-binary that provides 100% OpenAI-compatible endpoints for GGUF models. Point your existing AI tools to Shimmy and they just work — locally, privately, and free.
Prism is a powerful Laravel package for integrating Large Language Models (LLMs) into your applications.
Related contents:
Turn ideas into detections your SIEM understands. Generate Sigma, KQL, and SPL rules with tests and playbooks in seconds.
DetectPack Forge turns plain-English behaviors or sample logs into production-ready detection packs — Sigma, KQL (Sentinel), SPL (Splunk) — plus tests and a response playbook, mapped to MITRE ATT&CK, fully powered by Gen AI.
Generate code from the terminal! Supercharge Your AI Coding. Simple. Fast. Powerful. Codebuff works in your terminal.
Codebuff is an open-source AI coding assistant that edits your codebase through natural language instructions. Instead of using one model for everything, it coordinates specialized agents that work together to understand your project and make precise changes.
A sane distributed file system.
9P is a network protocol developed at Bell Labs for the Plan 9 from Bell Labs distributed operating system as the means of accessing and manipulating resources and applications transparently in a distributed environment. 9P works both as a distributed file system and as a network transparent and language agnostic ‘API’.
The Filesystem That Makes S3 your Primary Storage. ZeroFS is 9P/NFS/NBD on top of S3.
ZeroFS makes S3 storage feel like a real filesystem. It provides file-level access via NFS and 9P and block-level access via NBD. Fast enough to compile code on, with clients already built into your OS. No FUSE drivers, no kernel modules, just mount and go.
Background Agents for Claude Code.
Terragon is a developer platform that lets you run AI coding agents in the cloud. Whether you're at your browser, in your terminal, or on your phone, Terragon works wherever you are. Offload coding tasks and come back to pull requests ready to review.
A visualization and walkthrough of the LLM algorithm that backs OpenAI's ChatGPT. Explore the algorithm down to every add & multiply, seeing the whole process in action.
This project displays a 3D model of a working implementation of a GPT-style network. That is, the network topology that's used in OpenAI's GPT-2, GPT-3, (and maybe GPT-4).
A tool to perform transformations on code repositories with AI.
Related contents: