llm
An app that brings language models directly to your phone.
PocketPal AI is a pocket-sized AI assistant powered by small language models (SLMs) that run directly on your phone. Designed for both iOS and Android, PocketPal AI lets you interact with various SLMs without the need for an internet connection.
Related contents:
Transparent AI, Rooted in Research, Open to All. The Open Source Deep Researcher Tool. AI-Powered Online Data Information Synthesis Assistant.
CleverBee is a powerful Python-based research assistant agent using Large Language Models (LLMs) like Claude and Gemini, Playwright for web browsing, and Chainlit for an interactive UI. It performs research assistance by browsing the web, extracting content (HTML), cleaning it, and synthesizing findings based on user research topics.
Intelligent Prompt Gateway.
Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
Arch is an intelligent Layer 7 gateway designed to protect, observe, and personalize LLM applications (agents, assistants, co-pilots) with your APIs.
Design to Code. Automated.
Turn days into minutes by bringing AI into your design-to-code workflow. Convert Figma designs into clean code with Visual Copilot.
Llama3.1 learns to Listen. Local real-time voice AI (Formerly llama3-s).
🍓 Ichigo is an open, ongoing research experiment to extend a text-based LLM to have native "listening" ability. Think of it as an open data, open weight, on device Siri.
Multi-agent orchestrator for Claude Code. Track work with convoys; sling to agents.
Related contents:
- Welcome to Gas Town @ Steve Yegge's Medium.
- Gas Town Decoded @ Andrew Lilley Brinker.
- How to think about Gas Town @ Steve Klabnik.
- Agent Psychosis: Are We Going Insane? @ Armin Ronacher's Thoughts and Writings.
- Gas Town’s Agent Patterns, Design Bottlenecks, and Vibecoding at Scale @ Maggie Appleton.
- Move Over Gas Town, Claude Has First-Party Agent Orchestration @ Andrew Lilley Brinker.
⚡️ OpenAI PHP is a supercharged community-maintained PHP API client that allows you to interact with OpenAI API.
OpenAI PHP is a community-maintained PHP API client that allows you to interact with the Open AI API.
Communicate & Survive. When the Grid Goes Down. Offline Knowledge & Survival Platform.
CyberDeck is an offline-first communication and knowledge platform. Transform any device into a decentralized mesh node to chat, share, and learn without internet.
Portable offline knowledge, AI, and mesh communication platform. Run local LLMs, Wikipedia, and decentralized networking without internet.
A dead-simple unix tool for lightweight open-source local agents.
Orla is a unix tool for running lightweight open-source agents. It is easy to add to a script, use with pipes, or build things on top of.
Related contents:
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering.
Prompt engineering is a relatively new discipline for developing and optimizing prompts to efficiently use language models (LMs) for a wide variety of applications and research topics. Prompt engineering skills help to better understand the capabilities and limitations of large language models (LLMs).
I made my AI think harder by making it argue with itself repeatedly. It works stupidly well.
CoRT makes AI models recursively think about their responses, generate alternatives, and pick the best one. It's like giving the AI the ability to doubt itself and try again... and again... and again.
GAIA Logo GAIA: AI Agent Framework for AMD Ryzen AI.
GAIA is AMD's open-source framework for building intelligent AI agents that run 100% locally on AMD Ryzen AI hardware. Keep your data private, eliminate cloud costs, and deploy in air-gapped environments—all with hardware-accelerated performance.
Related contents:
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Lance is a modern columnar data format optimized for machine learning and AI applications. It efficiently handles diverse multimodal data types while providing high-performance querying and versioning capabilities.
Related contents:
MCP is an open protocol that standardizes how applications provide context to LLMs. Think of MCP like a USB-C port for AI applications. Just as USB-C provides a standardized way to connect your devices to various peripherals and accessories, MCP provides a standardized way to connect AI models to different data sources and tools.
Related contents:
- Model Context Protocol (MCP) Course @ Hugging Face.
- Introducing the Model Context Protocol @ Anthropic.
- LLM Agent Assisted Coding @ stafford williams.
- Everyone is talking about MCP @ Adam Silverman's X.
- What is Model Context Protocol (MCP)? How it simplifies AI integrations compared to APIs @ Norah Sakal.
- What is MCP by Anthropic?(Model Context Protocol) @ Toward AI.
- A Deep Dive Into MCP and the Future of AI Tooling @ Andreessen Horowitz.
- What is MCP (Model Context Protocol)? @ daily.dev.
- 230. MCP - It's Hot, But Will It Win? @ Hardcore Software by Steven Sinofsky.
- MCP (Model Context Protocol): Simply explained in 5 minutes @ High Growth Engineer.
- The “S” in MCP Stands for Security @ Elena Cross' Medium.
- Everything Wrong with MCP @ Shrivu's Substack.
- MCPs, Gatekeepers, and the Future of AI @ I Am Charlie Graham.
- A Critical Look at MCP @ Raz Blog.
- MCP vs API @ Glama.
- MCP explained without hype or fluff @ nilenso.
- What are MCP Servers? @ The Fly Blog.
- Block's Playbook for Designing MCP Servers @ Block Engineering Blog.
- MCP is eating the world—and it's here to stay @ Stainless.
- MCP: An (Accidentally) Universal Plugin System @ Works on My Machine.
- MCP is eating the world—and it's here to stay @ Stainless.
- MCP Vulnerabilities Every Developer Should Know @ Composio.
- Your MCP Doesn’t Need 30 Tools: It Needs Code @ Armin Ronacher's Thoughts and Writings.
- The State of MCP Security @ Pynt.
- MCPs Are Just Other People's Prompts Pointing to Other People's Code @ Daniel Miessler.
- you need to learn MCP RIGHT NOW!! (Model Context Protocol) @ NetworkChuck's YouTube.
- Episode #112: A new direction for AI developer tooling @ Changelog & Friends.
- What is special about MCP? @ Jessitron.
- Code execution with MCP: Building more efficient agents @ Engineering @ Anthropic.
- MCP Apps: Extending servers with interactive user interfaces @ mcp blog.
- Model Context Protocol (MCP) Tutorial: Build Your First MCP Server in 6 Steps @ towards data science.
- MCP is dead. Long live the CLI @ Eric Holmes.
The Privacy-First Alternative to Ollama.
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Shimmy is a 5.1MB single-binary that provides 100% OpenAI-compatible endpoints for GGUF models. Point your existing AI tools to Shimmy and they just work — locally, privately, and free.
Fetch an entire site and save it as a text file (to be used with AI models).
Convert email newsletters into RSS feeds.
LetterFeed is a self-hosted application that transforms your email newsletters into RSS feeds.
It periodically scans your email inbox via IMAP for new emails from the senders you've configured. When it finds a new email, it processes it, and adds it as a new entry to the corresponding newsletter's RSS feed.
Hertz-dev is an open-source, first-of-its-kind base model for full-duplex conversational audio.
Use your locally running AI models to assist you in your web browsing.
Page Assist is an open-source browser extension that provides a sidebar and web UI for your local AI model. It allows you to interact with your model from any webpage.
Generate a Markdown Document of Your Codebase Structure and Content.
CodeWeaver is a command-line tool designed to weave your codebase into a single, easy-to-navigate Markdown document. It recursively scans a directory, generating a structured representation of your project's file hierarchy and embedding the content of each file within code blocks. This tool simplifies codebase sharing, documentation, and integration with AI/ML code analysis tools by providing a consolidated and readable Markdown output.
This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API. - openai/openai-realtime-agents
RAG that intelligently adapts to your use case, data, and queries.
Streamlined and promptable Fast GraphRAG framework designed for interpretable, high-precision, agent-driven retrieval workflows.
We are uncovering a new way of building software by embracing AI, iteration, and human intuition.
Execute agentic workflows defined in simple YAML files.
COMandA is a command-line tool that enables the composition of Large Language Model (LLM) operations using a YAML-based Domain Specific Language (DSL). It simplifies the process of creating and managing agentic workflows composed of downloads, files, text, images, documents, multiple providers and multiple models.
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference.
OpenVINO is an open-source toolkit for optimizing and deploying deep learning models from cloud to edge. It accelerates deep learning inference across various use cases, such as generative AI, video, audio, and language with models from popular frameworks like PyTorch, TensorFlow, ONNX, and more. Convert and optimize models, and deploy across a mix of Intel® hardware and environments, on-premises and on-device, in the browser or in the cloud.
Extract structured data from PDFs. Stop wasting time extracting PDFs. Transform your PDF documents into structured data with Documind. Simple, powerful and open-source.
Documind is an advanced document processing tool that leverages AI to extract structured data from PDFs. It is built to handle PDF conversions, extract relevant information, and format results as specified by customizable schemas.
Open-source observability for your LLM application, based on OpenTelemetry.
OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others.
Train your AI self, amplify you, bridge the world.
an open-source prototype where you craft your own AI self—a new AI species that preserves you, delivers your context, and defends your interests.
Related contents:
R1 1776 is a DeepSeek-R1 reasoning model that has been post-trained by Perplexity AI to remove Chinese Communist Party censorship. The model provides unbiased, accurate, and factual information while maintaining high reasoning capabilities.
Related content:
LLM inference in C/C++.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Related contents:
- Everything I've learned so far about running local LLMs @ null program.
- Run large and small language models with llama.cpp (DeepSeek-R1, Phi-4) @ Modal Docs.
- Faire tourner un LLM localement sur votre ordinateur @ Quoi de neuf les devs ? :fr:.
- Optimizing Performance with llama.cpp @ Home Assistant community.
- Grand saut dans le déploiement sur site d'un serveur LLM à moindres privilèges @ Synacktiv :fr:.
- INSTALLER llama.cpp SUR LINUX POUR DE L'IA EN LOCAL (INFÉRENCE) @ Adrien Linuxtricks' YouTube :fr:.
Free AI Gateway for Multi-Provider LLMs.
Never stop coding. Free AI gateway: one endpoint, 231+ providers (50+ free), connect Claude Code, Codex, Cursor, Cline & Copilot to FREE Claude/GPT/Gemini. RTK+Caveman stacked compression saves 15-95% tokens, smart auto-fallback, MCP/A2A, multimodal APIs, Desktop/PWA.
Run AI Generated Code Locally. A secure local sandbox to run LLM-generated code using Apple containers.
CodeRunner is an MCP (Model Context Protocol) server that executes AI-generated code in a sandboxed environment on your Mac using Apple's native containers.
Related contents:
Build a superior context layer for AI agents.
Empower your AI agents through the leading open-source RAG engine, delivering reliable context and an integrated agent platform, built for enterprise.
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Claude Code IDE integration for Emacs.
Claude Code IDE for Emacs provides native integration with Claude Code CLI through the Model Context Protocol (MCP). Unlike simple terminal wrappers, this package creates a bidirectional bridge between Claude and Emacs, enabling Claude to understand and leverage Emacs’ powerful features—from LSP and project management to custom Elisp functions. This transforms Claude into a true Emacs-aware AI assistant that works within your existing workflow and can interact with your entire Emacs ecosystem.
Open Universal Machine Intellingence. E2E Foundation Model Research Platform. Everything you need to build state-of-the-art foundation models, end-to-end.
Oumi is a fully open-source platform that streamlines the entire lifecycle of foundation models - from data preparation and training to evaluation and deployment. Whether you're developing on a laptop, launching large scale experiments on a cluster, or deploying models in production, Oumi provides the tools and workflows you need.
Conversational Data Analysis.
PandasAI is a Python platform that makes it easy to ask questions to your data in natural language. It helps non-technical users to interact with their data in a more natural way, and it helps technical users to save time, and effort when working with data.
PandasAI is a Python library that integrates generative artificial intelligence capabilities into pandas, making dataframes conversational. Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
Related contents:
AI-Powered Mobile App Builder.
Transform your ideas into polished mobile applications with our intuitive mobile app generator. No complex setup required.
AI coding engine for complex tasks. Build complex software with AI.
An open source, terminal-based AI coding engine. Designed for real-world tasks that span many files.
Related contents:
Your LLM bill is leaking.
Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.
Most teams run every call on their most expensive model. Frugon reads your real logs locally and shows which calls a cheaper model handles just as well, and which to leave alone. No upload. No telemetry.
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
Related contents:
Run AI with an API. Run and fine-tune open-source models. Deploy custom models at scale. All with one line of code.
Thousands of models contributed by our community. All the latest open-source models are on Replicate. They’re not just demos — they all actually work and have production-ready APIs.
AI shouldn’t be locked up inside academic papers and demos. Make it real by pushing it to Replicate.
Related contents:
ZML is a production inference stack, purpose-built to decouple AI workloads from proprietary hardware.
Any model, many hardwares, one codebase, peak performance. Compiled directly to NVIDIA, AMD, TPU, Trainium for peak hardware performance on any accelerator. No rewriting.
Related contents:
Aider lets you pair program with LLMs, to edit code in your local git repository. Start a new project or work with an existing git repo. Aider works best with GPT-4o and Claude 3 Opus and can connect to almost any LLM.
Related contents:
Affiche une alerte sur des sites générés tout ou partie par des IA. Liste gérée par Next.ink.
Related contents:
An opinionated Laravel package that extends FakerPHP and uses openai-php/laravel to generate fake data.
A Laravel package that extends FakerPHP by adding an AI-powered data generator using OpenAI. This allows you to generate more realistic and context-aware fake data in your Laravel applications.
Related contents:
Turn ideas into detections your SIEM understands. Generate Sigma, KQL, and SPL rules with tests and playbooks in seconds.
DetectPack Forge turns plain-English behaviors or sample logs into production-ready detection packs — Sigma, KQL (Sentinel), SPL (Splunk) — plus tests and a response playbook, mapped to MITRE ATT&CK, fully powered by Gen AI.
Unlock your LLM's creativity. User-friendly WebUI for LLMs (Formerly Ollama WebUI)
Open WebUI is an extensible, self-hosted interface for AI that adapts to your workflow, all while operating entirely offline.
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our Open WebUI Documentation.
Related contents:
macOS menu bar app that exposes Apple's on-device Foundation Models as an OpenAI-compatible local API. Zero cloud. Zero dependencies.
Related contents:
Render any git repo into a single static HTML page for humans or LLMs.
Tired of clicking around complex file hierarchies of GitHub repos? Do you just want to see all of the code on a single page? Enter rendergit. Flatten any GitHub repository into a single, static HTML page with syntax highlighting, markdown rendering, and a clean sidebar navigation. Perfect for code review, exploration, and an instant Ctrl+F experience.
Fast, lossless LLM inference via dual-view diffusion decoding. Memory-Efficient Parallel Token Generation via Dual-View Diffusion.
Official implementation and model checkpoints for Orthrus, a dual-architecture framework that unifies the exact generation fidelity of autoregressive Large Language Models (LLMs) with the high-speed parallel token generation of diffusion models.
Leading Agentic Workflow Builder.
Dify offers everything you need — agentic workflows, RAG pipelines, integrations, and observability — all in one place, putting AI power into your hands.
Dify is an open-source LLM app development platform. Its intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features (including Opik, Langfuse, and Arize Phoenix) and more, letting you quickly go from prototype to production. Here's a list of the core features:
This is a cleanroom deobfuscation of the official Claude Code npm package.
Related contents:
Open-Source ML Monitoring and LLM Observability.
Open-source evaluation and observability for ML and LLM systems Evaluate, test, and monitor AI-powered systems. From tabular data to LLMs. Built for data scientists, AI, and ML engineers.
Automate and clean your inbox. Clean Up Your Inbox In Minutes.
Bulk unsubscribe from newsletters, automate your emails with AI, block cold emails, and view your analytics. Open-source.
Web Codegen Scorer is a tool for evaluating the quality of web code generated by LLMs.
Write Go, online, with LLMs.
sketch.dev is a new kind of Go playground that lets you write and run Go code in your browser, in a real editor. Build packages and modules, import dependencies, run tests, code with chat, and use a lightweight unix sandbox.
Related contents: