llm
Explore Agent Recipes
Explore common agent recipes with ready to copy code to improve your LLM applications.
Related contents:
This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API. - openai/openai-realtime-agents
Open-source document processing platform built for knowledge workers.
Rowfill helps extract, analyze, and process data from complex documents, images, PDFs and more with advanced AI capabilities.
structured-logprobs is an open-source Python library that enhances OpenAI's structured outputs by providing detailed information about token log probabilities.
This library is designed to offer valuable insights into the reliability of an LLM's structured outputs. It works with OpenAI's Structured Outputs, a feature that ensures the model consistently generates responses adhering to a supplied JSON Schema. This eliminates concerns about missing required keys or hallucinating invalid values.
Automate and clean your inbox. Clean Up Your Inbox In Minutes.
Bulk unsubscribe from newsletters, automate your emails with AI, block cold emails, and view your analytics. Open-source.
Everything to Markdown.
E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M offers an all-in-one, flexible, and open-source solution.
Open weights LLM for French, English, German, Spanish and Italian.
Related contents:
LLM génératifs ouverts et performants.
Le Consortium OpenLLM France réunit 17 acteurs qui se sont rassemblés dans le prolongement de la création de la communauté OpenLLM France qui fédère à ce jour un écosystème de près de 200 entités (laboratoires publics de recherche, fournisseurs potentiels de données, acteurs technologiques spécialisés, fournisseurs de cas d'usage...). Ces acteurs échangent de manière publique et transparente depuis le début de l’été 2023 sur le serveur Discord de la communauté.
A unified interface for LLMs. Better prices, better uptime, no subscription.
Related contents:
🐢 Open-Source Evaluation & Testing for AI & LLM systems.
The testing framework dedicated to ML models, from tabular to LLMs. Control risks of performance, bias and security issues in AI systems.
Fetch an entire site and save it as a text file (to be used with AI models).
LLM Agent and Evaluation Framework for Autonomous Penetration Testing.
We introduce HackSynth, a novel Large Language Model (LLM)-based agent capable of autonomous penetration testing. HackSynth's dual-module architecture includes a Planner and a Summarizer, which enable it to generate commands and process feedback iteratively. To benchmark HackSynth, we propose two new Capture The Flag (CTF)-based benchmark sets utilizing the popular platforms PicoCTF and OverTheWire. These benchmarks include two hundred challenges across diverse domains and difficulties, providing a standardized framework for evaluating LLM-based penetration testing agents.
Le numéro de confiance pour vérifier les faits.
Un seul numéro (gratuit) pour contrer la désinformation et apaiser le débat public.
MCP is an open protocol that standardizes how applications provide context to LLMs. Think of MCP like a USB-C port for AI applications. Just as USB-C provides a standardized way to connect your devices to various peripherals and accessories, MCP provides a standardized way to connect AI models to different data sources and tools.
Related contents:
- Model Context Protocol (MCP) Course @ Hugging Face.
- Introducing the Model Context Protocol @ Anthropic.
- LLM Agent Assisted Coding @ stafford williams.
- Everyone is talking about MCP @ Adam Silverman's X.
- What is Model Context Protocol (MCP)? How it simplifies AI integrations compared to APIs @ Norah Sakal.
- What is MCP by Anthropic?(Model Context Protocol) @ Toward AI.
- A Deep Dive Into MCP and the Future of AI Tooling @ Andreessen Horowitz.
- What is MCP (Model Context Protocol)? @ daily.dev.
- 230. MCP - It's Hot, But Will It Win? @ Hardcore Software by Steven Sinofsky.
- MCP (Model Context Protocol): Simply explained in 5 minutes @ High Growth Engineer.
- The “S” in MCP Stands for Security @ Elena Cross' Medium.
- Everything Wrong with MCP @ Shrivu's Substack.
- MCPs, Gatekeepers, and the Future of AI @ I Am Charlie Graham.
- A Critical Look at MCP @ Raz Blog.
- MCP vs API @ Glama.
- MCP explained without hype or fluff @ nilenso.
- What are MCP Servers? @ The Fly Blog.
- Block's Playbook for Designing MCP Servers @ Block Engineering Blog.
- MCP is eating the world—and it's here to stay @ Stainless.
- MCP: An (Accidentally) Universal Plugin System @ Works on My Machine.
- MCP is eating the world—and it's here to stay @ Stainless.
- MCP Vulnerabilities Every Developer Should Know @ Composio.
- Your MCP Doesn’t Need 30 Tools: It Needs Code @ Armin Ronacher's Thoughts and Writings.
- The State of MCP Security @ Pynt.
- MCPs Are Just Other People's Prompts Pointing to Other People's Code @ Daniel Miessler.
- you need to learn MCP RIGHT NOW!! (Model Context Protocol) @ NetworkChuck's YouTube.
- Episode #112: A new direction for AI developer tooling @ Changelog & Friends.
- What is special about MCP? @ Jessitron.
- Code execution with MCP: Building more efficient agents @ Engineering @ Anthropic.
- MCP Apps: Extending servers with interactive user interfaces @ mcp blog.
- Model Context Protocol (MCP) Tutorial: Build Your First MCP Server in 6 Steps @ towards data science.
- MCP is dead. Long live the CLI @ Eric Holmes.
Opensource, self-hosted AI coding assistant. Secure, flexible, and transparent AI coding.
Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot.
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI.
paperless-gpt seamlessly pairs with paperless-ngx to generate AI-powered document titles and tags, saving you hours of manual sorting. While other tools may offer AI chat features, paperless-gpt stands out by supercharging OCR with LLMs—ensuring high accuracy, even with tricky scans. If you’re craving next-level text extraction and effortless document organization, this is your solution.
Open-Source, Free, and AI-Powered News in Short.
Your open-source, AI-powered news companion that redefines how you consume news. Get bite-sized summaries from trusted sources worldwide, personalized to your interests. Stay informed without the overwhelm.
An automated document analyzer for Paperless-ngx using OpenAI API and Ollama (Mistral, llama, phi 3, gemma 2) to automatically analyze and tag your documents.
It features: Automode, Manual Mode, Ollama and OpenAI, a Chat function to query your documents with AI, a modern and intuitive Webinterface.
Storyteller is a self-hosted platform for creating and reading ebooks with synced narration. It's made of three components: the API server, the web interface, and the mobile apps. Together, these components allow you to take audiobooks and ebooks that you already own and automatically synchronize them, as well as read or listen to (or both!) the resulting synced books.
Related contents:
Built to keep you in flow state
The first agentic IDE, and then some. The Windsurf Editor is where the work of developers and AI truly flow together, allowing for a coding experience that feels like literal magic.
Open-Source LLM-Friendly Web Crawler & Scraper.
Crawl4AI delivers blazing-fast, AI-ready web crawling tailored for large language models, AI agents, and data pipelines. Fully open source, flexible, and built for real-time performance, Crawl4AI empowers developers with unmatched speed, precision, and deployment ease.
Your AI Second Brain. Ask anything, understand documents, create new content.
Khoj is a personal AI app to extend your capabilities. It smoothly scales up from an on-device personal AI to a cloud-scale enterprise AI.
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
Related contents:
Open-Source Data Movement for LLMs. AI Platform. Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes.
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
AI Code Generator.
An open source Claude Artifacts – generate small apps with one prompt. Powered by Llama 3 405B & Together.ai.
Simple frontend for LLMs built in react-native.
ChatterUI is a native mobile frontend for LLMs.
Run LLMs on device or connect to various commercial or open source APIs. ChatterUI aims to provide a mobile-friendly interface with fine-grained control over chat structuring.
Related contents:
A course on neural networks that starts all the way at the basics. The course is a series of YouTube videos where we code and train neural networks together. The Jupyter notebooks we build in the videos are then captured here inside the lectures directory. Every lecture also has a set of exercises included in the video description. (This may grow into something more respectable).
MMAudio generates synchronized audio given video and/or text inputs.
Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis.
Related contents:
API Parrot is the tool specifically designed to reverse engineer the HTTP APIs of any website. Making life easier for developers looking to automate, integrate or scrape websites without public APIs.
Power Your AI with Live Data.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A web browser for AI agents & applications. An AI web browsing framework focused on simplicity and extensibility.
Python tool for converting files and office documents to Markdown. MarkItDown is a utility for converting various files to Markdown (e.g., for indexing, text analysis, etc).
Related contents:
Convert Anything into Structured Actionable Data.
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks.
OmniParse is a platform that ingests and parses any unstructured data into structured, actionable data optimized for GenAI (LLM) applications. Whether you are working with documents, tables, images, videos, audio files, or web pages, OmniParse prepares your data to be clean, structured, and ready for AI applications such as RAG, fine-tuning, and more
Your AI Meeting Copilot (Early Preview)
Take the hassle out of meetings with Amurex, the ultimate Chrome extension that transforms how you manage and stay productive during meetings.
Amurex is your simple yet powerful AI meeting assistant that seamlessly integrates into your workflow. Built with cutting-edge AI, Amurex ensures you never miss a detail, always stay on top of action items, and make every meeting more productive.
Prompt, run, edit, and deploy full-stack web applications using any LLM you want!
bolt.diy allows you to choose the LLM that you use for each prompt! Currently, you can use OpenAI, Anthropic, Ollama, OpenRouter, Gemini, LMStudio, Mistral, xAI, HuggingFace, DeepSeek, or Groq models - and it is easily extended to use any other model supported by the Vercel AI SDK! See the instructions below for running this locally and extending it to include more models.
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference.
OpenVINO is an open-source toolkit for optimizing and deploying deep learning models from cloud to edge. It accelerates deep learning inference across various use cases, such as generative AI, video, audio, and language with models from popular frameworks like PyTorch, TensorFlow, ONNX, and more. Convert and optimize models, and deploy across a mix of Intel® hardware and environments, on-premises and on-device, in the browser or in the cloud.
Low code LLM Apps Builder. Build LLM Apps Easily.
Open source low-code tool for developers to build customized LLM orchestration flow & AI agents.
Related contents:
Agent Framework / shim to use Pydantic with LLMs.
PydanticAI is a Python Agent Framework designed to make it less painful to build production grade applications with Generative AI.
Related contents:
Your Terminal Assistant.
BashSenpai is a command-line tool that utilizes the power of ChatGPT, bringing it straight to your terminal. You can ask questions and receive insightful responses related to shell scripting, making it an indispensable asset for both beginners and seasoned users alike.
Turn websites into LLM - ready data.
DataFuel API scrapes entire websites and knowledge bases in a single query. Get clean, markdown-structured web data instantly for your RAG systems and AI models. No complex scraping code needed.
A smarter web fuzzing tool that combines local LLM models and ffuf to optimize directory and file discovery.
This tool enhances traditional web fuzzing by using local AI language models (via Ollama) to generate intelligent guesses for potential paths and filenames.
A research project to add some brrrrrr to Burp.
"burpference" started as a research idea of offensive agent capabilities and is a fun take on Burp Suite and running inference. The extension is open-source and designed to capture in-scope HTTP requests and responses from Burp's proxy history and ship them to a remote LLM API in JSON format. It's designed with a flexible approach where you can configure custom system prompts, store API keys and select remote hosts from numerous model providers as well as the ability for you to create your own API configuration. The idea is for an LLM to act as an agent in an offensive web application engagement to leverage your skills and surface findings and lingering vulnerabilities. By being able to create your own configuration and model provider allows you to also host models locally via Ollama to prevent potential high inference costs and potential network delays or rate limits.
Open-source framework for building Web Agents. Build and deploy Web Agents in a few lines of code.
Open-source sQL AI Agent. Text2SQL made Easy!
Wren AI is an open-source SQL AI Agent that empowers data, product, and business teams to access insights through AI chat, built-in well designed intuitive UI and UX, integrating seamlessly with tools like Excel and Google Sheets.
A set of Otoroshi plugins to interact with LLMs.
Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API.
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
Collection of awesome LLM apps with RAG using OpenAI, Anthropic, Gemini and opensource models.
A curated collection of awesome LLM apps built with RAG and AI agents. This repository features LLM apps that use models from OpenAI, Anthropic, Google, and even open-source models like LLaMA that you can run locally on your computer.
Online AlignmenT for LLMs.
Oat 🌾 is a simple yet efficient system for running online LLM alignment algorithms.
ClearerVoice-Studio is an open-source, AI-powered speech processing toolkit designed for researchers, developers, and end-users. It provides capabilities of speech enhancement, speech separation, target speaker extraction, and more. The toolkit provides state-of-the-art pre-trained models, along with training and inference scripts, all accessible from this repository.
The Powerful Multi-modal LLM Family for OCR-free Document Understanding. Modularized Multimodal Large Language Model for Document Understanding.
AI Model Comparison.
See and compare every AI model easily. 100% free & open-source.
Take Control of Your Learning. Privately.
A powerful open-source, AI-powered note-taking/research platform that respects your privacy. An Open Source implementation of Notebook LM with more flexibility and features.
Related contents:
A Completely Modular LLM Reverse Engineering, Red Teaming, and Vulnerability Research Framework.
Prompt optimization scratch. Promptim is an experimental prompt optimization library to help you systematically improve your AI systems.
Promptim automates the process of improving prompts on specific tasks. You provide initial prompt, a dataset, and custom evaluators (and optional human feedback), and promptim runs an optimization loop to produce a refined prompt that aims to outperform the original.
Related contents:
Execute agentic workflows defined in simple YAML files.
COMandA is a command-line tool that enables the composition of Large Language Model (LLM) operations using a YAML-based Domain Specific Language (DSL). It simplifies the process of creating and managing agentic workflows composed of downloads, files, text, images, documents, multiple providers and multiple models.
Laravel x LLMs. A unified interface for working with LLMs in Laravel.
Prism is a powerful Laravel package for integrating Large Language Models (LLMs) into your applications.
Open-source Headless Browser API.
🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructure.
AI agent for building React Native apps.
Cali is an AI agent that helps you build React Native apps. It takes all the utilities and functions of a React Native CLI and exposes them as tools to an LLM.
Thanks to that, an LLM can help you with your React Native app development, without the need to remember commands, spending time troubleshooting errors, and in the future, much more.
Simple, unified interface to multiple Generative AI providers.
aisuite makes it easy for developers to use multiple LLM through a standardized interface. Using an interface similar to OpenAI's, aisuite makes it easy to interact with the most popular LLMs and compare the results. It is a thin wrapper around python client libraries, and allows creators to seamlessly swap out and test responses from different LLM providers without changing their code. Today, the library is primarily focussed on chat completions. We will expand it cover more use cases in near future.
A natural language interface for computers.
Open Interpreter lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing.