llm
BAML is an expressive language for structured text generation. BAML is a domain-specific language to write and test LLM functions.
In BAML, prompts are treated like functions. An LLM function is a prompt template with some defined input variables, and a specific output type like a class, enum, union, optional string, etc.
With BAML you can write and test a complex LLM function in 1/10 of the time it takes to setup a python LLM testing environment.
Claude Engineer is an advanced interactive command-line interface (CLI) that harnesses the power of Anthropic's Claude 3 and Claude 3.5 models to assist with a wide range of software development tasks. This tool seamlessly combines the capabilities of state-of-the-art large language models with practical file system operations, web search functionality, intelligent code analysis, and execution capabilities.
The open source AI code editor.
Void is an open source Cursor alternative. Write code with the best AI tools, retain full control over your data, and access powerful AI features.
v0 is a generative user interface system by Vercel powered by AI. It generates copy-and-paste friendly React code based on shadcn/ui and Tailwind CSS that people can use in their projects.
Free AI Code Completion.
The fastest copilot. Supermaven lets you write code 2x faster with AI.
Related contents:
Local & OnPremise AI. Run LLMs offline. Tap into your private knowledge base. Interact with your documents using the power of GPT, 100% privately, no data leaks
PrivateGPT is a production-ready AI project that allows you to ask questions about your documents using the power of Large Language Models (LLMs), even in scenarios without an Internet connection. 100% private, no data leaves your execution environment at any point.
ell is a lightweight prompt engineering library treating prompts as functions.
Text-To-Speech, RAG, and LLMs. All local!
Dot is a standalone, open-source application designed for seamless interaction with documents and files using local LLMs and Retrieval Augmented Generation (RAG). It is inspired by solutions like Nvidia's Chat with RTX, providing a user-friendly interface for those without a programming background. Using the Phi-3 LLM by default, Dot ensures accessibility and simplicity right out of the box.
Turn websites into LLM-ready data.
Power your AI apps with clean data crawled from any website. It's also open-source. 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Related contents:
Related contents:
AI coding engine for complex tasks. Build complex software with AI.
An open source, terminal-based AI coding engine. Designed for real-world tasks that span many files.
Related contents:
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.
Design to Code. Automated.
Turn days into minutes by bringing AI into your design-to-code workflow. Convert Figma designs into clean code with Visual Copilot.
The GraphRAG project is a data pipeline and transformation suite that is designed to extract meaningful, structured data from unstructured text using the power of LLMs.
GraphRAG is a structured, hierarchical approach to Retrieval Augmented Generation (RAG), as opposed to naive semantic-search approaches using plain text snippets. The GraphRAG process involves extracting a knowledge graph out of raw text, building a community hierarchy, generating summaries for these communities, and then leveraging these structures when perform RAG-based tasks.
A new community-based approach to build truly open-source LLMs.
InstructLab Command-Line Interface. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.
Dioptra is a software test platform for assessing the trustworthy characteristics of artificial intelligence (AI). Trustworthy AI is: valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair - with harmful bias managed1. Dioptra supports the Measure function of the NIST AI Risk Management Framework by providing functionality to assess, analyze, and track identified AI risks.
Your AI-Powered Excalibur in Cloud. X bootstrap 1000+ tools and your scripts.
Lightweight POSIX script for managing tools (500+) and providing classic command extensions in an open-source environment.
Retrieval Augmented Generation (RAG) chatbot powered by Weaviate.
Welcome to Verba: The Golden RAGtriever, an open-source application designed to offer an end-to-end, streamlined, and user-friendly interface for Retrieval-Augmented Generation (RAG) out of the box. In just a few easy steps, explore your datasets and extract insights with ease, either locally with HuggingFace and Ollama or through LLM providers such as OpenAI, Cohere, and Google.
Command Line Utilities With The Power of AI.
Experience the power of Command AI: your AI-powered command line companion that makes complex tasks simple and intuitive.
Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI.
Perplexica is an open-source AI-powered searching tool or an AI-powered search engine that goes deep into the internet to find answers. Inspired by Perplexity AI, it's an open-source option that not just searches the web but understands your questions. It uses advanced machine learning algorithms like similarity searching and embeddings to refine results and provides clear answers with sources cited.
say is always on, recording and transcribing your voice 24/7. Whenever inspiration strikes, just say it.
Write code, not tests.
Contextually Aware AI-Driven Unit Test Generation for Typescript Node.js projects. Celp generates contextually relevant unit tests for Typescript node.js projects, saving you hours.
Benchmark Throughput Performance with running local large language models (LLMs) via ollama.
Fast and secure translation on your local machine, powered by marian and Bergamot.
Open source chatbot that can be personalized using a markdown file.
Unlock your LLM's creativity. User-friendly WebUI for LLMs (Formerly Ollama WebUI)
Open WebUI is an extensible, self-hosted interface for AI that adapts to your workflow, all while operating entirely offline.
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our Open WebUI Documentation.
Related contents:
Coalition for Content Provenance and Authenticity.
An open technical standard providing publishers, creators, and consumers the ability to trace the origin of different types of media.
Related contents:
An Automatic News Aggregator with LLM.
A personal news aggregator to pull information from multi-sources + LLM (ChatGPT via LangChain) to help us reading efficiently with less noises, the sources including: Tweets, RSS, YouTube, Web Articles, Reddit, and personal Journal notes.
Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika aims to be a competitive open-source alternative to Devin by Cognition AI.
Aider lets you pair program with LLMs, to edit code in your local git repository. Start a new project or work with an existing git repo. Aider works best with GPT-4o and Claude 3 Opus and can connect to almost any LLM.
Related contents:
Open source no-code business automation · Zapier open source alternative.
Your friendliest open source all-in-one automation tool ✨ Workflow automation tool 100+ integration / Enterprise automation tool / Zapier, n8n, ifttt Alternative
Backend ressources for Albert. Albert, also known as LIA (Legal Information Assistant), is a conversational agent that uses official French data sources to answer administrative agents questions.
Refer and Ground Anything Anywhere at Any Granularity.
An End-to-End MLLM that Accept Any-Form Referring and Ground Anything in Response.
Distribute and run LLMs with a single file.
Our goal is to make open LLMs much more accessible to both developers and end users. We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation.
Related contents:
Rethink the Computer. Turn your computer into an AI machine.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Related contents:
La plateforme d'IA qui simplifie l'analyse des données à tous les métiers. Piloter aujourd'hui. Anticiper demain. Dès maintenant.
MIA est une solution No Code d’analyse de données, basée sur l’Intelligence Artificielle, qui s'adapte à votre profil. Simple. Efficace. Rapide
A toolkit for controllable, private AI on consumer hardware in rust.
Floneum is a graph editor that makes it easy to develop your own AI workflows. Floneum allows you to build workflows that use large language models with a simple drag and drop interface.
Opensource, self-hosted AI coding assistant.
Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot.
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs.
Vigil is a Python library and REST API for assessing Large Language Model prompts and responses against a set of scanners to detect prompt injections, jailbreaks, and other potential risks.
Open-source Solution for AI Quality. The testing framework dedicated to ML models, from tabular to LLMs Scan AI models to detect risks of biases, performance issues and errors. In 4 lines of code.
Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
Ship AI features in minutes. Pezzo enables you to build, test, monitor and instantly ship AI all in one platform, while constantly optimizing for cost and performance.
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
A Multilingual Code Generation Tool.
We introduce CodeGeeX, a large-scale multilingual code generation model with 13 billion parameters, pre-trained on a large code corpus of more than 20 programming languages. As of June 22, 2022, CodeGeeX has been trained on more than 850 billion tokens on a cluster of 1,536 Ascend 910 AI Processors.
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
txtai is an all-in-one embeddings database for semantic search, LLM orchestration and language model workflows.
automatically tests prompt injection attacks on ChatGPT instances.
Prompt injection is a type of security vulnerability that can be exploited to control the behavior of a ChatGPT instance. By injecting malicious prompts into the system, an attacker can force the ChatGPT instance to do unintended actions.
Automatic Generation of Visualizations and Infographics with LLMs.
LIDA is a library for generating data visualizations and data-faithful infographics. LIDA is grammar agnostic (will work with any programming language and visualization libraries e.g. matplotlib, seaborn, altair, d3 etc) and works with multiple large language model providers (OpenAI, PaLM, Cohere, Huggingface). Details on the components of LIDA are described in the paper here and in this tutorial notebook. See the project page here for updates!.
Defog's SQLCoder is a state-of-the-art LLM for converting natural language questions to SQL queries.
Your Guide to Communicating with Artificial Intelligence.
Learn how to use ChatGPT and other AI tools to accomplish your goals using our free and open source curriculum, designed for all skill levels!
Get up and running with large language models, locally. Run Llama 2 and other models on macOS. Customize and create your own.
Operating LLMs in production.
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.
Unlike other APIs, it doesn't rely on proprietary providers such as Google or Azure to perform translations. Instead, its translation engine is powered by the open source Argos Translate library.
Milvus is an open-source vector database built to power embedding similarity search and AI applications. Milvus makes unstructured data search more accessible, and provides a consistent user experience regardless of the deployment environment.
Related contents:
Run open-source LLMs on your computer. Works offline. Zero configuration.
Falcon LLM is a foundational large language model (LLM) with 40 billion parameters trained on one trillion tokens. TII has now released Falcon LLM – a 40B model.
The RedPajama-Data repository contains code for preparing large datasets for training large language models. RedPajama-Data: An Open Source Recipe to Reproduce LLaMA training dataset.
Stability AI Language Models.
This repository contains Stability AI's ongoing development of the StableLM series of language models and will be continuously updated with new checkpoints. The following provides an overview of all currently available models. More coming soon.
An open source conversational AI framework. DeepPavlov makes it easy for beginners and experts to create dialogue systems.
Related contents: