python
LLM Gateway to provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.
Related contents:
- You need more than a vector database @ Redis.
- À la découverte de liteLLM, une plateforme pour les gouverner tous @ Arneo's YouTube :fr:.
- TeamPCP supply chain attack spreads to PyPI @ Reversing Labs.
- How a Poisoned Security Scanner Became the Key to Backdooring LiteLLM @ snyk.
- Building a Kubernetes-native pattern for AI infrastructure at scale @ The New Stack.
- My minute-by-minute response to the LiteLLM malware attack @ futuresearch.
- A popular Python library just became a backdoor to your entire machine @ XDA.
- LLMs on Kubernetes Part 1: Understanding the threat model @ CNCF.
Open Universal Machine Intellingence. E2E Foundation Model Research Platform. Everything you need to build state-of-the-art foundation models, end-to-end.
Oumi is a fully open-source platform that streamlines the entire lifecycle of foundation models - from data preparation and training to evaluation and deployment. Whether you're developing on a laptop, launching large scale experiments on a cluster, or deploying models in production, Oumi provides the tools and workflows you need.
LangGraph is a library for building stateful, multi-actor applications with LLMs, used to create agent and multi-agent workflows.
Related contents:
A faster way to build and share data apps. Streamlit turns data scripts into shareable web apps in minutes. All in pure Python. No front‑end experience required.
Streamlit lets you transform Python scripts into interactive web apps in minutes, instead of weeks. Build dashboards, generate reports, or create chat apps. Once you’ve created an app, you can use our Community Cloud platform to deploy, manage, and share your app.
The Production-Ready Open Source AI Framework.
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Get Infrastructure from Code. Effortless backends with infrastructure from code. Nitric is a multi-language framework for cloud applications with infrastructure from code.
Nitric is a multi-language framework, with concise inline infrastructure from code. Modern applications should be robust, productive and a joy to build. Nitric solves common problems building for modern platforms:
Related contents:
pytube is a lightweight, Pythonic, dependency-free, library (and command-line utility) for downloading YouTube Videos.
An extremely fast Python linter and code formatter, written in Rust.
Related contents:
Explore Agent Recipes
Explore common agent recipes with ready to copy code to improve your LLM applications.
Related contents:
An app for crossposting your posts from bluesky to twitter and mastodon.
An open source Valkey client library that supports Valkey and Redis open source 6.2, 7.0 and 7.2. Valkey GLIDE is designed for reliability, optimized performance, and high-availability, for Valkey and Redis OSS based applications. GLIDE is a multi language client library, written in Rust with programming language bindings, such as Java and Python
Related contents:
🍪 A full-featured, hackable tiling window manager written and configured in Python (X11 + Wayland)
Related contents:
handy cli tool to convert your speech to clipboard text.
This tool is designed to recognize speech in real-time, convert it to text, and automatically copy the text to the system clipboard. The tool leverages API services for speech recognition and uses Python libraries for audio capture and clipboard management.
structured-logprobs is an open-source Python library that enhances OpenAI's structured outputs by providing detailed information about token log probabilities.
This library is designed to offer valuable insights into the reliability of an LLM's structured outputs. It works with OpenAI's Structured Outputs, a feature that ensures the model consistently generates responses adhering to a supplied JSON Schema. This eliminates concerns about missing required keys or hallucinating invalid values.
All-in-One Toolkit for BruteForce Attacks. A Python-based tool to centralize and streamline BruteForce Attacks.
Kraken is a powerful, Python-based tool designed to centralize and streamline various brute-forcing tasks. Kraken provides a suite of tools for cybersecurity professionals to efficiently perform brute-force attacks across a range of protocols and services.
A high-performance, zero-overhead, extensible Python compiler using LLVM.
Codon is a high-performance Python compiler that compiles Python code to native machine code without any runtime overhead. Typical speedups over Python are on the order of 100x or more, on a single thread. Codon supports native multithreading which can lead to speedups many times higher still.
Concurrent Python made simple.
Pyper is a flexible framework for concurrent and parallel data-processing, based on functional programming patterns. Used for 🔀 ETL Systems, ⚙️ Data Microservices, and 🌐 Data Collection
High performance array computing.
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Related contents:
Python3 library for downloading YouTube Videos.
pytubefix is a lightweight, Pythonic, dependency-free, library (and command-line utility) for downloading YouTube Videos.
Related contents:
Python based web automation tool. Powerful and elegant.
DrissionPage is a Python-based web automation tool. It can control the browser, send and receive packets, and combine the two. You can balance the convenience of browser automation with the efficiency of requests. It is powerful, built-in countless user-friendly design and convenient features. Its syntax is simple and elegant, the code is small, and it is friendly to beginners.
A simple, extensible Python client library for Kubernetes that feels familiar for folks who already know how to use kubectl.
A batteries-included Python client library for Kubernetes that feels familiar for folks who already know how to use kubectl
The Microsoft Graph software development kits (SDKs) are designed to simplify building high-quality, efficient, resilient applications that access Microsoft Graph. The SDKs include two components: a service library and a core library.
The service library contains models and request builders generated from Microsoft Graph metadata. The service library provides a rich, strongly-typed, and discoverable experience when working with the many datasets available in Microsoft Graph.
Assess the security of your Active Directory with few or all privileges.
Assess the security of your Active Directory with few or all privileges. This tool offers functionalities similar to PingCastle, ORADAD, or even PurpleKnight (with some bonuses).
Related contents:
🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.
Surfer Protocol is an open-source framework that allows you to export your personal data from various platforms.
Your personal data is siloed across many platforms and apps. Big tech companies have no incentive to give you easy access to your own data. Whether you want to make an AI clone that texts like you, reclaim your data from big tech, or leave a digital legacy, Surfer Protocol is the way to do it.
Currently, Surfer Protocol consists of a Python SDK and a Desktop App. The Desktop App is used for exporting your data from your favorite apps and services. The Python SDK is used for building applications off of your personal data.
Python tool for converting files and office documents to Markdown. MarkItDown is a utility for converting various files to Markdown (e.g., for indexing, text analysis, etc).
Related contents:
PipeGate is a lightweight, self-hosted proxy built with FastAPI, designed as a "poor man's ngrok." It allows you to expose your local servers to the internet, providing a simple way to create tunnels from your local machine to the external world.
Optional Static Typing for Python.
Mypy is an optional static type checker for Python that aims to combine the benefits of dynamic (or "duck") typing and static typing. Mypy combines the expressive power and convenience of Python with a powerful type system and compile-time type checking. Mypy type checks standard Python programs; run them using any Python VM with basically no runtime overhead.
Solve puzzles. Learn CUDA.
GPU architectures are critical to machine learning, and seem to be becoming even more important every day. However, you can be an expert in machine learning without ever touching GPU code. It is hard to gain intuition working through abstractions.
This notebook is an attempt to teach beginner GPU programming in a completely interactive fashion. Instead of providing text with concepts, it throws you right into coding and building GPU kernels. The exercises use NUMBA which directly maps Python code to CUDA kernels. It looks like Python but is basically identical to writing low-level CUDA code. In a few hours, I think you can go from basics to understanding the real algorithms that power 99% of deep learning today. If you do want to read the manual, it is here:
A community-maintained Python framework for creating mathematical animations.
Manim is an animation engine for explanatory math videos.
Agent Framework / shim to use Pydantic with LLMs.
PydanticAI is a Python Agent Framework designed to make it less painful to build production grade applications with Generative AI.
Related contents:
The Database Toolkit for Python.
SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL.
It provides a full suite of well known enterprise-level persistence patterns, designed for efficient and high-performing database access, adapted into a simple and Pythonic domain language.
Robot Framework is an open source automation framework for test automation and robotic process automation (RPA). It is supported by the Robot Framework Foundation and widely used in the industry.
Its human-friendly and versatile syntax uses keywords and supports extending through libraries in Python, Java, and other languages.
It integrates with other tools for comprehensive automation without licensing fees, bolstered by a rich community with hundreds of 3rd party libraries.
autorandr detects the connected display hardware and load the appropriate X11
setup by using xrandr.
It automatically selects a display configuration based on connected devices.
Mopidy is an extensible music server written in Python. It plays music from local disk, Spotify, SoundCloud, TuneIn, … Users can edit the playlist from any phone, tablet, or computer using a variety of MPD and web clients.
- Mopidy @ GitHub.
- Mopidy-MPD (Mopidy-MPD @ GitHub) is a Mopidy extension for controlling playback from MPD clients It's a frontend that provides a full MPD server implementation to make Mopidy available from MPD clients.
Security scanner detecting Python Pickle files performing suspicious actions
🌎💪 BrowserGym, a Gym environment for web task automation.
BrowserGym is meant to provide an open, easy-to-use and extensible framework to accelerate the field of web agent research. It is not meant to be a consumer product. Use with caution!
Fast Music Remover is a lightweight tool designed to remove music, sound effects and noise from internet media. Processing takes about 8% of the original source length -that's under 5 seconds for a minute-long video!
prompt_toolkit is a library for building powerful interactive command line and terminal applications in Python.
It can be a very advanced pure Python replacement for GNU readline, but it can also be used for building full screen applications.
Python datetimes made easy.
Unlike other datetime libraries for Python, Pendulum is a drop-in replacement for the standard datetime class (it inherits from it), so, basically, you can replace all your datetime instances by DateTime instances in your code (exceptions exist for libraries that check the type of the objects by using the type function like sqlite3 or PyMySQL for instance).
QRNet is a state-of-the-art neural network that transforms the Quad-Bayer pattern into sharp and clean RGB images
Lighter web automation with Python.
Helium is a Python library for automating browsers such as Chrome and Firefox.
Automate Creation of YouTube Shorts using MoviePy.
Automate the creation of YouTube Shorts, simply by providing a video topic to talk about.
Open-source framework for building Web Agents. Build and deploy Web Agents in a few lines of code.
This repository contains the code and resources used in the article "Stop Wasting Time, Automate Your Presentation with Python" published on Medium.
Open Source Intelligence Interface for Deep Web Scraping.
Darkdump is a OSINT interface for carrying out deep web investgations written in python in which it allows users to enter a search query in which darkdump provides the ability to scrape .onion sites relating to that query to try to extract emails, metadata, keywords, images, social media etc. Darkdump retrieves sites via Ahmia.fi and scrapes those .onion addresses when connected via the tor network.
Related contents:
Build Reliable Backends 10x Faster, Scale to Millions with 1 Click.
DBOS is a serverless platform for building highly reliable applications. What takes days to build on AWS takes minutes on DBOS.
Related contents:
🍦 Never use print() to debug again.
Do you ever use print() or log() to debug your code? Of course you do. IceCream, or ic for short, makes print debugging a little sweeter.
🛡️ Windows Hello™ style facial authentication for Linux.
Howdy provides Windows Hello™ style authentication for Linux. Use your built-in IR emitters and camera in combination with facial recognition to prove who you are.
Using the central authentication system (PAM), this works everywhere you would otherwise need your password: Login, lock screen, sudo, su, etc.
Related contents:
High-Performance Klong array language in Python.
KlongPy is a Python adaptation of the Klong array language, known for its high-performance vectorized operations that leverage the power of NumPy. Embracing a "batteries included" philosophy, KlongPy combines built-in modules with Python's expansive ecosystem, facilitating rapid application development with Klong's succinct syntax.
The web framework for perfectionists with deadlines.
Django is a high-level Python web framework that encourages rapid development and clean, pragmatic design.
Related contents:
Open-source Headless Browser API.
🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructure.
Simple, unified interface to multiple Generative AI providers.
aisuite makes it easy for developers to use multiple LLM through a standardized interface. Using an interface similar to OpenAI's, aisuite makes it easy to interact with the most popular LLMs and compare the results. It is a thin wrapper around python client libraries, and allows creators to seamlessly swap out and test responses from different LLM providers without changing their code. Today, the library is primarily focussed on chat completions. We will expand it cover more use cases in near future.
Pyxel is a retro game engine for Python.
With simple specifications inspired by retro gaming consoles, such as displaying only 16 colors and supporting 4 sound channels, you can easily enjoy making pixel-art-style games.
Connexion is a modern Python web framework that makes spec-first and api-first development easy. You describe your API in an OpenAPI (or swagger) specification with as much detail as you want and Connexion will guarantee that it works as you specified.
DataFrames for the new era.
Dataframes powered by a multithreaded, vectorized query engine, written in Rust
Polars is a DataFrame interface on top of an OLAP Query Engine implemented in Rust using Apache Arrow Columnar Format as the memory model.
Polars is an open-source library for data manipulation, known for being one of the fastest data processing solutions on a single machine. It features a well-structured, typed API that is both expressive and easy to use.
Related contents:
Lightweight modern Python library to add security headers (CSP, HSTS, etc.) to Django, Flask, FastAPI, and more. Secure defaults or fully customizable.
Seed-Farmer is an orchestration tool that works with AWS CodeSeeder and acts as an orchestration tool modeled after GitOps deployments. It has a CommandLine Interface based in Python, leverages modular code deployments defined by declarative manifests, and includes change detection and deployment optimization.