devops
OpenNext takes the Next.js build output and converts it into packages that can be deployed across a variety of environments. Natively OpenNext has support for AWS Lambda, and classic Node.js Server.
Related contents:
Runtime type-checking for Ruby. Enums, properties, generics, structured objects. Type-check object properties at runtime.
A multi-vault secret injection tool for safely injecting secrets into app environment.
Whispr (Pronounced as whisper) is a CLI tool to safely inject secrets from your favorite secret vault (Ex: AWS Secrets Manager, Azure Key Vault etc.) into your app's environment. This is very useful for enabling secure local software development.
ElectricEye is a multi-cloud, multi-SaaS Python CLI tool for Asset Management, Security Posture Management & Attack Surface Monitoring supporting 100s of services and evaluations to harden your CSP & SaaS environments with controls mapped to over 20 industry, regulatory, and best practice controls frameworks
A command-line tool to get valuable information out of AWS CloudTrail and a general purpose toolbox for working with IAM policies
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources.
Cloud Custodian enables you to manage your cloud resources by filtering, tagging, and then applying actions to them. The YAML DSL allows defininition of rules to enable well-managed cloud infrastructure that's both secure and cost optimized.
Cloud Custodian, also known as c7n, is a rules engine for managing public cloud accounts and resources. It allows users to define policies to enable a well managed cloud infrastructure, that's both secure and cost optimized. It consolidates many of the adhoc scripts organizations have into a lightweight and flexible tool, with unified metrics and reporting.
Publish packages as git tags.
- 🔧 Works with projects with build steps.
- 👯 Works with projects with multiple packages (monorepos).
- 🏎 Lightweight git tags (only the files needed are included).
Continuous Deployment & Delivery Software for DevOps teams. Deploy your software to multi-cloud, hybrid, and on-premises environments with ease.
Make your complex deployments simple, reliable, and auditable with Octopus Deploy.
Related contents:
- Introducing Config as Code for Runbooks @ Octopus Deploy Blog.
- Introducing the Octopus Datadog integration @ Octopus Deploy Blog.
- Launching the Octopus MCP Server @ Octopus Deploy.
- Octopus and Elastic with OpenTelemetry @ Octopus Deploy.
- Hidden Gems in Octopus Deploy: Resources You Might Have Missed @ Octopus Deploy.
- GitOps with Octopus and Argo CD @ Octopus Deploy.
📦🚀 Fully automated version management and package publishing.
semantic-release automates the whole package release workflow including: determining the next version number, generating the release notes, and publishing the package.
A blazingly fast, single-file, and open-source server for your application with type-safe restful APIs, auth, admin dashboard, and more.
Open-source developer platform and workflow engine. Turn scripts into auto-generated UIs, APIs and cron jobs. Compose them as workflows or data pipelines. Build complex, data-intensive apps with ease.
Write and deploy software 10x faster, and run it with the highest reliability and observability on the fastest self-hostable job orchestrator.
Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.
Easy to use reverse proxy with docker integration.
A lightweight, easy-to-use, and performant reverse proxy with a Web UI and dashboard.
A curated list of Docker Compose samples.
These samples provide a starting point for how to integrate different services using a Compose file and to manage their deployment with Docker Compose.
Meson® is a project to create the best possible next-generation build system.
Meson is an open source build system meant to be both extremely fast, and, even more importantly, as user friendly as possible.
The main design point of Meson is that every moment a developer spends writing or debugging build definitions is a second wasted. So is every second spent waiting for the build system to actually start compiling code.
A crowdsourced, open-source gallery for high-quality dev docs.
Stop wrestling with code dependencies. Use Codependence! 🤼♀️
Codependence is a JavaScript utility for checking dependencies to ensure they're up-to-date or match a specified version.
🚀 FTL is a powerful deployment tool that simplifies the process of setting up servers and deploying applications.
FTL (Faster Than Light) is a powerful deployment tool designed specifically for developers who want to deploy their applications to popular cloud providers like Hetzner, DigitalOcean, Linode, or even Raspberry Pi and other servers but aren't sure where to start. FTL simplifies the process of setting up servers and deploying applications, making deployment easy and reliable, even for those who aren't experts in server management or advanced deployment techniques.
Sample Go app repo with test and release pipelines optimized for software supply chain security (S3C).
Template Go app repo with local test/lint/build/vulnerability check workflow, and on tag image test/build/release pipelines, with ko generative SBOM, cosign attestation, and SLSA build provenance
kubernetes log viewer.
Kubernetes tail. Streams logs from all containers of all matched pods. Match pods by service, replicaset, deployment, and others. Adjusts to a changing cluster - pods are added and removed from logging as they fall in or out of the selection.
data plane testing utility of cloud native.
kdoctor is a Kubernetes data plane testing component that conducts functional and performance tests on clusters using proactive pressure injection. It addresses the operational needs of network, storage, and applications by adopting a cloud-native approach based on extensive research and abstraction. With its CRD design, kdoctor can seamlessly integrate with observability components.
Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
Related contents:
CLI to spin your CI/CD for react-native!
The problem we noticed is that setting up CI is performed once, needs to be researched every time, and is often trial and error driven. The process is repetitive.
We created a tool that bootstraps CI with the most used features, which are ready for customization in the future. Running npx setup-ci generates GitHub workflows for the most popular CI tasks.
Octoscan is a static vulnerability scanner for GitHub action workflows.
A flexible detection platform that simplifies rule management and deployment with K8s CronJob and Helm. Venator is flexible enough to run standalone or with other job schedulers like Nomad.
Venator is optimized for Kubernetes deployment but is flexible enough to run standalone or with other job schedulers like Nomad. It provides a highly adaptable detection engine that prioritizes simplicity, extensibility, and ease of maintenance. Supporting multiple query engines and publishers, Venator allows you to easily switch between different data lakes or services with minimal changes, avoiding vendor lock-in and dependence on specific SIEM solutions for signal generation.
PHP Extension installer
Pickle is a new PHP extension installer. It is based on Composer and the plan is to get Composer to fully support it.
Comprehensive Open Source Security and SBOM Management. Secure Your Products From Repo to Release.
Stop vulnerabilities, automate compliance, and mitigate third-party risk in your applications.
Escalator is a batch or job optimized horizontal autoscaler for Kubernetes.
It is designed for large batch or job based workloads that cannot be force-drained and moved when the cluster needs to scale down - Escalator will ensure pods have been completed on nodes before terminating them. It is also optimized for scaling up the cluster as fast as possible to ensure pods are not left in a pending state.
Giving Kubernetes Superpowers to everyone.
k8sgpt is a tool for scanning your Kubernetes clusters, diagnosing, and triaging issues in simple English. It has SRE experience codified into its analyzers and helps to pull out the most relevant information to enrich it with AI.
Related contents:
Kubernetes Event-driven Autoscaling.
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
Related contents:
Kubernetes Live Cluster Linter. A Kubernetes cluster resource sanitizer.
Popeye is a utility that scans live Kubernetes clusters and reports potential issues with deployed resources and configurations. As Kubernetes landscapes grows, it is becoming a challenge for a human to track the slew of manifests and policies that orchestrate a cluster. Popeye scans your cluster based on what’s deployed and not what’s sitting on disk. By linting your cluster, it detects misconfigurations, stale resources and assists you to ensure that best practices are in place, thus preventing future headaches. It aims at reducing the cognitive overload one faces when operating a Kubernetes cluster in the wild. Furthermore, if your cluster employs a metric-server, it reports potential resources over/under allocations and attempts to warn you should your cluster run out of capacity.
Load testing designed for DevOps and CI/CD.
Gatling is a highly capable load testing tool. It is designed for ease of use, maintainability and high performance.
Out of the box, Gatling comes with excellent support of the HTTP protocol that makes it a tool of choice for load testing any HTTP server. As the core engine is actually protocol agnostic, it is perfectly possible to implement support for other protocols. For example, Gatling currently also ships JMS support.
Colmena is a simple, stateless NixOS deployment tool modeled after NixOps and morph, written in Rust. It's a thin wrapper over Nix commands like nix-instantiate and nix-copy-closure, and supports parallel deployment.
A lightweight, multi-host, daemonless mini-pass that supports deploying kubernetes manifests.
Low resource, no daemon, kubernetes manifest compatible mini-paas.
Command Line S3 Client and S3 Backup for Windows, Linux: s3cmd, s3express.
S3cmd is a free command line tool and client for uploading, retrieving and managing data in Amazon S3 and other cloud storage service providers that use the S3 protocol, such as Google Cloud Storage or DreamHost DreamObjects. It is best suited for power users who are familiar with command line programs. It is also ideal for batch scripts and automated backup to S3, triggered from cron, etc.
OPEN SOURCE ORCHESTRATION AND CORRELATION TOOL. ASOC, ASPM, DevSecOps, Vulnerability Management Using ArcherySec.
Automate Your Application Security Orchestration And Correlation (ASOC) Using ArcherySec.
ArcherySec allow to interact with continuous integration/continuous delivery (CI/CD) toolchains to specify testing, and control the release of a given build based on results. Its include prioritization functions, enabling you to focus on the most critical vulnerabilities. ArcherySec uses popular open source tools to perform comprehensive scanning for web application and network. The developers can also utilize the tool for implementation of their DevOps CI/CD environment.
The deployment tool for PHP.
The PHP deployment tool with support for popular frameworks out of the box.
validate the structure of your container images.
The Container Structure Tests provide a powerful framework to validate the structure of a container image. These tests can be used to check the output of commands in an image, as well as verify metadata and contents of the filesystem.
Related contents:
OpenTelemetry command-line tool for sending events from shell scripts & similar environments.
otel-cli is a command-line tool for sending OpenTelemetry traces. It is written in Go and intended to be used in shell scripts and other places where the best option available for sending spans is executing another program.
Automated Self-Hosted Dev Environments.
🪄 Spin up ready-to-code, disposable dev environments on your own servers. Self-hosted alternative to Gitpod and Github Codespaces.
Repack docker images to optimize for pulling speed.
This tool repacks a Docker image into a smaller, more efficient version that makes it significantly faster to pull. It does this by using a few different techniques such as removing redundant data and improving compression ratios.
1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
Fast, Advanced Systems Engineering, Automation, APIs, shorter CLIs, etc.
The software that empowers network professionals.
Build, Design and Test your network in a risk-free virtual environment and access the largest networking community to help. Whether you are studying for your first networking exam or building out a state-wide telecommunications network, GNS3 offers an easy way to design and build networks of any size without the need for hardware. And the best part is it's free!
Runme runs Markdown. DevOps Notebooks Built with Markdown.
Runme is a tool that makes runbooks actually runnable, making it easier to follow step-by-step instructions. Shell/bash, Python, Ruby, Javascript/Typescript, Lua, PHP, Perl, and many other runtimes are supported via Runme's shebang feature. Runme allows users to execute instructions, check intermediate results, and ensure the desired outputs are achieved. This makes it an excellent solution for runbooks, playbooks, and documentation that requires users to complete runnable steps incrementally—making operational docs reliable and much less susceptible to bitrot.
KWOK stands for Kubernetes WithOut Kubelet.
KWOK is a toolkit that enables setting up a cluster of thousands of Nodes in seconds. Under the scene, all Nodes are simulated to behave like real ones, so the overall approach employs a pretty low resource footprint that you can easily play around on your laptop.
Convert your Docker Compose file to Kubernetes or OpenShift.
Kompose is a conversion tool for Docker Compose to container orchestrators such as Kubernetes (or OpenShift).
Related contents:
🦎 a tool to build and deploy software on many servers 🦎
Related contents:
- Terraform Provider for Komodo @ GitHub.
- Komodo is a Free, OpenSource Docker Manager with Inbuilt CI/CD - Check It Out! @ Jim's Garage.
- How To: Automate version updates for your self-hosted Docker containers with Gitea, Renovate, and Komodo @ nickcunningh.am.
- Using Komodo to Run Docker Commands from a Web Interface @ Noted.
- FerretDB Was Eating My CPU: Migrating Komodo from SQLite to Postgres @ mauveRANT.
- Renovate + Komodo - Updating at Scale in a Large Homelab @ FoxxMD Blog.
Like Prometheus, but for logs.
Grafana Loki is a set of open source components that can be composed into a fully featured logging stack. A small index and highly compressed chunks simplifies the operation and significantly lowers the cost of Loki.
Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.
Fully managed DevOps platform to deploy your code and open-source software
No more DevOps. Deploy on any cloud or on-premise. Scalable & Secure. CI/CD Pipelines.
A tiny but valid init for containers. Tini is the simplest init you could think of.
All Tini does is spawn a single child (Tini is meant to be run in a container), and wait for it to exit all the while reaping zombies and performing signal forwarding.
Continuous (Preview) Releases for your libraries!
With pkg.pr.new, each of your commits and pull requests will trigger an instant preview release without publishing anything to NPM. This enables users to access features and bug-fixes without the need to wait for release cycles using npm or pull request merges.
concurrent, cache-efficient, and Dockerfile-agnostic builder toolkit.
BuildKit is a toolkit for converting source code to build artifacts in an efficient, expressive and repeatable manner.
Related contents:
Docker CLI plugin for extended build capabilities with BuildKit
You can use this tool to generate a valid Permissions Policy HTTP Header, which can be provided by your web server / web application in order to improve the security of your visitors and the data they may be accessing on your site.
Kubernetes Operator to automate Helm, DaemonSet, StatefulSet & Deployment updates.
Keel is a tool for automating Kubernetes deployment updates. Keel is stateless, robust and lightweight.
View 5 weeks of DevSecOps Series' Articles on DEV Community
a new set of GitLab Cheatsheet. This speaks about GitLab CI and basics of stages and jobs.
Container Management and Kubernetes on the Desktop.
An open-source application that provides all the essentials to work with containers and Kubernetes on the desktop. Rancher Desktop is an open-source project that brings Kubernetes and container management to the desktop. It runs on Windows, macOS and Linux.
with learning resources.
This is a step-by-step guide on how to become a DevOps engineer, with links to relevant learning resources.