Cloudir LLM Ops tracks and controls costs for AI agent deployments by monitoring API spending in real time and automatically routing requests to cheaper models when possible
AI tools for DevOps Engineers
3,775 live tools · ranked by monthly traffic and community votes · dead links removed automatically
Datadog is a cloud-scale observability and security service that brings infrastructure metrics, application traces, logs, security signals and user experience data into one place.
Bits Investigation is an always-on AI SRE agent from Datadog that investigates alerts the moment they fire.
Windmill is an open-source, code-first orchestration platform for internal software.
incident.io is a software reliability platform that handles on-call, incident response, investigations and status pages in one product.
FireHydrant is an incident management system that brings alerting, on-call scheduling, runbooks, status pages and retrospectives into one place.
Cheap GPUs on demand
Scale AI effortlessly
A backend developer needs to spin up a new API service for a mobile app
Over 5,000 users run confidential compute workloads here
Application crashes and performance issues cost companies real users — 53% of consumers abandon apps after encountering freezes or errors
LiteLLM is an open-source AI gateway and LLM proxy that puts more than 140 providers and 1,800 models behind one OpenAI-compatible API key.
Cerebrium is a serverless GPU platform for running AI workloads in production.
Factory is an agent-native software development platform built around autonomous coding agents called Droids.
Portkey puts a single API in front of more than 1,600 language models and wraps it with the controls a production AI team needs.
Qwen Code is an open-source AI coding agent that lives in the terminal and also runs in editors, a desktop app, a Web UI and chat apps.
Beam is a cloud runtime for AI workloads that offers serverless GPUs, task queues and sandboxes through a Python, TypeScript and Go SDK.
Vercel is a cloud platform for deploying web applications and AI agents.
Amazon Bedrock AgentCore is an AWS service for building, connecting and running AI agents in production.
Omnara is an open-source platform that gives developers one API to deploy and run agents for their users and team.
Ellipsis is a managed cloud platform for running coding agents.
Run AI code without infrastructure
Production AI infrastructure
Models to production fast