AI tools for AI Engineers

Azure AI Foundry, now branded Microsoft Foundry, is Microsoft's enterprise platform for building, grounding and governing AI applications and agents.

AutoGen is an open-source framework from Microsoft for building AI agents and multi-agent applications.

Agno is an agent platform that runs in your own cloud and covers the full lifecycle of building, serving and managing AI agents.

FastGPT is an open-source platform for building AI agents and knowledge-base applications.

Helicone is an AI gateway and LLM observability platform that routes, debugs and analyzes requests from AI applications.

Beam is a cloud runtime for AI workloads that offers serverless GPUs, task queues and sandboxes through a Python, TypeScript and Go SDK.

Arize Phoenix is an open-source platform for AI observability and evaluation, built by Arize.

The OpenAI Agents SDK is a Python package for building agentic applications with very few abstractions.

IBM watsonx is a portfolio of enterprise AI products that covers building models and applications, preparing governed data, running AI assistants and agents, and managing AI risk.

Zilliz Cloud is a fully managed vector database service from the creators of Milvus, now described as a Vector Lakebase.

Tavily is a real-time search and web access API for AI agents.

Jina Reader converts a web page into clean, LLM-friendly Markdown.

Omnara is an open-source platform that gives developers one API to deploy and run agents for their users and team.

Amazon Bedrock AgentCore is an AWS service for building, connecting and running AI agents in production.

Reducto is an agentic document platform that converts complex files into clean, structured data for AI applications.

Cerebras Inference is a cloud API for running large language models at very high speed on the Cerebras Wafer-Scale Engine.

Runware is AI infrastructure that gives developers one API for hundreds of thousands of models, along with the compute to run them.

CoreWeave is a cloud built specifically for AI workloads, offering GPU and CPU compute, storage, networking, managed services and bare metal servers on NVIDIA hardware.

Brave Search API gives developers programmatic access to Brave's independent web index, which covers 40+ billion pages and receives 100+ million page updates a day.

AIMLAPI is an AI model gateway that exposes more than 1000 models through one API.

Semantic Kernel is a lightweight, open-source development kit from Microsoft for building AI agents and adding AI models to existing C#, Python or Java codebases.

Cerebras builds wafer-scale AI chips and runs a cloud service that serves models at extremely high token speeds.

Chroma is open-source search infrastructure for AI, released under Apache 2.0.

Amazon Bedrock is a managed AWS service for building generative AI applications and agents.