AI tools for Machine Learning Engineers

Agno is an agent platform that runs in your own cloud and covers the full lifecycle of building, serving and managing AI agents.

llama.cpp is an open-source inference engine that runs large language models and vision-language models on local hardware or in the cloud with minimal setup.

Helicone is an AI gateway and LLM observability platform that routes, debugs and analyzes requests from AI applications.

Tavily is a real-time search and web access API for AI agents.

Zilliz Cloud is a fully managed vector database service from the creators of Milvus, now described as a Vector Lakebase.

The OpenAI Agents SDK is a Python package for building agentic applications with very few abstractions.

Amazon Bedrock AgentCore is an AWS service for building, connecting and running AI agents in production.

Jina Reader converts a web page into clean, LLM-friendly Markdown.

Brave Search API gives developers programmatic access to Brave's independent web index, which covers 40+ billion pages and receives 100+ million page updates a day.

Runware is AI infrastructure that gives developers one API for hundreds of thousands of models, along with the compute to run them.

Reducto is an agentic document platform that converts complex files into clean, structured data for AI applications.

Cerebras Inference is a cloud API for running large language models at very high speed on the Cerebras Wafer-Scale Engine.

EarthOne is a fully hosted geospatial machine learning platform from EarthDaily Analytics, the company that absorbed Descartes Labs.

Cerebras builds wafer-scale AI chips and runs a cloud service that serves models at extremely high token speeds.

Chroma is open-source search infrastructure for AI, released under Apache 2.0.

SambaNova Cloud is an inference service where developers call open-source models through an API that follows the OpenAI chat completions format.

Perplexity Sonar API is the developer platform behind Perplexity's real-time web research, exposed as a Router API, an Agent API, a Search API and an Embeddings API.

Google Cloud Speech-to-Text is a speech recognition API that turns audio into written text.

DeepSeek is an AI lab and chat assistant.

Every model, one endpoint

Search built for AI

Developers wanting access to hundreds of AI models without juggling multiple API keys need something different than ChatGPT's single-model approach

Realistic body modeling

Rasa is an agent platform for product teams building customer-facing AI.