AI tools for AI Engineers

Cerebras Inference is a cloud API for running large language models at very high speed on the Cerebras Wafer-Scale Engine.

Reducto is an agentic document platform that converts complex files into clean, structured data for AI applications.

Amazon Bedrock AgentCore is an AWS service for building, connecting and running AI agents in production.

Omnara is an open-source platform that gives developers one API to deploy and run agents for their users and team.

Cerebras builds wafer-scale AI chips and runs a cloud service that serves models at extremely high token speeds.

Semantic Kernel is a lightweight, open-source development kit from Microsoft for building AI agents and adding AI models to existing C#, Python or Java codebases.

AIMLAPI is an AI model gateway that exposes more than 1000 models through one API.

Amazon Bedrock is a managed AWS service for building generative AI applications and agents.

Axolotl is a free, open-source tool for fine-tuning large language models.

Chroma is open-source search infrastructure for AI, released under Apache 2.0.

SambaNova Cloud is an inference service where developers call open-source models through an API that follows the OpenAI chat completions format.

Microsoft Azure AI Speech, now branded Azure Speech in Foundry Tools, is a cloud service for adding voice to applications and agents.

LiveKit Agents is an open source framework and cloud platform for building voice, video and physical AI agents and running them in production.

Scale AI supplies the data and evaluation services behind many of the world's leading AI models, and it also builds applied AI systems for enterprises and governments.

Weights & Biases is an AI developer platform for tracking, evaluating and debugging machine learning models and LLM applications.

Pipedream is an integration layer for AI agents.

The Deepgram Voice Agent API is one real-time API that combines speech recognition, language model orchestration and speech synthesis, so developers do not have to stitch separate services together.

Voyage AI makes embedding models and rerankers that raise the quality of search and retrieval, and it now operates as part of MongoDB.

Kapa is a knowledge retrieval API for AI agents.

DeepSeek is an AI lab and chat assistant.

Z

WaveSpeedAI is a media generation platform that puts more than 1,000 image, video, audio, 3D and language models behind one API key.

A machine learning engineer needs to fine-tune Llama 3 on a single NVIDIA T4 GPU but keeps hitting out-of-memory errors

Blackbox AI is an inference platform built around privacy and speed.