AI tools for self hosted

LiteLLM is an open-source AI gateway and LLM proxy that puts more than 140 providers and 1,800 models behind one OpenAI-compatible API key.

Agno is an agent platform that runs in your own cloud and covers the full lifecycle of building, serving and managing AI agents.

Tiledesk is an open-source, no-code platform for building AI chatbots and agents that automate conversations and connect live agents when a person is needed.

Omnara is an open-source platform that gives developers one API to deploy and run agents for their users and team.

Langfuse is an open-source platform for observability and evaluation of AI agents and LLM applications.

Arize Phoenix is an open-source platform for AI observability and evaluation, built by Arize.

Piper is a fast, local neural text-to-speech engine that converts text into spoken audio on your own hardware, with no cloud service involved.

llama.cpp is an open-source inference engine that runs large language models and vision-language models on local hardware or in the cloud with minimal setup.

Chroma is open-source search infrastructure for AI, released under Apache 2.0.

Windmill is an open-source, code-first orchestration platform for internal software.

Web applications get built through a visual editor that combines AI generation with drag-and-drop customization

Kokoro is an open-weight text-to-speech model with 82 million parameters.

AutoGen is an open-source framework from Microsoft for building AI agents and multi-agent applications.

LLaMA-Factory is an open-source framework for fine-tuning more than 100 large language models and vision-language models.

OpenVoice is an open-source instant voice cloning model created by researchers at MIT and Tsinghua University together with MyShell.

LiveKit Agents is an open source framework and cloud platform for building voice, video and physical AI agents and running them in production.