AI tools for lLM development

Framework for building with large language models

A machine learning engineer needs to fine-tune Llama 3 on a single NVIDIA T4 GPU but keeps hitting out-of-memory errors

LLaMA-Factory is an open-source framework for fine-tuning more than 100 large language models and vision-language models.

Haystack is an open-source AI orchestration framework from deepset for building production-grade LLM applications and agents.

TRL, short for Transformers Reinforcement Learning, is a Hugging Face library for post-training transformer language models.

The API powering the AI ecosystem

AI apps without code

Enterprise AI for business language

Connect AI to your data

Drag and drop AI

Ollama is a tool designed to help users quickly and effortlessly set up and utilize large language m

Most AI developer platforms dump more tools on you

A training API that hands control of model fine-tuning to researchers while someone else deals with the servers and scaling headaches

The SDK handles on-device AI inference by routing model execution through three distinct hardware backends

Rivet is an open-source visual programming environment for building AI agents with large language models.

Azure AI Foundry, now branded Microsoft Foundry, is Microsoft's enterprise platform for building, grounding and governing AI applications and agents.

Gemma is Google DeepMind's family of open models that developers use to build AI applications running on phones, laptops and cloud servers.

Amazon Bedrock is a managed AWS service for building generative AI applications and agents.

llama.cpp is an open-source inference engine that runs large language models and vision-language models on local hardware or in the cloud with minimal setup.

Axolotl is a free, open-source tool for fine-tuning large language models.

IBM watsonx is a portfolio of enterprise AI products that covers building models and applications, preparing governed data, running AI assistants and agents, and managing AI risk.

Semantic Kernel is a lightweight, open-source development kit from Microsoft for building AI agents and adding AI models to existing C#, Python or Java codebases.

Weights & Biases is an AI developer platform for tracking, evaluating and debugging machine learning models and LLM applications.

ModelScope is an open-source model community and hosting hub founded in June 2022 by the Institute for Intelligent Computing together with the CCF Open Source Development Committee.