llama.cpp is an open-source inference engine that runs large language models and vision-language models on local hardware or in the cloud with minimal setup.
31
0
3,775 live tools · ranked by monthly traffic and community votes · dead links removed automatically