Latest Open Source Projects

llama.cpp

TLDR: The llama.cpp project enables inference of Meta's LLaMA model and others in pure C/C++. It offers minimal setup, state-of-the-art performance on a wide range of hardware, including various backends and supports multiple models. It comes with tools like llama-cli, llama-server, llama-perplexity, llama-bench, and more.