Latest Open Source Projects
llama.cpp
llama.cpp
TLDR: The llama.cpp project enables inference of Meta's LLaMA model and others in pure C/C++. It offers minimal setup, state-of-the-art performance on a wide range of hardware, including various backends and supports multiple models. It comes with tools like llama-cli, llama-server, llama-perplexity, llama-bench, and more.
2023-03-10
Github