llama.cpp
GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++
code:bash
git clone
https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make