llama.cpp

janhq/llama.cpp

LLM inference in C/C++