llama.cpp

Run LLMs efficiently on CPUs and edge devices.