Use case The popularity of projects like PrivateGPT, llama.cpp, Ollama, GPT4All, llamafile, and others underscore the demand to run LLMs locally (on your own device). This has at least two important benefits: Privacy: Your data is not sent to a third party,