Pull down to go back
Why don't open source AI tools treat llama.cpp as a first-class option?

Why don't open source AI tools treat llama.cpp as a first-class option?

為什麼沒有開源工具把 llama.cpp 當成一等公民?

If you've tried using open source AI tools like VS Code's Copilot extension or other "open source" AI assistants, you've probably noticed they all support Ollama and sometimes LM Studio—but rarely llama.cpp, even though it's arguably the most powerful option. The frustrating part? From an engineering perspective, adding llama.cpp support is trivial—it would take almost zero effort to list it alongside Ollama. Better yet, these tools could just accept any OpenAI API-compatible endpoint and let you plug in your own port number. It's especially galling because Ollama basically borrowed llama.cpp's work and got all the attention for it. Why the double standard?