Pull down to go back
Tool for Creating Your Own High-Quality GGUF Quants (Docs + Web UI)

Tool for Creating Your Own High-Quality GGUF Quants (Docs + Web UI)

自己製作高品質 GGUF 量化模型的工具(完整文件 + 網頁介面)

For anyone interested in building their own GGUF quants, I've put together the GGUF-Tool-Suite docs and a simple web UI to make the process easier. Docs: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/docs Web UI: https://gguf.thireus.com/quant_assign.html The goal is to let anyone benchmark and automatically produce GGUFs of any size for ik_llama.cpp and llama.cpp.

Keywords

GGUF quantsmodel quantizationweb UIdocumentationopen source toolbenchmarking