下に引いて戻る
Qwen3.6-27B-NVFP4 - images

Qwen3.6-27B-NVFP4 - images

Qwen3.6-27B-NVFP4 - images

Model: Abiray-Qwen3.6-27B-NVFP4.gguf https://huggingface.co/Freenixi/Abiray-Qwen3.6-27B-NVFP4-GGUF Specs: - Legion 7i Gen10 - NVIDIA GeForce RTX™ 5090 - Intel® Core™ Ultra 9 275HX × 24 - RAM 32.0 GiB llamacpp settings: ./build/bin/llama-server \ -m ~/.lmstudio/models/lmstudio-community/Qwen3.6-27B-GGUF/Abiray-Qwen3.6-27B-NVFP4.gguf \ -ngl 99 \ -c 131072 \ -t 16 \ -b 4096 \ -ub 2048 \ --cache-type-k q8_0 \ --cache-type-v q8_0 \ -fa 1 \ --defrag-thold 0.1 \ --temp 0.6 \ --top-p 0.95 \ --top-