Pull down to go back
Why is Gemma 4 26B/31B running so fast on my Intel laptop? (288V / CachyOS)

Why is Gemma 4 26B/31B running so fast on my Intel laptop? (288V / CachyOS)

Gemma 4 26B/31B 在 Intel 筆電上跑這麼快是正常的嗎?(288V / CachyOS)

I jumped into local LLMs just a week ago and hit some walls with Ollama and LMStudio on my Core Ultra 9 288V—they kept crashing on MoE models. So I decided to build my own setup from scratch. OpenVINO wasn't cooperating with the NPU for these bigger models, so I compiled a custom Vulkan bridge for the GPU instead, and it's actually working surprisingly well. I'm getting 7-12 tokens/second on Gemma-4-26B with a 16k context window. Has anyone else seen these kinds of speeds on similar hardware, or am I doing something right by accident?

Keywords

local LLMinference speedIntel Core UltraGPU optimizationGGUFGemma-4performance benchmarking