Pull down to go back
Running Qwen 3.5 35B on a 16GB M3 MacBook Air at 8.9 TPS - Here's How

Running Qwen 3.5 35B on a 16GB M3 MacBook Air at 8.9 TPS - Here's How

在 16GB M3 MacBook Air 上跑 Qwen 3.5 35B,速度竟然有 8.9 TPS!

I got Qwen 3.5 35B (a massive AI model) running smoothly on my 16GB M3 MacBook Air using memory mapping (mmap), hitting 8.9 tokens per second. For context, this model is way bigger than my available RAM, so this speed is actually pretty solid. The trick? Using GGUF quantization to compress the model and mmap to efficiently swap data between disk and memory. I'll walk you through the exact steps, starting with downloading the model from Hugging Face using a simple pip install and Python command. No fluff here—just practical setup instructions for anyone wanting to run serious AI locally on their Mac.