Running Qwen 35BA3B on a 16GB M3 Macbook Air at 8.9TPS!

Preface: I actually write my posts myself, no slop in this post. I managed to get Qwen 3.5 35BA3B working on my 15" 16GB M3 MBA through mmap, and I must say that given the massive model compared to my ram, 9 TPS is not bad at all. So, how did I do it? Step one, download the model itself: pip3 install huggingface-hub python3 -c "from huggingface_hub import hf_hub_download; \ hf_hub_download('unsloth/Qwen3.5-35B-A3B-GGUF', \ 'Qwen3.5-35B-A3B-UD-IQ3_XXS.gguf', \ local_dir='~/.local/share/ll