Pull down to go back
Can you actually run Qwen 3.6 35B on a laptop with RTX 3060? Here's what to expect

Can you actually run Qwen 3.6 35B on a laptop with RTX 3060? Here's what to expect

用 RTX 3060 筆電跑 Qwen 3.6 35B 會怎樣?老實說給你聽

So you're thinking about running Qwen 3.6 35B on your laptop with an RTX 3060 6GB and 40GB RAM? Here's the real talk: it's technically possible, but you're going to hit some hard limits. A 35B model quantized to Q4 (4-bit) takes up roughly 18-20GB of VRAM, which means you'll need to offload a significant chunk to system RAM. Your RTX 3060 Mobile will handle the heavy lifting, but expect slower inference speeds—we're talking maybe 5-15 tokens/second depending on how much you're offloading. For non-time-sensitive tasks like PDF summarization, that's actually workable. The real bottleneck? Your 4-core CPU and the PCIe bandwidth between GPU and RAM will create a noticeable slowdown when swapping data. You might want to test with a smaller model first (like 13B) to see if it meets your needs without the headache. Check out frameworks like llama.cpp or Ollama to optimize for your setup.