Pull down to go back
Mistral Medium 3.5 on AMD Strix Halo: Painfully Slow (Plan for Overnight Runs)

Mistral Medium 3.5 on AMD Strix Halo: Painfully Slow (Plan for Overnight Runs)

Mistral Medium 3.5 在 AMD Strix Halo 上跑起來超慢,準備好熬夜吧

Someone actually tested Mistral Medium 3.5 on AMD's new Strix Halo chip, and the results are... not great. For a 48k-token prompt with 4k thinking tokens, it took about 2 hours just to get an answer about code architecture. Yeah, you read that right—two hours. The takeaway: if you want to run this locally on Strix Halo, queue it up before bed. The technical setup involved heavy optimization (Q5_K_XL quantization, GPU acceleration with -ngl 999, cache reuse), but even with all that tuning, it's still a crawl. Not exactly the "instant local AI" dream, but hey, at least it works.

Tech Blogger Take

Someone waited 2 hours for AI to answer a coding question. This is why local AI isn't ready.

Picture this: you ask your local AI a complex coding question, hit enter, and then... wait. For two hours. That's exactly what happened when someone tested Mistral Medium 3.5 on AMD's shiny new Strix Halo chip. We're talking about a 48k-token prompt with 4k thinking tokens — basically asking the AI to really think through a code architecture problem. Even with every optimization trick in the book (Q5_K_XL quantization, maxed-out GPU acceleration, cache reuse), it still crawled along like dial-up internet. This isn't some budget setup either — Strix Halo is AMD's flagship AI chip. The brutal reality? While everyone's hyping 'AI on your laptop,' we're still light-years away from the instant, ChatGPT-like experience people expect. Sure, it works, but 'working' and 'practical' are two very different things.

VerdictQueue up your complex AI tasks before bed and pray your laptop doesn't crash overnight — local AI is still a patience game.
7/10

AI Analysis

Hardware Development

high
Action Required

Start planning AI workload benchmarks for your next chip designs — consumer expectations are shifting from 'can it run' to 'how fast can it run'

Key Insight

Even AMD's flagship Strix Halo with all the optimization tricks still needs 2 hours for what cloud APIs do in seconds — the local AI performance gap is massive

Why It Matters

Your customers are about to discover that 'AI-capable hardware' and 'AI-practical hardware' are completely different things

Job Impact Analysis

AI Engineers

Role Shift
Why It Impacts

Local AI inference is proving painfully slow even on premium hardware, forcing a complete rethink of deployment strategies

How to Adapt

Start building hybrid workflows now — queue long inference jobs locally overnight, keep interactive work in the cloud

Product Managers

At Risk
Why It Impacts

The 2-hour wait time for complex AI tasks on local hardware kills any real-time product experience dreams

How to Adapt

Redesign your AI features around batch processing and overnight workflows, not instant responses

Glossary

Strix Halo(Strix Halo晶片)
AMD's flagship AI-focused processor chip that this painful 2-hour test exposed as still being way too slow for real-time local AI work.
Q5_K_XL Quantization(Q5_K_XL量化)
A compression method that reduces AI model size to fit on consumer hardware — one of the optimization tricks used in this test that still couldn't save it from the 2-hour crawl.
Thinking Tokens(思考令牌)
The 4k tokens mentioned in this test that represent the AI's internal reasoning process before giving its final answer — basically the AI 'thinking out loud' internally.
Local Inference(本地推論)
Running AI models on your own hardware instead of cloud services — what this 2-hour nightmare demonstrates is still painfully slow compared to cloud APIs.