Qwen3.8-27B on a $100 GPU, 3.9× faster
Four campaigns tuned an inference engine for Qwen3.8-27B on one Tesla P100: two goal campaigns made the new weight format work and hold its quality, then two hill climbs made it fast, with the model's answers held where they started. tensorless ships the result in one command.
- 3.89×
- faster decode, 7.74 → 30.06 tokens a second
- 131
- changes judged in the decode climb, 28 kept
- $100
- the GPU: one used Tesla P100
Decode speed of every attempt, in tokens a secondQwen3.8-27B-PN3 on one Tesla P100, 24–29 October 2026