【西川和久の不定期コラム】9年前の「Tesla V100」がアツい。Qwen3.8-Flash-Nextが約80tok/s出る！
AI summary
Editorial policyThe Strata engine allows the Qwen3.8-Flash-Next MoE model to run at approximately 80 tokens per second on a 9-year-old Tesla V100 GPU by utilizing a three-tier memory hierarchy.
Key points
- •The Strata engine, which places experts across GPU VRAM, main memory, and SSD, was introduced earlier this month for running Qwen3.8-Flash-Next.
- •Strata enables running large Mixture of Experts models on standard PCs by distributing experts across three memory tiers.
- •The Qwen3.8-Flash-Next model achieves a speed of approximately 80 tokens per second on a Tesla V100 GPU.