Open-Source Tool Runs AI Locally
Open Source For You, Monday, October 5th, 2026
Strata, an MIT-licensed inference engine, runs a 125B-parameter model on gaming PCs by splitting work across GPU, RAM and CPU.
Open Source For You reports on Strata, an open source inference engine that runs the 125-billion-parameter Qwen3.8-Flash-Next model on consumer gaming PCs under Windows or Linux with NVIDIA or AMD GPUs, keeping data on the user's machine.
It needs 12GB+ of VRAM, 32GB+ of RAM with 64GB recommended, and about 80GB of storage, keeping frequently used mixture-of-experts weights on the GPU and the full set in system RAM alongside speculative decoding.
Strata reports up to 94 tokens per second on an RTX 5070 system and 60 on an RX 9070 XT.