A tool was released that uses WebGPU to run small language models entirely in the browser, allowing on-device comparison and benchmarking of models like PetitGPT and SmolLM2.
- •Q4 small language models can be fully executed in the browser using WebGPU.
- •Seven small LLMs, including PetitGPT and SmolLM2, can be chatted with, benchmarked, and compared on-device.
- •It reduces reliance on servers, enabling users to test AI model performance on their devices.