Plucky Chinese startup claims to beat Nvidia DGX Spark, Mac Mini on Qwen — says its '256 TOPS beats 1000 TOPS in prefill', running 16-core Cortex-A55 SoC on 40w
A Chinese startup has claimed a breakthrough in energy-efficient AI hardware with a chip that consumes 40 watts while processing Alibaba's…
A Chinese startup has claimed a breakthrough in energy-efficient AI hardware with a chip that consumes 40 watts while processing Alibaba's Qwen large language models. Built on a 16-core ARM Cortex-A55 system-on-chip, the hardware achieves 256 TOPS of compute performance. The company asserts that architectural optimizations during the LLM prefill phase enable its 256 TOPS to outperform conventional 1,000 TOPS processors, as well as systems like the Apple Mac Mini and Nvidia edge setups. While such power efficiency could make local LLM deployment far more accessible for edge devices, the performance metrics currently rest solely on unverified vendor claims.