Zhongke Shuguang will release a token acceleration solution for large model inference

Sources from relevant personnel at Zhongke Shuguang reveal that the company will launch a new generation of token acceleration solutions aimed at large model inference, focusing on addressing issues of redundant computation and data scheduling during the inference process.

Currently, Zhongke Shuguang's ParaStor distributed storage has been applied to the country's first fully domestically produced 100,000-card AI supercluster Shuguang 8000 (Dengfeng), providing data throughput and elastic scaling support for large-scale computing tasks. The latest report from CCID Consulting shows that Zhongke Shuguang ranks first in four sub-industries: AI, education, embodied intelligence, and autonomous driving.