share_log

英伟达发布Dynamo,号称“AI工厂的操作系统”

NVIDIA released Dynamo, touted as the 'operating system of AI factories.'

Breakings ·  Mar 18 18:54

NVIDIA officially launched Dynamo, claimed to be the 'operating system of AI factories.' Dynamo is a 'distributed inference service library.' Essentially, it is an open-source solution for the problem of not being able to produce enough tokens for user-demanded tokens. Jensen Huang displayed a chart regarding inference, with the X-axis showing the number of tokens per second by users and the Y-axis showing the number of tokens per second by the factory. With the support of Dynamo and the Grace Blackwell NVLink72 superchip, Blackwell achieves 25 times the performance improvement compared to Hopper. In inference models, Blackwell's performance is 40 times that of Hopper. Jensen Huang also humorously remarked that with the latest technologies mentioned, vendors building AI factories 'save more the more they buy.'

The translation is provided by third-party software.


The above content is for informational or educational purposes only and does not constitute any investment advice related to Futu. Although we strive to ensure the truthfulness, accuracy, and originality of all such content, we cannot guarantee it.
1
Comment Comment · Views 2338

Recommended

Write a comment

Statement

This page is machine-translated. Futubull tries to improve but does not guarantee the accuracy and reliability of the translation, and will not be liable for any loss or damage caused by any inaccuracy or omission of the translation.