According to NVIDIA official news, NVIDIA announced today that the NVIDIA H100 Tensor Core GPU is in full production, and NVIDIA global technology partners plan to launch the first products and services based on the groundbreaking NVIDIA Hopper architecture in October.
Released in April 2022 , the H100 consists of 80 billion transistors and features numerous groundbreaking technologies, including a powerful new Transformer engine and NVIDIA NVLink interconnect technology, to accelerate the largest scale AI models , such as advanced recommender systems and large language models, and drive innovation in areas such as conversational AI and drug discovery.
According to Nvidia, the H100 enables enterprises to cut AI deployment costs, delivering the same AI performance with a 3.5x improvement in energy efficiency compared to the previous generation, reducing the total cost of ownership to 1/3, the number of server nodes used Also reduced to 1/5.
NVIDIA DGX H100 systems are also now accepting customer preorders. The system contains 8 H100 GPUs with a peak performance of 32 PFlops in FP8 precision . Each DGX system includes NVIDIA Base Command and NVIDIA AI Enterprise software, enabling cluster deployments from a single node to NVIDIA DGX SuperPODs, supporting advanced AI development for large language models and other large-scale workloads.
H100-powered systems from the world's leading computer manufacturers are expected to ship in the next few weeks, with more than 50 server models arriving by the end of this year and dozens more in the first half of 2023 . Partners already building systems include Atos, Cisco, Dell Technologies, Fujitsu, Gigabyte, HPE, Lenovo and Supermicro.
0 Comments