{"id":741659,"date":"2023-03-21T11:59:02","date_gmt":"2023-03-21T15:59:02","guid":{"rendered":"https:\/\/www.marketnewsdesk.com\/index.php\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/"},"modified":"2023-03-21T11:59:02","modified_gmt":"2023-03-21T15:59:02","slug":"nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows","status":"publish","type":"post","link":"https:\/\/www.marketnewsdesk.com\/index.php\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","title":{"rendered":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows"},"content":{"rendered":"
\n

\n NVIDIA H100 GPUs Now Being Offered by Cloud Giants to Meet Surging Demand for Generative AI Training and Inference; Meta, OpenAI,\u00a0Stability AI to Leverage H100 for Next Wave of AI<\/em>\n <\/p>\n

SANTA CLARA, Calif., March 21, 2023 (GLOBE NEWSWIRE) — GTC \u2014<\/strong>NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU<\/u><\/a> \u2014 the world\u2019s most powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.<\/p>\n

\n
\n Oracle Cloud Infrastructure<\/u>
\n <\/a> (OCI) announced the limited availability of new OCI Compute bare-metal GPU instances featuring H100 GPUs. Additionally, Amazon Web Services announced its forthcoming EC2 UltraClusters of Amazon EC2 P5 instances, which can scale in size up to 20,000 interconnected H100 GPUs. This follows Microsoft Azure<\/u><\/a>\u2019s private preview announcement last week for its H100 virtual machine, ND H100 v5.<\/p>\n

Additionally, Meta has now deployed its H100-powered Grand Teton AI supercomputer internally for its AI production and research teams.<\/p>\n

NVIDIA founder and CEO Jensen Huang announced during his GTC keynote today that NVIDIA DGX\u2122 H100<\/a> AI supercomputers are in full production and will be coming soon to enterprises worldwide.<\/p>\n

\u201cGenerative AI\u2019s incredible potential is inspiring virtually every industry to reimagine its business strategies and the technology required to achieve them,\u201d said Huang. \u201cNVIDIA and our partners are moving fast to provide the world\u2019s most powerful AI computing platform to those building applications that will fundamentally transform how we live, work and play.\u201d<\/p>\n

\n Hopper Architecture Accelerates AI<\/strong>
\n
The H100, based on the NVIDIA Hopper\u2122 GPU computing architecture with its built-in Transformer Engine, is optimized for developing, training and deploying generative AI, large language models (LLMs) and recommender systems. This technology makes use of the H100\u2019s FP8 precision and offers 9x faster AI training and up to 30x faster AI inference on LLMs versus the prior-generation A100. The H100 began shipping in the fall in individual and select board units from global manufacturers.<\/p>\n

The NVIDIA DGX H100 features eight H100 GPUs connected with NVIDIA NVLink\u00ae high-speed interconnects and integrated NVIDIA Quantum InfiniBand and Spectrum\u2122 Ethernet networking. This platform provides 32 petaflops of compute performance at FP8 precision, with 2x faster networking than the prior generation, helping maximize energy efficiency in processing large AI workloads.<\/p>\n

DGX H100 also features the complete NVIDIA AI software stack, enabling enterprises to seamlessly run and manage their AI workloads at scale. This offering includes the latest version of NVIDIA AI Enterprise<\/u><\/a>, announced<\/u><\/a> separately today, as well as NVIDIA Base Command<\/u><\/a>\u2122, the operating system of the DGX data center, which coordinates AI training and operations across the NVIDIA DGX platform to simplify and streamline AI development.<\/p>\n

\n AI Pioneers Adopt H100<\/strong>
\n
Several pioneers in generative AI are adopting H100 to accelerate their work:<\/p>\n