{"id":786503,"date":"2023-09-27T13:25:22","date_gmt":"2023-09-27T17:25:22","guid":{"rendered":"https:\/\/www.marketnewsdesk.com\/index.php\/cloudflare-powers-hyper-local-ai-inference-with-nvidia-accelerated-computing\/"},"modified":"2023-09-27T13:25:22","modified_gmt":"2023-09-27T17:25:22","slug":"cloudflare-powers-hyper-local-ai-inference-with-nvidia-accelerated-computing","status":"publish","type":"post","link":"https:\/\/www.marketnewsdesk.com\/index.php\/cloudflare-powers-hyper-local-ai-inference-with-nvidia-accelerated-computing\/","title":{"rendered":"Cloudflare Powers Hyper-Local AI Inference with NVIDIA Accelerated Computing"},"content":{"rendered":"

<\/p>\n

Cloudflare Powers Hyper-Local AI Inference with NVIDIA Accelerated Computing<\/b><\/p>\n

Businesses can now access Cloudflare\u2019s global data center network for affordable and secure AI inference to power leading-edge applications anywhere<\/i><\/p>\n

SAN FRANCISCO–(BUSINESS WIRE<\/a>)–Cloudflare, Inc.<\/a> (NYSE: NET), the leading connectivity cloud company, today announced its global network will deploy NVIDIA GPUs at the edge combined with NVIDIA Ethernet switches, putting AI inference compute power close to users around the globe. It will also feature NVIDIA\u2019s full stack inference software \u2014including NVIDIA TensorRT-LLM<\/a> and NVIDIA Triton Inference server<\/a> \u2014 to further accelerate performance of AI applications, including large language models.<\/p>\n

\nStarting today, all Cloudflare customers can access local compute power to deliver AI applications and services using fast and more compliant infrastructure. With this announcement, organizations will be able to run AI workloads at scale, and pay for compute power as needed, for the first time through Cloudflare.<\/p>\n

\nAI inference is how the end user experiences AI and is set to dominate AI workloads. Today, organizations\u2019 have great demand for GPUs. Cloudflare, with data centers in over 300 cities across the world, can deliver fast experiences to users and meet global compliance regulations.<\/p>\n

\nCloudflare will make it possible for any organization globally to start deploying AI models \u2014 powered by NVIDIA GPUs, networking and inference software \u2014 without having to worry about managing, scaling, optimizing, or securing deployments.<\/p>\n

\n\u201cAI inference on a network is going to be the sweet spot for many businesses: private data stays close to wherever users physically are, while still being extremely cost-effective to run because it\u2019s nearby,\u201d said Matthew Prince, CEO and co-founder, Cloudflare. \u201cWith NVIDIA\u2019s state-of-the-art GPU technology on our global network, we\u2019re making AI inference \u2014 that was previously out of reach for many customers \u2014 accessible and affordable globally.\u201d<\/p>\n

\n\u201cNVIDIA’s inference platform is critical to powering the next wave of generative AI applications,\u201d said Ian Buck, Vice President of Hyperscale and HPC at NVIDIA. \u201cWith NVIDIA GPUs and NVIDIA AI software available on Cloudflare, businesses will be able to create responsive new customer experiences and drive innovation across every industry.\u201d<\/p>\n

\nToday, Cloudflare is making generative AI inferencing accessible globally, and without up-front costs. By deploying NVIDIA GPUs to its global edge network, Cloudflare now provides:<\/p>\n