Tech

Nvidia EGX takes AI computing to the edge of the network

Nvidia is launching its EGX Platform to bring real-time artificial intelligence to the edge of the network. That means AI computing will happen at the edge of the network, where sensors collect data before it is sent to cloud-connected data centers.

“There’s a massive change in the computing industry being driven by growth of [Internet of Things] sensors,” said Justin Boitano, senior director of enterprise and edge computing, in a press briefing. “There are cameras for seeing the world, microphones for hearing the world, and devices being deployed so machines can detect what is happening in the real world.”

But that means there’s an exponential increase in the amount of raw data that has to be analyzed.

“We will soon hit a crossover point where there is more computing power at the edge than in data centers,” Boitano said.

Nvidia and its customers will offer a new class of servers for instant AI on real-time streaming data in markets such as telecommunications, medicine, manufacturing, retail, and transportation. Nvidia showed the platform at the Computex event in Taiwan.

Nvidia EGX will provide accelerated computing at the edge for low-latency transactions, or those with minimal time delays between interactions. It will enable real-time reactions to data pouring in from sensors for 5G base stations, warehouses, retail stores, factories and beyond.

“AI is one of the most important computing challenges of our time, but CPUs have not been able to keep up,” Boitano said.

Nvidia created EGX to meet the emerging needs of AI applications to serve what will eventually be trillions of devices streaming continuous raw sensor data.

The platform is designed for emerging, high-throughput AI applications on the edge where data is sourced to achieve instantaneous or guaranteed response time while reducing bandwidth to the cloud. By 2025, 150 billion machine sensors and IoT devices will stream continuous data that will need to be processed. That will be orders-of-magnitude more data than produced by people.

Edge servers will be distributed throughout the world to process data from these sensors in real time.

Nvidia EGX is a “hyperscale cloud-in-a-box,”– combining the full range of Nvidia AI computing technologies with Mellanox security, networking, and storage technologies. Companies in the largest industries — manufacturing, retail, healthcare, and transportation – can use EGX to deploy AI quickly and securely, from edge to cloud.

Nvidia said EGX is scalable. It starts with the tiny Nvidia Jetson Nano — which in a few watts can provide one-half trillion operations per second (TOPS) of processing for tasks such as image recognition — and spans all the way to a full rack of Nvidia T4 servers, delivering more than 10,000 TOPS for real-time speech recognition and other real-time AI tasks.

Nvidia EGX is built for enterprise and industries. It is optimized for running enterprise-grade Kubernetes container platforms such as Red Hat Openshift. These container platforms have been tested with Nvidia Cloud Stack, an optimized software suite, to simplify setup, provisioning and management of GPU accelerated infrastructure for running Tensor RT, Tensor RT Inference Server, and NGC Nvidia GPU Cloud registry.

By combining Nvidia EGX, Red Hat OpenShift, and Nvidia Cloud Stack, enterprises can easily stand up a state-of-the-art edge to cloud infrastructure, Nvidia said.

To enable hybrid cloud computing, Nvidia EGX-powered systems and devices can connect to cloud IoT services. Customers can remotely manage their service from AWS IoT Greengrass and Microsoft Azure IoT Edge.

“Azure IoT Edge helps customers deploy cloud service to their IoT devices quickly and securely,” said Sam George, director of Azure IoT Edge, in a statement. “We look forward to supporting NVIDIA’s EGX edge platform on Azure IoT Edge devices so that customers can deploy AI workloads targeting EGX-compatible hardware.”

Early adopters include more than 40 industry-leading companies and organizations, from BMW to Foxconn.

Content sourced fromTNW

*This section only applies to third party rss feed users*
Kashmir Broadcasting Corporation allows the use of RSS Feeds, but with our content usage we expect that credit is given, but in the event that it is not. This content policy annotation will act as a credit towards KBC (Kashmir Broadcasting Corporation) Please visit kbcchannel.tv for more news and articles — we can not justify what is written on a third party site, as the content can be altered to their specification, if something is not authentic as it should be please visit kbcchannel.tv and look for the original content. if it is no longer there then it can no longer be associated with Kashmir Broadcasting Corporation and if the content on a third party site has been altered to the point of offence or deemed inappropriate please report it to KBC via email: report@kbcchannel.tv or fill the submission form on kbc’s website: https://www.kbcchannel.tv/report-form/ with the details of the site and article heading — Thank You

Website — https://www.kbcchannel.tv/
FaceBook — https://www.facebook.com/kbcchanneltv
Twitter — https://twitter.com/kbcchanneltv
YouTube — https://www.youtube.com/channel/UCV6TFLe3dGbavSYilnC2paQ
Instagram — https://www.instagram.com/kbcchanneltv/

Tags
Show More

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button
Close

Adblock Detected

Please consider supporting us by disabling your ad blocker
%d bloggers like this: