Cutting-edge technologies are driving growth for Smart Network Interface Cards (SmartNICs), Data Processing Units (DPUs), and Infrastructure Processing Units (IPUs) are shifting the balance of power in the data centre. ABI Research expects this market to grow significantly, driven by the emergence of highly specialised workloads such as AI/ ML, IoT, and 5G infrastructure.
“The demand for data centres has been exponential, driven by the growth of cloud hyperscalers, such as Alibaba Cloud, Amazon Web Services (AWS), Google Cloud, and Microsoft Azure," said Yih-Khai Wong, distributed and edge computing senior analyst at ABI Research.
He explained that the onset of the COVID-19 pandemic in 2020 accelerated the thirst for public cloud platforms.
"Organisations are moving existing workloads to public clouds and exploring the feasibility of running specific applications that require high processing power on public cloud data centres to ensure business continuity."
Yih-Khai Wong
"Large businesses using SmartNICs, DPUs, and IPUs as intelligent offloading engines for high-compute data processing tasks, resulting in a decrease in compute cost and highly optimised CPU performance,” he continued.
Although the current ecosystem is still in its infancy, this market is characterised by highly innovative solutions. As the demand accelerates, further consolidation of vendors will happen, with the more established players acquiring niche innovative vendors to boost their value proposition further.
Opportunities for the SmartNIC, DPU, and IPU markets:
Networking is the most common use of SmartNICs, DPUs, and IPUs. AMD’s Xilinx Alveo portfolio provides network functions virtualization (NFV) that decouples network services from dedicated hardware for high-performance network acceleration.
Cloud Computing Platforms where SmartNICs, DPUs, and IPUs are deployed to accelerate data-intensive workloads flowing through the cloud platform. Intel partnered with Google Cloud, with its E2000 IPU powering Google’s new C3 virtual machine.
Security: Provide the ability to offload security functions from the CPU, optimising CPU processing power for core applications. NVIDIA’s BlueField-2 DPU delivers platform security by enabling high-speed encryption and decryption, stateful packet filtering, and pattern matching.
“This market promises to be an exciting area. While we might not see mass adoption of intelligent accelerators in the short term, a scenario where a server is equipped with either a SmartNIC, DPU, or IPU by default might happen sooner rather than later,” Wong concludes.
