Systems and Means of Informatics

2025, Volume 35, Issue 1, pp 170-180

DATA PROCESSING UNITS AS A NEW COMPONENT OF THE DATA CENTER INFRASTRUCTURE

V. B. Egorov

Abstract

The data center processing capabilities have been traditionally implemented by processors of three kinds - central processing units (CPU), graphics processing units (GPU), and network processing units (NPU). Recently, data processing units (DPU), sometimes called also infrastructure processors, have joined this triad. The most frequently advertised purpose of the DPU is to free CPU and GPU from communication burdens and a number of routine tasks for storing, moving, and processing certain data types within a data center that assumes interaction of DPU with CPU and GPU as well as partial or complete replacement of the NPU. The article attempts to clarify the essence of DPU, specifies their place and role in the data center infrastructure, examines the connection of DPU with GPU and NPU, finds out the relation to network functions virtualization, denotes difficulties of using the DPU, and gives a preliminary assessment of the prospects for their further development and application.

[+] References (25)

Egorov, V.B. 2021. Evolyutsiya setevykh protsessorov [Evolution of network processors]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 31(1):111-121. doi: 10.14357/08696527210109.EDN: CTKUMR.
Kumar, R. 2022. Intel E2000 is the new Intel Mount Evans DPU IPU brand. STH. Available at: https://www.servethehome.com/intel-e2000-is-the-new- intel-mount-evans-dpu-ipu-brand/#:^:text=The%20Intel%20Mount%20Evans%20 IPU,Data%20Processing%20Unit%20Quick%20Primer (accessed March 10, 2025).
Salamone, S. 2022. IPU chip offloads networking and some security tasks from CPUs. Network Computing. Available at: https://www.networkcomputing.com/data- centers/ipu-chip-offloads-networking-and-some-security-tasks-cpus (accessed March 10, 2025).
Deierling, K. 2020. What is a DPU? NVIDIA. Available at: https://blogs.nvidia. com/blog/2020/05/20/whats-a-dpu-data-processing-unit (accessed March 10, 2025).
Roundy, J. 2021. How do CPU, GPU and DPU differ from one another? TechTarget. Available at: https://www.techtarget.com/searchdatacenter/tip/How-do-CPU-GPU- and-DPU-differ-from-one-another (accessed March 10, 2025).
Trick, C. 2022. What is a DPU (Data processing unit)? Trenton Systems. Available at: https://www.trentonsystems.com/blog/what-is-a-dpu (accessed March 10, 2025).
Kerravala, Z. 2022. Understanding the power benefits of data processing units. Network Computing. Available at: https://www.networkcomputing.com/data- centers/understanding-power-benefits-data-processing-units (accessed March 10, 2025).
Eileen, A. 2023. Data processing units: What are DPUs and why do you want them? Data Center Knowledge. Available at: https://www.datacenterknowledge.com/data- center-faqs/data-processing-units-what-are-dpus-and-why-do-you-want-them#close- modal (accessed March 10, 2025).
Kak ustroeny DPU, soprotsessory dlya obrabotki dannykh [How DPUs and coprocessors for data processing work]. 2020. Selectel Academy. Available at: https:// selectel.ru/blog/dpu/ (accessed March 10, 2025).
BCM58800. High-performance datacenter SoC with integrated NetXtreme Ethernet controller. 2017. Broadcom. Available at: https://docs.broadcom.com/doc/58800- PB100 (accessed March 10, 2025).
Egorov, V. 2017. Nekotorye neyavnye voprosy setevoy virtualizatsii [Some implicit issues of network virtualization]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 27(3):88^8. doi: 10.14357/08696527170308. EDN: ZQLXVN.
Data processing units (DPU). 2023. Marvell. Available at: https://www.marvell. com/products/data-processing-units.html (accessed March 10, 2025).
Egorov, V. B. 2016. Nekotorye voprosy prakticheskoy realizatsii kontseptsii SDN [Some issues of the SDN concept practical implementation]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 26(1):109M20. doi: 10.14357/08696527160108. EDN: VZBFNT.
NVIDIA BlueField-2 DPU. 2021. Data center infrastructure on a chip. NVIDIA. Available at: https://www.nvidia.com/content/dam/en-zz/Solutions/ Data-Center/documents/datasheet-nvidia-bluefield-2-dpu.pdf (accessed March 10, 2025).
NVIDIA BlueField networking platform. 2023. NVIDIA. Available at: https://www. nvidia.com/en-us/networking/products/data-processing-unit/ (accessed March 10, 2025).
NVIDIA Grace CPU superchip. 2023. NVIDIA. Available at: https://www.nvidia. com/en-us/data-center/grace-cpu-superchip/ (accessed March 10, 2025).
NVIDIA GH200 Grace Hopper superchip. 2023. NVIDIA. Available at: https:// www.nvidia.com/en-us/data-center/grace-hopper-superchip/ (accessed March 10, 2025).
Stepin, A. 2022. AMD gotovit novye DPU Pensando: Giglio i Salina [AMD is preparing new DPUs Pensando: Giglio and Salina]. ServerNews. Available at: https:// servernews.ru/1073294; https://dzen.ru/a/Yw9dPnlTczKSXvEy (accessed March 10, 2025).
AMD Pensando networking. 2024. AMD. Available at: https://www.amd.com/en/ products/accelerators/pensando.html (accessed March 10, 2025).
Davis, R. 2022. GPU+DPU for computational storage. SNIA. Available at: https://www.snia.org/sites/default/files/PM-Summit/2022/PMCS22-Davis- GPU-and-DPU-in-Computational-Storage.pdf (accessed March 10, 2025).
Huang, J., J. Lou, Y. Sun, T. Wang, E. K. Lee, andN. S. Kim. 2023. Analyzing energy efficiency of a server with a SmartNIC under SLO constraints. Symposium (International) on Performance Analysis of Systems and Software Proceedings. Piscataway, NJ: IEEE. 334-336. doi: 10.1109/ISPASS57527.2023.00044.
Huang, Z., Y. Tan, Y. Zhu, H. Tan, and K. Li. 2024. MTDA: Efficient and fair DPU offloading method for multiple tenants. IEEE T. Serv. Comput. 17(6):3971-3984. doi: 10.1109/TSC.2024.3433588.
Du, D., Q. Liu, and X. Q. Jiang. 2022. Serverless computing on heterogeneous computers. Conference (International) on Architectural Support for Programming Languages and Operating Systems Proceedings. New York, NY: ACM. 797-813. doi: 10.1145/3503222.3507732.
Karasev, S. 2023. NVIDIA predstavila setevoy uskoritel' SuperNIC dlya giper- masshtabiruemykh II-nagruzok [NVIDIA introduced SuperNIC network accelerator for hyper-scale AI workloads]. ServerNews. Available at: https://servemews.ru/1096340 (accessed March 10, 2025).
Raynovich, S. 2022. Networking could be NVIDIA's next big game. Forbes. Available at: https://www.forbes.com/sites/rscottraynovich/2022/03/28/network-could- be-nvidias-next-big-game/?sh=7c06bc201bcd (accessed March 10, 2025).

[+] About this article