Feb. 28, 2025 — SoftBank Corp., ZutaCore and Hon Hai Know-how Group (Foxconn) in the present day introduced that they applied ZutaCore’s two-phase direct liquid cooling expertise*1 in an AI server utilizing NVIDIA accelerated computing.
The businesses mentioned that is the primary implementation*2 of ZutaCore’s two-phase DLC*1 utilizing NVIDIA H200 GPUs. As well as, SoftBank designed and developed a rack-integrated resolution that integrates every part of the server, together with cooling gear with two-phase DLC expertise, on a rack scale, and performed an operational demonstration and efficiency analysis at its information middle in February 2025.
The demonstration outcomes indicated the answer handed NVIDIA’s temperature check (NVQual), thereby confirming the compatibility, stability and reliability of this rack-integrated resolution. The answer additionally achieved pPUE (partial Energy Utilization Effectiveness) of 1.03 (precise measured worth) per rack for cooling effectivity*3.
With the unfold and elevated adoption of AI, demand for AI servers and different computing assets is predicted to develop considerably, additional growing energy consumption at information facilities. On the similar time, decreasing energy consumption from the attitude of decreasing carbon dioxide (CO2) emissions has turn out to be a urgent subject worldwide, requiring information facilities to turn out to be extra environment friendly, eat much less energy, and introduce revolutionary warmth elimination options. Since Might 2024, SoftBank has been collaborating with ZutaCore, a worldwide chief within the improvement and enterprise deployment of two-phase DLC expertise, to develop options optimized for low energy consumption at AI information facilities.
NVIDIA H200
SoftBank, ZutaCore and Foxconn will proceed their efforts to realize greater effectivity and decrease energy consumption in AI information facilities utilizing NVIDIA accelerated computing, and collaborate on the event of rack-integrated options optimized with two-phase DLC expertise for sensible use and deployment within the world market.
Options of the rack-integrated resolution embrace:
- Plug & Play resolution
By integrating server elements similar to cooling gear outfitted with 2-phase DLC expertise, which conventionally needed to be optimized individually, on a rack scale, it’s attainable to offer a “Plug & Play”*4 resolution that can be utilized instantly by merely connecting the gear. This makes it straightforward and easy to put in in AI information facilities.
- 2-phase DLC cooling system
ZutaCore’s two-phase DLC expertise, which cools the chipsets (CPUs, GPUs, reminiscence, and so forth.) which might be the warmth sources within the server by bringing them into contact with a chilly plate, circulates a particular insulating warmth switch (dielectric) fluid with a low boiling level within the chilly plate and makes use of warmth absorption throughout the section change from liquid to gasoline attributable to the warmth supply. Environment friendly cooling is achieved by way of repeated evaporation and condensation. As well as, the water temperature will be maintained at a better temperature than in standard water-cooled services, which improves the warmth transport capability of the water used for cooling and reduces the circulate fee of water to realize the required cooling impact. This makes it attainable to scale back the strain of the pump that delivers the water for cooling, contributing to decrease energy consumption. Moreover, using insulating warmth switch fluid prevents critical injury to the server within the occasion of a spill of particular fluid.
- AI server with compatibility, stability and reliability
Foxconn developed an AI server based mostly on NVIDIA H200 GPUs, optimized with ZutaCore’s two-phase DLC expertise. This AI server was capable of exceed goal efficiency figures in NVIDIA’s certification check (NVQual), which determines the compatibility, stability, and reliability of server methods.
- Scalable rack for high-density placement of AI servers
SoftBank developed a rack designed to maximise cooling effectivity and enhance operational effectivity with its two-phase DLC expertise. Along with being designed to be versatile and scalable for high-density placement of the newest AI servers, the rack has airflow for improved cooling effectivity, and energy provide. As well as, energy provide and wiring are concentrated within the rear of the rack for operational security and robot-friendly operation. The rack can also be appropriate with 21-inch servers and traditional 19-inch servers compliant with the ORV3 normal, which is a specification set by the Open Compute Mission (OCP), a non-profit group that promotes open-source {hardware} specs and designs. The specs are designed to be deployed in accordance with world requirements.
“As we work to develop one of many largest AI infrastructures in Japan and homegrown large-scale language fashions (LLMs), bettering the vitality effectivity of knowledge facilities is important to speed up AI improvement and notice a sustainable society” mentioned Hironobu Tamba, Vice President and Head of the Information Platform Technique Division at SoftBank Corp. “The operational demonstration of this rack-integrated resolution with optimized two-phase DLC expertise has confirmed secure operation and improved vitality effectivity of high-density GPU servers with liquid cooling. Sooner or later, we’ll work on the sensible software of this resolution to be used in AI information facilities and AI factories to construct a sustainable AI infrastructure and maximize computational effectivity.”
“ZutaCore is honored to accomplice with world business leaders SoftBank and Foxconn to introduce the world’s first 2-phase DLC rack integration resolution utilizing NVIDIA accelerated computing for AI servers,” mentioned Erez Freibach, Co-founder and CEO at ZutaCore. “This groundbreaking collaboration highlights the transformative potential of our waterless DLC cooling expertise to ship unmatched effectivity whereas addressing the rising want for sustainable vitality options. Collectively, we aren’t simply assembly in the present day’s challenges however setting a brand new normal for energy-efficient innovation in next-generation AI information facilities and factories, driving progress whereas safeguarding the planet.”
*1 A expertise that cools the chilly plate on the semiconductor chip (processor) contained in the server by circulating an insulating refrigerant with out water in a two-phase system (liquid and gasoline).
*2 As of January 2025, in keeping with ZutaCore analysis.
*3 Based on ZutaCore analysis. PUE is a measure of cooling effectivity in information facilities. pPUE is a measure of the effectivity of a specific space or facility, similar to a server room or module. The nearer the quantity is to 1.0, the extra vitality environment friendly it’s.
*4 This technique that robotically acknowledges peripherals and makes the required settings when peripherals are related to the primary unit of a tool.
