Server consolidation is getting a second look as agentic AI drives a surge in demand for general-purpose compute. Graphics processing units dominate the AI infrastructure conversation, but the agents running on those systems lean heavily on central processing units, and data centers are short on the power and space to keep adding servers.
Dell Technologies Inc. sees that pressure as an opening for its PowerEdge server line, which it expanded with 11 new servers in May. Replacing aging fleets with denser systems frees capacity for new AI work, according to Pradyumna Narendra (pictured), product planner and senior consultant at Dell.
“As AI accelerates, inferencing and agentic AI around it will accelerate and grow faster,” Narendra said. “As these use cases scale out, you get exponential growth in the need for compute.”
Narendra spoke with theCUBE Research’s John Furrier at the AI Data Pipeline Forum, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how server consolidation, rack-level efficiency and support for multiple chip suppliers help customers make room for agentic AI. (* Disclosure below.)
Server consolidation makes room for agentic compute
Dell’s upcoming 18th generation of PowerEdge servers is built around that refresh math. Systems powered by Advanced Micro Devices Inc. processors will deliver 70% gen-over-gen performance gains and can fold 13 servers from Dell’s 14th generation into one, Narendra noted. The gains compound as companies retire older hardware.
“For every 10 to 13 servers you replace, you get so much of that productivity gain back because now you can do that with one server,” Narendra said. “Now when you expand that across data centers, that’s like an accelerating effect that you get to capitalize from.”
Raw processor speed is only part of the pitch, since many server makers use the same AMD silicon. Dell’s three-rack-unit, two-socket design, for instance, spends less power cooling itself than a two-unit equivalent, which lets customers fit more compute into each rack, he explained.
“So therefore, by deploying servers that are slightly larger in package, you deliver more density at a rack level, which seems sometimes counterintuitive,” Narendra said. “But we are actually seeing results and our customers are benefiting from this.”
Management tools such as Integrated Dell Remote Access Controller, or iDRAC, and OpenManage Enterprise tie those fleets together, while support for multiple chip suppliers keeps server consolidation from becoming a lock-in decision. Customers get systems that look and operate the same regardless of whose processors sit inside, according to Narendra.
“We believe in democratizing technology and enabling silicon diversity so that our customers are not locked into a single operating model or a single choice as such,” Narendra said. “That is the promise and the premise which we built our portfolio with.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the AI Data Pipeline Forum:
(* Disclosure: Dell Technologies Inc. sponsored this segment of theCUBE. Neither Dell Technologies Inc. nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)