GPU utilization during post-training depends partly on how efficiently infrastructure moves data and loads updated models. As enterprises continually refine AI agents, reducing delays between training rounds can help keep that process moving.
The need for continual improvement is pushing CoreWeave Inc. to build a full-stack AI cloud for the agent lifecycle. You.com Inc. provides web search tools for those agents, according to Saurabh Sharma (pictured, right), chief product officer of You.com.
“What we’re seeing is that the ceiling is no longer model intelligence,” Sharma said. “The models are getting more intelligent, but it’s their ability to use the tools that dictates the agent’s success.”
Sharma and Corey Sanders (left), senior vice president of product at CoreWeave, spoke with theCUBE Research’s Dave Vellante and John Furrier at the Fully Connected event, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed tool skills, graphics processing unit utilization and continuous model improvement. (* Disclosure below.)
Post-training puts GPU utilization at the heart of the AI loop
CoreWeave has announced CoreWeave Forge, which connects model deployment, evaluation and improvement. Its reinforcement learning Rollouts capability, currently in preview, supports repeated cycles of generating training responses and updating models, Sanders explained.
“For the weight synchronization, this is an area that we’ve done a bunch of work to be able to bring the weights in sort of a hot start versus starting cold every time,” Sanders said. “Instead of the weight always coming from object storage, we now get weights from other peers nearby.”
Data movement also matters when the goal is keeping GPU utilization high between training rounds. CoreWeave AI Object Storage now supports cross-region writes, letting post-training jobs write results back for others to use, according to Sanders.
“There actually is core infrastructure like our object storage, which we’ve built around trying to get data into the GPU as fast and as easy as possible,” Sanders said. “You write like it’s a local machine. We treat it like it’s a global system.”
You.com, which runs its own web index, has joined CoreWeave’s partner network to give agents a search layer. Working with Nvidia, the companies used RL Rollouts to post-train Nemotron 3.5 Lightning in eight hours with You.com’s web search tools.
“What our customers are seeing is that … they are able to run their workloads with higher accuracy and lower total cost of ownership,” Sharma said. “If you can do this in eight hours, this is no longer something that only the frontier labs can do.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the Fully Connected event:
(* Disclosure: TheCUBE is a paid media partner for the Fully Connected event. Neither CoreWeave, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)