The enterprise AI sector is undergoing a significant transformation, with a clear shift toward on-premises solutions rather than cloud-based models. Recent findings show that 67% of AI workloads are now executed outside the cloud, highlighting a strong preference among businesses for infrastructure that allows for internal governance and security.
As companies strive to manage AI models within their own environments, Dell and NVIDIA are stepping up to address operational gaps. Their latest partnership enhances the Dell AI Factory by integrating NVIDIA's hardware advancements to support autonomous AI workloads. This collaboration is important because it enables autonomous agents to efficiently query data, execute code, and utilize various tools while adhering to corporate security protocols.
Emphasizing On-Premises AI
The movement toward on-premises AI is further emphasized by survey data from Dell, which reveals that 88% of respondents are currently running at least one AI workload on their premises. This trend underscores the need for enterprises to adopt infrastructure that not only supports AI but also aligns with their data governance and operational needs.
Dell’s infrastructure updates aim to enhance the capabilities of AI agents. The introduction of the Dell PowerEdge XE9812, built on NVIDIA’s Vera Rubin NVL72, represents a significant advancement, promising up to ten times lower costs per token compared to earlier models. This efficiency is crucial for enterprises looking to scale their AI operations cost-effectively.
Additionally, Dell is expanding its server offerings with the PowerEdge XE9880L, XE9885L, and XE9882L systems, which are the first to utilize NVIDIA’s HGX Rubin NVL8 technology. These systems boast the capacity for up to 144 GPUs per rack and direct liquid cooling, providing a performance boost of up to 5.5 times compared to previous models. This enhanced hardware is vital for handling the computational demands of modern AI applications.
The Future of AI Infrastructure
As the demand for stable AI solutions rises, the collaboration between Dell and NVIDIA indicates a broader trend toward developing on-premises infrastructures capable of supporting complex autonomous workloads. The emphasis on internal data governance and security controls is likely to drive further innovations in this area, as enterprises seek to leverage AI's potential while maintaining oversight and control.
The advancements by Dell and NVIDIA mark a significant moment in the enterprise AI sector. Companies are increasingly prioritizing on-premises solutions that provide greater control over their AI models and data, paving the way for more sophisticated applications of autonomous agents across various industries. This trend is expected to persist as businesses aim to optimize their AI strategies in a rapidly evolving technological landscape.
The stories that move AI & crypto markets — before the market reacts.
Free. 7am ET. Five stories. 62,400 readers.
