Intel Gaudi 3 Expands Availability to Drive AI Innovation at Scale

a gaudi 3 accelerator sits over a blue background

Available through Dell AI Factory, Intel Gaudi 3 AI accelerators deliver high performance, open source flexibility and enterprise-grade infrastructure to speed AI adoption. (Credit: Intel Corporation)

Available through Dell AI Factory, Intel Gaudi 3 AI accelerators deliver high performance, open source flexibility and enterprise-grade infrastructure to speed AI adoption.

What’s New: Today, Dell unveiled the Dell AI platform with Intel® Gaudi® 3 AI accelerators, via the Dell AI Factory. The fully validated end-to-end solution is designed to simplify the adoption, integration and scaling of AI technologies for enterprises. Combining Intel Gaudi 3 hardware with an open source software stack and Dell’s trusted infrastructure expertise, the platform provides a seamless path to accelerating AI transformation across industries.

“Our collaboration with Dell brings the power of Intel Gaudi 3 into an integrated solution ready for enterprise deployment. This platform is optimized to meet the demands of modern AI – from large language models to edge inference – while providing the flexibility and openness businesses require.”

- Saurabh Kulkarni, Intel vice president, Data Center AI Strategy and Product Management

Why It Matters: Enterprises navigate complex decisions in AI deployment, balancing the need for high performance, scalability, flexibility and cost-efficiency. The Dell AI platform features Intel Gaudi 3, which offer competitive generative AI (GenAI) price performance, delivering 70%1 better price-performance inference throughput of Llama 3 80B over Nvidia H100.  The platform’s scalable architecture evolves with business needs, ensuring IT professionals can meet increasing demands without compromising flexibility. With open networking and software stacks, the solution avoids vendor lock-in, offering businesses long-term adaptability. This empowers developers, IT teams and business leaders to unlock AI value at every stage of their journey.

"Today, enterprises need more than raw compute, they need scalable, open and efficient solutions that accelerate their AI journey,” said Varun Chhabra, senior vice president, Dell Technologies. “With the Dell AI platform with Intel, we're delivering a future-ready foundation for AI innovation that grows with our customers' needs."

How It is Purpose-Built for AI Workloads: At the core of the Dell AI platform with Intel is the PowerEdge XE9680, a robust server optimized for AI workloads. The server’s key features include:

  • Eight Intel Gaudi 3 accelerators with 128 gigabytes (GB) HBM memory and 3.7 terabytes/second (TB/s) bandwidth, perfect for large language models and computer vision.
  • 5th Gen Intel® Xeon® processors with up to 64 cores and PCIe Gen 5 slots, designed to handle complex computations with ease.
  • Scalable storage and networking with 32 DIMM slots, 16-drive capacities and 800 gigabit Ethernet (GbE), ensuring smooth data flow and eliminating storage and connectivity bottlenecks.
  • Energy-efficient air cooling, optimized to support large-scale AI workloads such as GenAI and machine learning.

How It is Optimized for Developers: The platform includes a pre-validated open source software stack that supports:

  • Frameworks like PyTorch and Hugging Face for easy model fine-tuning.
  • Kubernetes for flexible resource scheduling and orchestration.
  • Grafana and Prometheus for real-time observability and monitoring.

Additionally, the Dell Enterprise Hub offers a catalog of models optimized for Intel Gaudi 3, giving developers an expedited path to implementation.

About Streamlined Cluster Management: Dell Omnia, an open source tool kit for deploying and managing high-performance clusters, plays a pivotal role in the Dell AI platform with Intel, enabling dynamic resource allocation. This helps IT teams and developers quickly adapt and optimize evolving workloads, reducing deployment times and increasing overall productivity.

By seamlessly integrating with various tools and frameworks, the Dell AI platform with Intel offers the perfect blend of enterprise-grade reliability and developer agility.

 What’s Next: Discover the capabilities of Intel Gaudi 3 AI accelerators and explore the Dell AI platform with Intel at Dell Technologies World 2025 on May 19-22 in Las Vegas at the Intel booth #654 or Dell booth #833.

The small print:

1 Source: Intel measured results vs Nvidia H100 data sources: http://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/performance/perf-overview.md for 128-2048 input-output sequences Intel results obtained Sept. 9, 2024. Results may vary. Pricing estimates based on publicly available information and Intel internal analysis

Intel does not control or audit third-party data.  You should consult other sources to evaluate accuracy.