Intel Corp. unveiled its latest AI-focused technologies on Tuesday, the Xeon 6 with Performance Cores (P-cores) and Gaudi 3 AI accelerators.
The Xeon 6 processors offer twice the performance of their predecessors, with increased core count, memory bandwidth, and integrated AI acceleration. Meanwhile, the Gaudi 3 AI accelerator, also designed for generative AI, is powered by 64 Tensor processor cores, eight matrix multiplication engines, and 128 GB of HBM2e memory. It offers up to 20% higher performance and twice the price/performance ratio of the H100 for LLaMa 2 70B inference.
"Demand for AI is leading to a massive transformation in the data center, and the industry is asking for choice in hardware, software, and developer tools," Intel executive vice president and general manager of the Data Center and Artificial Intelligence Group, Justin Hotard, commented, adding that with the new release the company "is enabling an open ecosystem that allows our customers to implement all of their workloads with greater performance, efficiency and security."
