Intel Unveils 5th Gen Xeon Processors Featuring Advanced AI Acceleration

Intel has launched its 5th Gen Xeon processors, featuring AI acceleration in every core, with market availability expected in 2024.

During the AI Everywhere event, Intel CEO Pat Gelsinger introduced these processors, previously codenamed Emerald Rapids. They signify a transformative milestone in computing, tailored for artificial intelligence, high-performance computing, networking, storage, databases, and security. The design focuses on enhancing performance while reducing total cost of ownership (TCO).

Sandra Rivera, Intel’s executive vice president and general manager of the Data Center and AI Group, highlighted the importance of this launch, stating, “Built for AI, our 5th Gen Intel Xeon processors provide greater performance for customers deploying AI capabilities across cloud, network, and edge use cases. We’re launching on a proven foundation that enables rapid adoption and scalability at a lower TCO.”

Key Features of 5th Gen Xeon Processors

- AI Acceleration in Every Core: Optimized specifically for AI workloads, these processors deliver up to 42% higher inference performance with minimal latency on large language models. They facilitate end-to-end AI processing without needing additional accelerators, enhancing efficiency.

- Performance and Efficiency Gains: The new processors boast an average performance increase of 21% in general compute tasks compared to their predecessors and provide a 36% boost in performance per watt across various workloads, significantly enhancing energy efficiency.

- Enhanced Capabilities: Supporting up to 64 cores per CPU, increased last-level cache, eight channels of DDR5, and faster memory transfer rates, these processors ensure improved performance and bandwidth. They also support CXL Type 3 workflows via leading cloud service providers.

- Security Enhancements: Featuring Intel Trust Domain Extensions (Intel TDX), these processors enhance confidentiality and security at the VM level, providing users with improved data privacy and control.

The Road Ahead

The 5th Gen Xeon processors will be available in single- and dual-socket systems from major OEMs like Cisco, Dell, HPE, and Lenovo by Q1 2024. Major cloud service providers are set to announce availability of instances powered by these processors throughout the year.

Intel is committed to its roadmap, with the introduction of Sierra Forest, focusing on E-core efficiency with up to 288 cores, planned for the first half of 2024. Following that will be Granite Rapids, which will prioritize P-core performance.