英特尔发布了Xeon 6 处理器和Gaudi 3 AI加速器，旨在为企业提供高性能、高性价比的AI系统。Xeon 6 处理器性能是上一代的两倍，并集成了AI加速功能，而Gaudi 3 AI加速器专为大规模生成式AI优化，提供更高的吞吐量和性价比。英特尔还与IBM合作，将Gaudi 3 AI加速器作为服务部署在IBM云上，降低AI的总拥有成本。

🚀 **英特尔Xeon 6 处理器:** Xeon 6 处理器旨在以卓越的效率处理计算密集型工作负载，其性能是上一代的两倍。该处理器配备了更高的核心数量、两倍的内存带宽和嵌入在每个核心中的AI加速功能。Xeon 6 专为满足从边缘到数据中心和云环境的AI性能需求而设计。

🚀 **英特尔Gaudi 3 AI加速器:** Gaudi 3 专为大规模生成式AI优化，拥有64个张量处理核心（TPC）和8个矩阵乘法引擎（MME），以加速深度神经网络计算。它包括128GB的HBM2e内存，用于训练和推理，以及24个200Gb以太网端口，用于可扩展的网络连接。Gaudi 3 还与PyTorch框架以及高级的Hugging Face变压器和扩散器模型无缝兼容。

🚀 **英特尔与IBM合作:** 英特尔最近宣布与IBM合作，将英特尔Gaudi 3 AI加速器作为服务部署在IBM云上。通过这种合作，英特尔和IBM旨在降低总拥有成本，以利用和扩展AI，同时提高性能。

🚀 **英特尔与OEM合作:** 英特尔与戴尔科技和超微等领先的OEM合作，共同开发针对特定客户需求的定制系统，以实现有效的AI部署。戴尔科技目前正在共同开发利用Gaudi 3和Xeon 6的基于RAG的解决方案。

🚀 **扩展企业AI应用的访问权限:** 英特尔的Tiber产品组合提供业务解决方案，以解决AI、云和边缘环境中的访问、成本、复杂性、安全、效率和可扩展性等挑战。英特尔® Tiber™ 开发者云现在提供英特尔Xeon 6的预览系统，供技术评估和测试。此外，部分客户将能够抢先体验英特尔Gaudi 3，以验证AI模型部署，Gaudi 3集群将在下一季度开始推出，用于大规模生产部署。

Intel enables a new era of high-performance enterprise AI systems and solutions.

NEWS HIGHLIGHTS

Intel launches Xeon 6 with Performance-cores (P-cores), doubling the performance for AI and HPC workloads.

New Gaudi 3 AI accelerators offer up to 20 percent more throughput and 2x price/performance vs H100 for inference of LLaMa 2 70B¹. 

As AI continues to revolutionize industries, enterprises are increasingly in need of infrastructure that is both cost-effective and available for rapid development and deployment. To meet this demand head-on, Intel launched Xeon 6 with Performance-cores (P-cores) and Gaudi 3 AI accelerators, bolstering the company’s commitment to deliver powerful AI systems with optimal performance per watt and lower total cost of ownership (TCO).

Also Read: AiThority Interview with Brian Gumbel, President and Chief Operations Officer at Dataminr

“Demand for AI is leading to a massive transformation in the data center, and the industry is asking for choice in hardware, software and developer tools,” said Justin Hotard, Intel executive vice president and general manager of the Data Center and Artificial Intelligence Group. “With our launch of Xeon 6 with P-cores and Gaudi 3 AI accelerators, Intel is enabling an open ecosystem that allows our customers to implement all of their workloads with greater performance, efficiency and security.”

Introducing Intel Xeon 6 with P-cores and Gaudi 3 AI accelerators

Intel’s latest advancements in AI infrastructure include two major updates to its data center portfolio:

Intel Xeon 6 with P-cores: Designed to handle compute-intensive workloads with exceptional efficiency, Xeon 6 delivers twice the performance of its predecessor². It features increased core count, double the memory bandwidth and AI acceleration capabilities embedded in every core. This processor is engineered to meet the performance demands of AI from edge to data center and cloud environments.

Intel Gaudi 3 AI Accelerator: Specifically optimized for large-scale generative AI, Gaudi 3 boasts 64 Tensor processor cores (TPCs) and eight matrix multiplication engines (MMEs) to accelerate deep neural network computations. It includes 128 gigabytes (GB) of HBM2e memory for training and inference, and 24 200 Gigabit (Gb) Ethernet ports for scalable networking. Gaudi 3 also offers seamless compatibility with the PyTorch framework and advanced Hugging Face transformer and diffuser models. Intel recently announced a collaboration with IBM to deploy Intel Gaudi 3 AI accelerators as a service on IBM Cloud. Through this collaboration, Intel and IBM aim to lower the total cost of ownership to leverage and scale AI, while enhancing performance.

Enhancing AI Systems with TCO Benefits

Deploying AI at scale involves considerations such as flexible deployment options, competitive price-performance ratios and accessible AI technologies. Intel’s robust x86 infrastructure and extensive open ecosystem position it to support enterprises in building high-value AI systems with an optimal TCO and performance per watt. Notably, 73% of GPU-accelerated servers use Intel Xeon as the host CPU³.

Also Read: Unlocking the Future of AI in the Managed Travel Industry

Intel partners with leading OEMs including Dell Technologies and Supermicro to develop co-engineered systems tailored to specific customer needs for effective AI deployments. Dell Technologies is currently co-engineering RAG-based solutions leveraging Gaudi 3 and Xeon 6.

Bridging the Gap from Prototypes to Production with Co-Engineering Efforts

Transitioning generative AI (Gen AI) solutions from prototypes to production-ready systems presents challenges in real-time monitoring, error handling, logging, security and scalability. Intel addresses these challenges through co-engineering efforts with OEMs and partners to deliver production-ready retrieval-augmented generation (RAG) solutions.

These solutions, built on the Open Platform Enterprise AI (OPEA) platform, integrate OPEA-based microservices into a scalable RAG system, optimized for Xeon and Gaudi AI systems, designed to allow customers to easily integrate applications from Kubernetes, Red Hat OpenShift AI and Red Hat Enterprise Linux AI.

Expanding Access to Enterprise AI Applications

Intel’s Tiber portfolio offers business solutions to tackle challenges such as access, cost, complexity, security, efficiency and scalability across AI, cloud and edge environments. The Intel® Tiber™ Developer Cloud now provides preview systems of Intel Xeon 6 for tech evaluation and testing. Additionally, select customers will gain early access to Intel Gaudi 3 for validating AI model deployments, with Gaudi 3 clusters to begin rolling out next quarter for large-scale production deployments.

New service offerings include SeekrFlow, an end-to-end AI platform from Seekr for developing trusted AI applications. The latest updates feature Intel Gaudi software’s newest release and Jupyter notebooks loaded with PyTorch 2.4 and Intel oneAPI and AI tools 2024.2, which include new AI acceleration capabilities and support for Xeon 6 processors.

[To share your insights with us as part of editorial or sponsored content, please write to psen@itechseries.com]

The post Intel Unveils Next-Generation AI Solutions with the Launch of Xeon 6 and Gaudi 3 appeared first on AiThority.