Intel unveils Gaudi 3 AI accelerator, says it beats Nvidia's H100

 Intel made a splash at the kickoff of its Vision 2024 conference by introducing the Gaudi 3 AI processing chip. This new chip is tailor-made to turbocharge AI tasks on a large scale within businesses, boasting superior speed compared to Nvidia's H100 GPU, the current gold standard in the industry.

 

Built upon the same architecture and core principles as its predecessor, Gaudi 3 distinguishes itself by leveraging TSMC's cutting-edge 5nm manufacturing process, a significant leap from the 7nm process utilized in Gaudi 2. This enhancement translates to heightened efficiency and performance.



 Equipped with up to 128GB of HBM2e memory, Gaudi 3 boasts an impressive bandwidth of 3.7 TB/s and operates within a power envelope of 900W.

During its presentation, Intel presented benchmark comparisons pitting Gaudi 3 against Nvidia's leading H100 GPU, showcasing performance disparities across various large language models such as LLAMA2-7B, LLAMA2-13B, and GPT-3 175B. Impressively, Gaudi 3 outpaced its competitor by up to 1.7 times in speed.

 

Furthermore, Intel highlighted Gaudi 3's exceptional power efficiency, asserting that it surpasses Nvidia's H100 by up to 2.3 times in this regard.

Equipped with up to 128GB of HBM2e memory, Gaudi 3 boasts an impressive bandwidth of 3.7 TB/s and operates within a power envelope of 900W.

During its presentation, Intel presented benchmark comparisons pitting Gaudi 3 against Nvidia's leading H100 GPU, showcasing performance disparities across various large language models such as LLAMA2-7B, LLAMA2-13B, and GPT-3 175B. Impressively, Gaudi 3 outpaced its competitor by up to 1.7 times in speed.

 

Furthermore, Intel highlighted Gaudi 3's exceptional power efficiency, asserting that it surpasses Nvidia's H100 by up to 2.3 times in this regard.

Comments

Post a Comment

Popular posts from this blog

Visual 'portal' connects Dublin and New York City

Image
 Dublin and New York City have forged a live, visual bond through an innovative artistic endeavor known as "The Portal."   This groundbreaking installation boasts a street-side sculpture that offers a continuous, real-time livestream showcasing both Dublin and New York, regardless of where you are.   These twin portals stand as pillars of a larger public art initiative designed to bridge communities across the Atlantic Ocean using cutting-edge technology.   The sculpture serves as a conduit for immediate interaction among Dubliners, New Yorkers, and all those who traverse these bustling cities.   Positioned on Dublin's iconic O'Connell Street, the portal captures the essence of the city, including landmarks like the GPO and the Spire.   Meanwhile, its counterpart in New York City resides within the vibrant Flatiron South Public Plaza, nestled amid the bustling intersection of Broadway, Fifth Avenue, and 23rd Street.   The unveiling of this
Read more

Is Mother's Day for moms in the trenches? Woman shares why she takes the day for herself.

Image
 An Indiana mom is making waves online by revealing her unconventional approach to Mother's Day. Rather than celebrating her own mother or mother-in-law on the designated day, she chooses to honor them on separate occasions. Her reasoning? To carve out a space for herself to truly relish the holiday.   In a TikTok video garnering 2.1 million views, Emily Wehner explained her stance, acknowledging it might stir controversy. She emphasized that her priority lies in the intensive task of mothering she's currently engaged in.   Wehner's message is clear: Mother's Day should prioritize the mothers in the thick of parenting, not necessarily the grandmothers. This perspective stems from her own experience of feeling sidelined on her first Mother's Day, consumed by arranging grandparent visits and neglecting her own needs.   Thus, she instituted what she calls "Mother's Day Rules" to ensure she gets the chance to pamper herself and fully embrace
Read more

Russia is suspected of orchestrating a plot to assassinate a high-ranking European defense official.

Image
According to NATO diplomats, Russia is believed to be behind a foiled plot to assassinate the head of Europe’s largest ammunition manufacturer due to his company's support for Ukraine. The alleged conspiracy targeted Armin Papperger, the chief executive of Rheinmetall, a Düsseldorf-based defense company, and is viewed as part of Russia's broader sabotage and hybrid attack campaign against European NATO states. This information was first reported by CNN. A person familiar with Papperger's security measures indicated that the level of protection around him was “at the highest level,” comparable to that of German Chancellor Olaf Scholz. Although a spokesperson for Scholz declined to comment, Papperger told the Financial Times that Berlin had established a “great level of security around my person.”   Papperger could not confirm specific details of the plot but expressed belief in the accuracy of the CNN report, which stated that US intelligence uncovered the effort and a
Read more