OpenAI reveals its first AI processor: Jalapeño


OpenAI has just revealed a new “intelligence processor” chip for AI servers made in partnership with Broadcom. The chip, called Jalapeño, is designed to power current and future large language models, according to an announcement on Wednesday.

Jalapeño is an ASIC (Application-Specific Integrated Circuit), meaning it’s designed for a specific purpose: AI inference. With AI inference, models process a user’s request to run an agent like Codex or offer a response from ChatGPT, while AI training involves a model consuming vast amounts of data to inform its responses.

It comes just nine months after OpenAI revealed that it would team up with Broadcom to make its own chips, helping reduce the company’s reliance on the GPUs offered by Nvidia that are in limited supply. In an interview with Reuters, Broadcom CEO Hock Tan says it matches the performance of Nvidia’s Blackwell chips and Google’s Tensor processing units. Microsoft, Meta, and Amazon are among the other AI companies that have also launched custom-designed AI chips recently to power their servers for either training or inference, while still trailing Nvidia’s chips on overall performance.

OpenAI calls Jalapeño the “first step in a multi-generation compute platform,” which it expects to deploy by the end of 2026. “While OpenAI is still measuring final performance, early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” OpenAI says.



Source link

  • Related Posts

    Europe’s extreme heat is shutting down power plants

    Unit two at the Golfech nuclear power plant in southern France shut down at about 11:45 p.m. on June 22 when the river used to cool the plant got too…

    ‘Supergirl’ Review: A Solid ‘Superman’ Follow-Up That Could Really Use More Lobo

    Supergirl is the second full-length film from James Gunn’s DC Studios and it switches gears from last year’s Superman to focus on his younger cousin Kara. Milly Alcock steps into…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    How Fed Chair Kevin Warsh killed the debasement trade

    How Fed Chair Kevin Warsh killed the debasement trade

    Aurora, Ont. to remove Frank Stronach’s name from recreation complex after sexual assault conviction

    Aurora, Ont. to remove Frank Stronach’s name from recreation complex after sexual assault conviction

    What Are The Benefits Of Flying In Emirates’ Business Class?

    What Are The Benefits Of Flying In Emirates’ Business Class?

    Bedford crash occurred after train passed red signal, investigators believe | Rail industry

    Bedford crash occurred after train passed red signal, investigators believe | Rail industry

    Baroness Mone sued to recover PPE Medpro millions

    Baroness Mone sued to recover PPE Medpro millions

    How roguelite shooter Void/Breaker’s destruction combat uses PS5 features – PlayStation.Blog

    How roguelite shooter Void/Breaker’s destruction combat uses PS5 features – PlayStation.Blog