Databricks’ former AI chief thinks he can cut AI’s power bill by 1,000x


The drive to discover the next big thing in AI has funded some pretty ambitious projects — but one company is taking it as a chance to rebuild computing architecture from the ground up.

Led by Naveen Rao, formerly the head of AI at Databricks, Unconventional AI promises to make inference processing vastly more power efficient. The secret weapon: a new kind of oscillator-based computer architecture.

On Thursday, the company released its first model AI — called Un-0 — an image-generation system tool that shows for the first time how the company’s technology can replicate conventional AI systems. In an accompanying new paper, the company’s research team details how they built a fully functional image-generation model using a software simulation of the new architecture — one that performs just as well as state-of-the-art diffusion models.

“This is the ‘hello world’ of a new kind of computer,” Rao told TechCrunch. “Over the next year, you’re going to start seeing some pretty interesting news around this.”

The output from the new Un-0 model is similar to that of image-generation models like Stable Diffusion or OpenAI’s GPT Image 1. The impressive part is how it arrives at that performance. The model is built on an oscillator-based architecture that is completely different from the chips that power conventional computing and traditional LLMs. The advantages of the oscillator-based computing are complex, but Rao believes it will ultimately reduce power use by as much as 1,000 times.

Much of the infrastructure to get there is still being built. The current version of Un-0 runs on a software simulation of Unconventional’s oscillator chips, but the company plans to release schematics for an actual chip soon. From there, the plan is to build an entire inference stack from the ground up, with Unconventional AI eventually supplying compute capacity just like any other provider.

“We will build a new kind of system composed of our chips,” says Rao. “We will run AI models there, and we will have a network cable where prompts come in and inferences go out, but it’ll be done at 1/1000 of power.”

It’s a stunningly ambitious goal, particularly for a company that still counts less than 50 employees. But given the scale of the AI buildout and the anticipated cost of meeting the growing demand for inference, it may be one of the few efforts to meet the scale of the problem. As Rao sees it, the available supply of power will be one of the hard limits for AI in the years to come — and Unconventional is one of the few projects able to address it.

“AI scaling is hard because of energy. It’s going to be the fundamental limit in the next few years. You just can’t go past it. It’s going to be an energy-limited problem, at the end of the day,” he says.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.



Source link

  • Related Posts

    Apple’s AirPods Max 2 headphones are still $150 off — for now

    One of the best deals this ongoing Prime Day has been on Apple’s latest flagship headphones. The AirPods Max 2 are still available for a heavily discounted price of $399…

    23 Walmart Deals We Like Better Than That Other Sale Happening Right Now

    Prime Day is in full swing, but Amazon isn’t the only shop with deals. Walmart has a competing sale it calls, in a burst of creativity, “Walmart Deals.” Like Prime…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Freedom Con: Thousands of Men Gather for Christianity and Feats of Strength

    Freedom Con: Thousands of Men Gather for Christianity and Feats of Strength

    Apple’s AirPods Max 2 headphones are still $150 off — for now

    Apple’s AirPods Max 2 headphones are still $150 off — for now

    Lawsuit filed in case of polluting, derelict N.S. tug that cost $4.1M to clean up

    Lawsuit filed in case of polluting, derelict N.S. tug that cost $4.1M to clean up

    The French-Girl Bag Trend to Wear With Black Pants This Summer

    The French-Girl Bag Trend to Wear With Black Pants This Summer

    Hormuz traffic flows despite ship attack as Iran fights to keep its grip on key trade route

    Hormuz traffic flows despite ship attack as Iran fights to keep its grip on key trade route

    Champions League: Brentford in talks to hold Shakhtar’s matches

    Champions League: Brentford in talks to hold Shakhtar’s matches