Pixi’s new iOS app turns text messages into interactive AR experiences


Forget stickers, GIFs, and emoji reactions. Pixi is betting that the next evolution of messaging is interactive augmented reality (AR).

The startup launched its messaging-native app on the App Store on Wednesday, allowing users to send AI-powered AR characters through iMessage. Instead of appearing as static media, the characters come to life through the recipient’s iPhone camera, where they can react to their surroundings, interact with people, and respond in real time.

While AR isn’t new and shiny anymore—companies like Snap have created AR filters and lenses for years—Pixi believes its approach is different. By combining AR with on-device AI, its characters can understand what’s happening around them and behave accordingly. A virtual cat, for example, reacts when a real dog walks past. (According to the company, all visual and audio processing remains on the device to preserve user privacy.)

Pixi founder Mark Drummond (ex-DreamWorks Animation and ex-Apple) says the app is designed to bring a greater sense of presence and spontaneity to digital conversations. Rather than sending a text to wish someone a Happy Birthday, users can send characters that create a shared experience, turning a simple message into something closer to a digital gift or playful interaction.

“The consumer problem we’re solving is thinking of a friend when they’re not present,” he told TechCrunch. “Sometimes the psychology is called pebbling or creative gifting. You’re sharing tokens of affection, basically cards, e-cards, and gifts. That’s your dad, or, in some cases, your granddad’s media. We can do better. We can do something that’s digitally native, and that uses everything we learned about AR on the iPhone.” 

Earlier this week, Drummond demonstrated the app for us, selecting the cat character, which performed a series of stand-up jokes on his desk. Notably, the cat appeared to respond to Drummond’s facial expressions. For instance, the experience concluded when he smiled, showcasing the character’s ability to perceive emotional cues.

At launch, users will have access to a robot, a cat, and an animated envelope character that can react to their voice and “attack” their friends in a playful way. If they move, the envelope will chase them. There are also games like tic-tac-toe and whack-a-mole.

Image Credits:Pixi Platforms

Pixi plans to expand beyond just a few characters. The goal is to create a marketplace where studios, brands, and independent creators can share their unique characters for users to choose from. The company envisions this being used for events like movie premieres or product launches, allowing characters to generate excitement, such as when M&Ms release a new flavor.

Drummond also mentioned introducing Alice in Wonderland as a character option, as she is an open intellectual property. He pointed out that “our Alice character needs to react to objects that she sees on your desktop in an ‘Alice-consistent’ way,” to demonstrate to partners how their creations will interact with the technology.

In the future, Pixi hopes to allow users to create their own characters and personalities. 

“Part of our plan is to open up those generative AI capabilities to our [users], so they can prompt their way to say something, like, ‘I want a blue blob that threatens my friend and growls at them and keeps chasing them on the phone,’” Drummond explained.

To send a character to your friend, download the app on iOS and use iMessage by tapping the plus sign button in the lower left corner. No installation is required to receive a Pixi message.

Initially, the app will be available only for iPhone models 11 and newer, but there are plans to expand to Android devices and messaging platforms like WhatsApp and Instagram in the future. 

Also, while the app is free for users, brands will have the option to charge for their characters if they choose.

“We’re going to encourage people to do it for free, because then people become your own brand ambassadors. You’re putting them in charge of using your characters to tell their own stories,” Drummond said.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.



Source link

  • Related Posts

    The first long-duration resident of the ISS, a cosmonaut, has died

    Aleksandr Samokutyaev, Expedition 28 flight engineer, in the International Space Station’s Zvezda service module with a view of space shuttle Atlantis outside the window during the STS-135 mission on July…

    Waymo Recalls Robotaxis Over Risk They’ll Drive at Speed Into Freeway Construction Zones

    Waymo has filed its fourth safety recall since February 2024, after its driverless cars were caught entering closed freeway-construction zones. The recall, filed with the National Highway Traffic Safety Administration…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The first long-duration resident of the ISS, a cosmonaut, has died

    The first long-duration resident of the ISS, a cosmonaut, has died

    Anya Taylor-Joy Joins ‘The Hunt for Gollum’

    Anya Taylor-Joy Joins ‘The Hunt for Gollum’

    Cuban economy needs ‘urgent changes’ as US blockade deepens crisis, says president | Cuba

    Cuban economy needs ‘urgent changes’ as US blockade deepens crisis, says president | Cuba

    Son of ex-premier Jean Charest to run for Quebec Liberals in Montreal’s Verdun riding

    Son of ex-premier Jean Charest to run for Quebec Liberals in Montreal’s Verdun riding

    How Indigenous-owned firms finance their operations

    How Indigenous-owned firms finance their operations

    Fallen Toronto officer Marc Pinizzotto commemorated with Mississauga park naming

    Fallen Toronto officer Marc Pinizzotto commemorated with Mississauga park naming