
AI: OpenAI/Jony Ive's challenges on new AI Devices. RTZ #866
One more piece today on my recent series on upcoming AI Smart Glasses and AI Devices from Amazon, Meta, Google, Apple and others, ramping up in this AI Tech Wave. These are new, AI Native, non-legacy devices beyond smartphones and PCs, to make new AI applications and services possible beyond today’s AI chatbots.
One more company in the mix of course is OpenAI, post its $6.5 billion+ acquisition of io, founded by former Apple uber-designer Jony Ive.
I’ve been discussing for a while that new hardware and software is HARD, in every major tech wave. And AI is no different.
Both Amazon and Apple have had very visible public delays in their plans for AI powered Alexa/Echo and Apple Siri/Home devices for months now. It seems that OpenAI has some challenges it’s sorting through as well in its AI Devices planned for next year and beyond.
The Financial Times (FT) discusses these issues in “OpenAI and Jony Ive grapple with technical issues on secretive AI device”:
“ChatGPT maker is working with former Apple design boss to launch a palm-sized personal assistant next year.”
“OpenAI and star designer Jony Ive are grappling with a series of technical issues with their secretive new artificial intelligence device, as they push to launch a blockbuster tech product next year. The San Francisco-based start-up run by Sam Altman acquired the former Apple design chief’s company io for $6.5bn in May, but the pair have shared few details on the projects they are building.”
“Their aim is to create a palm-sized device without a screen that can take audio and visual cues from the physical environment and respond to users’ requests. People familiar with their plans said OpenAI and Ive had yet to solve critical problems that could delay the device’s release.”
The challenges and decisions faced by OpenAI outlined below, are applicable to most companies large and small developing new AI devices:
“Despite having hardware developed by Ive and his team — whose alluring designs of the iMac, iPod and iPhone helped turn Apple into one of the most valuable companies in the world — obstacles remain in the device’s software and the infrastructure needed to power it.”
“These include deciding on the assistant’s “personality”, privacy issues and budgeting for the computing power needed to run OpenAI’s models on a mass consumer device.”
“Compute is another huge factor for the delay,” said one person close to Ive. “Amazon has the compute for an Alexa, so does Google [for its Home device], but OpenAI is struggling to get enough compute for ChatGPT, let alone an AI device — they need to fix that first.”
“A person close to OpenAI said the teething troubles were simply normal parts of the product development process. Multiple people familiar with the plans said OpenAI and Ive were working on a device roughly the size of a smartphone that users would communicate with through a camera, microphone and speaker. One person suggested it might have multiple cameras.”
The meagre available specifics hint at the contours of the device:
“The gadget is designed to sit on a desk or table but can also be carried around by the user. The Wall Street Journal previously reported some of the specifications around the device. One person said the device would be “always on” rather than triggered by a word or prompt.”
“The device’s sensors would gather data throughout the day that would help to build its virtual assistant’s “memory”. OpenAI overtook Elon Musk’s SpaceX to become the world’s most valuable private company this week, after a deal that valued it at $500bn.”
In this effort, OpenAI is executing on a well-worn plan for new devices in most prior tech waves:
“One of the ways the ChatGPT maker is seeking to justify the price tag is a push into hardware. The goal is to improve the “smart speakers” of the past decade, such as Amazon’s Echo speaker and its Alexa digital assistant, which are generally used for a limited set of functions such as listening to music and setting kitchen timers.”
A unique differentiated challenge this time is that AI is increasingly being anthropomorphized (aka humanized) by mainstream users. Something that needs to be addressed in a first principles way in product design and the eventual mass market UI/UX (user interface and experience):
“OpenAI and Ive are seeking to build a more powerful and useful machine. But two people familiar with the project said that settling on the device’s “voice” and its mannerisms were a challenge. One issue is ensuring the device only chimes in when useful, preventing it from talking too much or not knowing when to finish the conversation — an ongoing issue with ChatGPT.”
“The concept is that you should have a friend who’s a computer who isn’t your weird AI girlfriend . . . like [Apple’s digital voice assistant] Siri but better,” said one person who was briefed on the plans. OpenAI was looking for “ways for it to be accessible but not intrusive”.
“Model personality is a hard thing to balance,” said another person close to the project. “It can’t be too sycophantic, not too direct, helpful, but doesn’t keep talking in a feedback loop.”
And of course OpenAI is not alone in this new open opportunity:
“OpenAI’s device will be entering a difficult market. Friend, an AI companion worn as a pendant around your neck, has been criticised for being “creepy” and having a “snarky” personality.”
“An AI pin made by Humane, a company that Altman personally invested in, has been scrapped. Still, OpenAI has been on a hiring spree to build its hardware business. Its acquisition of io brought in more than 20 former Apple hardware employees poached by Ive from his alma mater.”
Part of the challenge is of course that the device is likely to rely on supply chains overseas, particularly in China.
And there lie geopolitical ‘trade and tariff’ dragons that are currently vexing everyone from Nvidia, Apple and others on down:
“OpenAI is also working with Chinese contract manufacturers, including Luxshare, to create its first device, according to two people familiar with the development that was first reported by The Information. The people added that the device might be assembled outside of China.”
The whole piece is worth a read for additional details on the challenges and opportunities around this new OpenAI device. But the core takeaway is that new hardware/software is hard.
And harder still this AI Tech Wave due to the unique scale and geopolitical challenges of the current environment. So we will all have to likely wait for the positives a bit longer than currently assumed. Stay tuned.
(NOTE: The discussions here are for information purposes only, and not meant as investment advice at any time. Thanks for joining us here)