You don’t need to buy a new phone for this, it’s all software.
If it’s all in the cloud - yes. If some/most of it runs locally - still yes with a caveat - hardware acceleration can make it run both faster and at a lower battery cost, same how every computer has a dedicated graphics chip, whether as a separate expansion card or a separate module on the CPU. Yes, you technically can do all that math on CPU, it’s called software rendering, but rendering done with a purpose-built chip is so much better. Same logic applies to “AI”.
I get what you mean, but there’s currently nothing planned or in the works to run local AI on phones, also they’re still way too demanding. They can’t even handle an 7b model if we’re talking about ram usage alone.
Futureproofing, I guess, but also I’m sure there are things other than language models that can benefit from a dedicated processing unit, like photo processing, smaller models, Lens, etc.
Actually, Speach To Text is done locally on newer pixel devices. So is the audio recognition, the camera processing and a lot more AI features.
AI isn’t just chatgpt and basically every device in the last 4 years has a dedicated AI chip
This is the best summary I could come up with:
Sometimes they’re useful: I asked it to expand a bullet point list of notes into some care instructions for my houseplants, and it added some helpful context about how often to water them.
We’ll see the Pixel 8 (that’s no surprise — Google already told us in like 20 different ways), and what I’m most interested to see is how it starts bringing together the company’s various ideas about AI and its usefulness in our daily lives.
AI needs a lot of it, and Google — like other companies — offloads the heavy lifting to the cloud when you ask Bard to summarize a document or write up a meal plan.
Google’s custom Tensor chips are supposedly designed with the goal of doing more of this processing locally, but is its third-generation chipset up to the task?
Given how common overheating complaints are about Pixel 7 phones, it seems unlikely that Tensor G3 will suddenly be ready to run a lot more complicated processes on-device.
There was a report earlier this year that Google was shaking up the Assistant team and aiming to make the product more Bard-like, and my guess is that we’ll see plenty of flavors of this future in next week’s announcement.
The original article contains 885 words, the summary contains 205 words. Saved 77%. I’m a bot and I’m open source!
deleted by creator
