What is novel about AI on mobile devices?
This year’s main smartphone launches promote Artificial Intelligence as a life-changing feature.
AI has been present in mobile phones for a while now, powering voice assistant features like Siri or the Google Assistant, for example.
However, in the previous generation of phones, AI was cloud-based and required an internet connection to be accessed.
What is different about AI on mobile devices is that the new generation of smartphones will combine the cloud-based AI to built-in AI engines on the hardware. This novelty has been announced by tech giants such as Google, Apple and Huawei.
What is in-device AI and how does it work?
From what experts have promised, it seems like the difference of having a smartphone to an ‘artificially intelligent’ phone is like the difference of having a pet to a guide dog. While a pet will obey your commands, a guide dog will not only respond to your orders but lead the way and make decisions to what it believes is best for you.
Huawei’s Mate 10, released today, carries the brand’s own Kirin 970 processor. On top of the CPU and GPU, common to processors, Kirin 970 also features a Neural Processing Unit (NPU).
While CPUs and GPUs can make precise calculations, AI units, such as the NPU, work differently.
Like the human brain, AI won’t make overly complex and simultaneous calculations instantly. What it will do, through sparse processing, is recognize images, voices and language and process them like data.
This means that phones like the Mate 10 will be able to make decisions and optimise their performance based on what they have learnt from being used. In-device AI also promises a better integration of the system with hardware such as cameras, microphones and batteries.
This leads the way for a number of unique features and improvements.
What will in-device Artificial Intelligence do?
On the iPhone X, AI algorithms are behind the facial recognition system Face ID, the animated emojis Animoji and augmented reality apps.
On the Google Pixel 2, one of the AI-powered features is Now Playing. Using a database of 100,000 songs updated weekly and customised to location, the phone will tell you immediately what song is playing in the background by automatically pushing a notification on the home screen. No need to access similarly dedicated apps like Shazam.
By understanding language and images, AI will also boost Google features such as live translations and Google Lens; the google search you can trigger by taking a picture.
On the Mate 10, AI-vision cameras scan the surrounding environment to adjust the phone’s settings accordingly, optimising performance and user experience.
When taking a picture, the phone can also identify the object, person or situation being photographed. A correction filter is also applied, resulting in better quality images. The image recognition and enhancement are accurate to such a degree that they can distinguish a cat from a dog.
The AI engine is also able to compensate for low-resolution images. If the picture being viewed on your device is of a lower resolution, the AI-vision engine can predict the pixels that are missing. This allows a better full display and zooming in.
All three brands have also announced a better battery performance on the new generation phones. This is partly due to the in-device artificial intelligence. Huawei has stated that its AI will make the company’s new phones 50 times more energy efficient.
In-device AI saves power in two ways: Firstly, it allocates power to relevant functions. So, if the user isn’t using a certain feature, the phone will not allow it to consume as power unnecessarily. Secondly, in-device AI means the cloud-based AI won’t be needed as much, which saves energy.
Experts also expect in-device AI to open doors to the development of all kinds of innovative and intelligent mobile applications.
“We’re really excited to see what the new app ecosystem will have to offer, developing new apps that will privilege the new AI capabilities on the hardware,” said Christophe Coutelle, Huawei’s head of software marketing.
For instance, The Microsoft translator application has been tested and can be accelerated by up to 300% with an in-device AI engine.
Is Artificial Intelligence hungry for data?
Machine learning is all about having the right and a diverse amount of data. This makes mobile phones the ideal device to teach an AI engine due to the large and frequent amount of data input by the user.
“This is true for any kind of learning. You want lots of examples and a really nice range of examples so there aren’t any surprises and your system has learned the right way. The unique thing with devices like phones is that there are lots of examples. For the system training, that’s an advantage,” explained Professor David Robertson, from the University of Edinburgh.
However, using too much data also raises concerns about security and confidentiality.
“There’s a lot of data that you use and supply on your phone that is unique to you, that identifies you. The systems that can do an intelligent analysis of data can determine lots of things about you that you may or may not wish to be determined: your behaviours, your preferences, your health,” added Professor Robertson.
On the other hand, Professor Robertson also explained that newer AI engines might be less hungry for data because they are clever enough to start with.
Tech companies have claimed that in-device AI also allows for better security because less data will need to be shared with the cloud-based system and more data will remain on the device.
Will Artificial Intelligence features on my phone change my life?
While data and privacy issues generate concern today, Professor Robertson explained that AI has existed for more than twenty years and that, although in many cases it is not directly experienced by the user, it has been used to optimise technology systems for a long time.
AI is not the most revolutionary feature around today but its use in mobile devices could be an important help in daily life.
“It has always been an extension of human behaviour, it helps or amplifies what you do and makes things easier,” said Robertson.
The professor added that AI’s enabling capabilities are extremely “relevant to the use of mobile devices”.
Huawei’s Christophe Coutelle believes that many will benefit from AI features and that its advantages may justify the buzz around it.
“AI is about better personalisation, performance and energy saving, we believe this is in the interest of everybody.
“If the phone has a better understanding of the way you use it, if a phone has a better understanding of your context, then your phone will be able to provide more relevant features or applications. That’s really the purpose: making your phone more intelligent and able to anticipate your needs and to perform its tasks in a better a way.”