Google just announced new AI functionality and integrations between Gemini (their premier suite of public AI models), Android devices and other Google services like Gmail. This announcement includes support for 45 languages and over 200 territories. Especially important is that the functionality will be brought to many existing Android devices, unlike Apples latest announcement that their on-device AI “Apple Intelligence” will only be made available on new iPhones (requiring users to upgrade their device to gain access).

While there were many amazing use cases (you can watch the full keynote here), we’re going to cover some of the top use cases that may impact consumer behavior.

First, the integration of Gemini will span across many Google apps such as Gmail, Drive, Calendar, Keep, and more.

Gemini is Multi-modal

Next, Gemini will be multi-modal, which means that it can leverage multiple input types, such as text, voice, and images. Here are a few examples:

  1. Multi-modal use-case #1: Take a picture of a poster that promotes a musician’s (Sabrina Carpenter in this case) tour schedule and ask Gemini (using your voice) to “check my calendar and see if I’m free when she comes to San Francisco this year.”
    1. It outputs a response of “Sure, I found that Sabrina Carpenter is coming to San Francisco on November 9, 2024. I don’t see any events on your calendar during that time.”
    2. Then you can follow up with the voice command to “set a reminder to check ticket prices tonight at 7:00”
      1. Then it sets a reminder on your phone to check
  2. Multi-modal use-case #2: You’re watching a YouTube video of a food blogger touring a famous “foodie” city and you ask Gemini to create a list of foods eaten in the video.
    1. Gemini then creates a list of foods based on the YouTube captions.
    2. Then, you can ask to have that list of foods be added to a new list in Google Keep so that you can shop for them at the Grocery store.

Have a Live Conversation with Gemini

You can also converse with Gemini in a free-flowing voice-based conversation with Gemini and change the topic as the conversation flows. You also have 10 different voices to chose from.

Gemini Can Send Information Over the Internet or Stay On-device

The use cases described above are all largely going to make internet requests to get you the latest information. However, for use cases with privacy and security implications, Google has developed Gemini Nano, an on-device model that doesn’t have to make requests over the internet. The requests remain on your device.

  1. On-device Example #1 (Text based call summaries): Gemini can effectively transcribe your call and then generate a summary after the call is over.
  2. On-device Example #1 (Screenshot Organization): Gemini can create a visual library of all screenshots you take. We all take screenshots of things we want to remember, but it can be a huge challenge to make use of those when we need to (or even remember what we have in our photos app). Gemini will use AI to detect information in the image so that everything is searchable. It also remembers where you got the screenshot from, so that you can click a link and be returned right back to the source of where you took the screenshot from. This one could have a big impact on traffic and attribution to websites, as the traffic source will likely be direct, even if a user had originally came from a marketing channel.

As AI models continue to be deployed more widely, across mobile devices, use cases will continue to expand. As use cases expand and user adoption increases, we’ll see more and more impacts on consumer behavior and search patterns. If you are looking for ways to keep your organization in sync with these changing consumer behaviors, reach out to info@morevisibility.com