Google reimagines the mouse pointer with AI-enabled commands

Commands are simple once the mouse knows where it is pointing. (Picture: Google)
The common mouse pointer hasn’t changed in half a century, Google says — so it has infused it with context-aware AI to let you simply speak to it.

The general idea is to have an AI system be aware of where or what you are pointing at, and then use the microphone on your computer to give simple commands without careful prompting.

This should allow for easier AI interactions like «show me directions» when looking at a building, or «book a table» while hovering over a restaurant.

This sort of pointer needs the OS or app to be context-aware, and there is no system like this yet. It is, however, rolling out in Gemini in Chrome «starting today,» and will roll out «soon» as Magic Pointer, a major feature of the freshly announced Googlebook.

It is also available to test in AI Studio, where you can use it to edit an image or find places on a map. Do note that the system uses your microphone.

Read more: Google’s blog, 9to5Google.

Codex gets a plugin for Chrome

The new Chrome extension lets Codex do everything you do on Google’s Chrome browser — from repetitive browser work to complex data entry work.

The plugin can run code in the background, automatically chooses the right tool for the job, and can be used for things like testing web apps, getting context from multiple tabs and launching DevTools.

It’s available on macOS and Windows in all regions «except the EU and UK.»

Gemini on Chrome expands to more countries and languages

Gemini is offering AI integration in the Chrome browser for even more markets. (Picture: Google/generated)
With som features previously only available for Pro and Ultra subscribers in the USA, the AI features for Chrome are now launching on desktop and mobile in India (the second largest market for American AI), New Zealand and Canada, with promises of more to come.

Gemini in Chrome adds a new side panel, letting you chat with Gemini without opening up a new tab, and can do things like summarize or interact with web pages. It can connect to Gmail, Calendar, YouTube, Shopping and flights information.

It also comes with Nano Banana features, so you can try an apartment listing picture with your own furniture, for example.

In addition to the three new countries, which are mostly English-speaking, Google is announcing support for another 50 languages.

This of course includes Hindi, but there is also support for French, Spanish, Chinese and lots of other European languages.

Read more: Google’s announcement. Writeups on TechCrunch and Engadget.

Gemini on Chrome gets massive update

Gemini in Chrome goes big on agentic browsing. (Picture: Google)
Pro and Ultra users on Chrome in the USA are getting a huge update today, on everything from shopping to Personal Intelligence.

The new side panel (no longer a pop-up) is powered by Gemini 3 and goes big on agentic browsing. It can connect to your Gmail, Calendar, Youtube, Shopping and Flights information and can multitask to do things like booking flights from an email invitation.

It can even use your browsers stored passwords to log into shopping sites and complete your order, after finding your purchase in an embedded image.

It’s also getting Nano Banana to manipulate images right from the websites you are reading.

Everything should be ready to go in the new update for U.S. subscribers, and Google says Personal Intelligence will likely come in a few months.

Read more: Google’s announcement and thread, The Verge, Gizmodo.

Google rolls out AI Mode in US, during AI feast at Google I/O

Google debuts AI Mode, Gemini for Chrome and lots more at I/O this year
So much news. Google brings a firehose of new AI features to Google I/O. (Picture: Google Imagen 4)
Google’s I/O conference kicked off with a tsunami of AI news last night. Clearly, the company is going all-in on artificial intelligence, and is using all the levers in its power to promote it — even in Chrome.

The most important news they presented is AI Mode going live in the USA, using what is likely the most valuable screen real estate on the planet — Google’s front page — to leverage the new AI search feature. It’s been in testing for about a week.

Continue reading “Google rolls out AI Mode in US, during AI feast at Google I/O”