Google Gemini AI Begins Automating Smartphone App Tasks

0
20

Artificial intelligence (AI) is making a significant leap into the world of mobile devices, with Google’s Gemini AI poised to automate tasks across a wide range of smartphone applications. A recently surfaced list, compiled by Android Authority, details 134 apps that could potentially be automated by Gemini, opening up new avenues for user interaction in areas like food delivery, ride-hailing, shopping, travel, and work.

Gemini: From Information to Action

The task automation capability of Gemini extends beyond simply providing information or links. It is designed to interact directly with application interfaces, performing actions on behalf of the user. This means Gemini could autonomously search for products, add them to a cart, and proceed through the checkout process, stopping just before the final payment confirmation. The user would then only need to perform a final review and authorize the transaction.

App Compatibility: What We Know

As of November 12, a list of target apps for the stable version of Android 17 QPR2 included 114 applications. An additional 20 apps were identified in the Android Canary version, bringing the total to 134. Among the tested applications, Gemini has demonstrated success in ordering food via the Indian platform Zomato and selecting milk through Blinkit. However, apps not on the approved list, such as Swiggy or Zepto, were reportedly rejected by the system.

Limitations and Future Prospects

Inclusion in Gemini’s automation list depends on several factors. Primarily, an app must be on Google’s “whitelist,” and its digital signature must match. However, even being on the list does not guarantee full functionality. For instance, while office applications like Word, Excel, Outlook, and Slack are included, Gemini currently cannot directly edit documents within Word or perform automated operations in Outlook. This suggests that achieving comprehensive automation across all applications will require further development and refinement.

Google has not yet released an official, complete list of apps supporting Gemini automation or commented on these discoveries. Nevertheless, the emergence of new apps in the test version, including Reddit, X (formerly Twitter), LINE, and Shopee, indicates an ongoing expansion of Gemini’s capabilities.

Conclusion

The integration of Google Gemini with mobile applications marks a crucial advancement in AI development and its practical application. While current limitations exist, the potential for automating routine tasks is immense. This technology could significantly streamline users’ daily lives, freeing up time for more critical activities. The future of mobile interaction is undoubtedly linked to the continued evolution of such AI-powered solutions.

LEAVE A REPLY

Please enter your comment!
Please enter your name here