The much-anticipated Doubao Mobile Assistant consumer version has officially launched, bringing a host of new features and a refined user experience. This latest iteration focuses on enhanced stability and daily usability, with a particular emphasis on improving the overall interaction.
Versatile Activation and Smart Interaction
Doubao Mobile Assistant offers flexible activation methods, including voice commands and a dedicated AI key. The AI key is equipped with fingerprint authentication, allowing users to execute assistant tasks without secondary unlocking after initial verification. Voice activation has also been optimized for various environments, including scenarios with background noise and long-distance commands.
Screen-Aware AI Capabilities
A standout new feature is the assistant’s ability to understand and interact with the current screen content. Users can now perform tasks directly related to what’s displayed without needing to take screenshots or switch applications. For instance, a user could point their camera at a room’s interior and ask the assistant to find a cabinet within specific size and price constraints, with the assistant then searching e-commerce platforms based on the visual information and the user’s query.
Local Data Search and Enhanced Note-Taking
Doubao also provides a robust tool for searching local data, enabling users to quickly retrieve information from their photo albums, text messages, and notes. Need to know your travel permit’s expiry date? The assistant can find it within your phone’s stored information. Furthermore, the recording experience has been upgraded, integrating with Feishu Miaoji (a transcription service). Combined with the local search, users can directly ask follow-up questions about recorded content, such as specific product suggestions mentioned in a previous user interview. Users can also manually save screen content for later retrieval and searching through gestures like a three-finger swipe or by pressing the AI key and volume button simultaneously.
Open Ecosystem and Developer Control
In a significant move towards fostering an open AI application ecosystem, Doubao is introducing a Beta version of its ‘Control Phone’ functionality. To ensure responsible development and user control, the assistant is launching the Screen Automated Execution Statement Protocol (SAEP). This protocol allows third-party applications to declare their operational boundaries, explicitly permitting or denying AI automation within their interfaces. Doubao Assistant commits to respecting developers’ wishes, ensuring no automated actions are performed on apps that opt-out.
The assistant’s data collection and processing adhere to principles of ‘reasonableness and necessity’ and ‘user autonomous control.’ A dedicated Agent protection system manages and categorizes the scope of operations, providing layered security.
Exclusive Debut on Nubia NaviX Ultra
The first consumer version of the Doubao Mobile Assistant will be available on the upcoming Nubia NaviX Ultra. This device is currently available for pre-order and is set to officially go on sale on September 16th.
