Gemini for Android is getting two new options that may enable customers to ask questions on their smartphone’s present display screen. Dubbed ‘Ask about this display screen’ and ‘Ask about this video’, these instruments seize a screenshot and course of the content material of the display screen. Then, when prompted by the person, it may well reply with related data that the person is searching for. The video characteristic, which solely seems to be appropriate with YouTube, also can present video summaries offered there are captions added to the video.
Gemini Now Lets Customers Ask Queries About Their Display
Devices 360 employees members noticed the options within the Google app model 15.33.38.28.arm64 and later in a number of totally different smartphones. These seem on the highest of the Gemini floating window when a person summons the AI assistant. Those that have entry to the characteristic will see a separate rectangular strip with the textual content “Ask about this display screen” and a screenshot icon. If Gemini was activated whereas taking part in a video on YouTube, the textual content is changed with “Ask about this video” and the YouTube icon.
Gemini Ask about this display screen characteristic
Tapping the icon for ‘Ask about this display screen’ captures a short lived screenshot inside Gemini, after which the person can ask any question concerning the display screen. The responses will solely be based mostly on what the AI can see within the screenshot, nonetheless, customers also can immediate Gemini to entry the Web to search out extra data. Considered one of its use instances might be asking for a brief abstract of a information article.
To ask a follow-up query, customers can simply faucet the microphone icon or the keyboard icon on the backside of the floating window. Notably, the captured screenshot is just not saved on the gadget. Moreover, lengthy screenshots should not supported with this characteristic.
The ‘Ask about this video’ characteristic solely works for a YouTube video the place captions have been added. In our testing, we discovered that no different video platform, regardless of the standing of captions, was appropriate with the characteristic. Nevertheless, on a YouTube video, utilizing the characteristic permits customers to ask questions concerning the video. The solutions are generated based mostly on the captions, and the video itself is just not analysed.
