Here’s a demo of Gemini Live’s ‘Talk Live about video’ feature
Rita El Khoury / Android Authority
TL;DR
- Google is working on a new feature that will allow users to chat with Gemini Live about the YouTube videos they are watching.
- This feature is not available yet, but you can see it in action in the demo video below.
- Google is also working on a similar feature for the PDFs you view.
Google’s vision for Gemini is that it will be the only AI assistant you need for everything, including communicating freely through Gemini Live. We have just demonstrated how Gemini Advanced will offer you talk to Gemini Live about the files you downloaded. We have now been able to enable this feature to have similar conversations with Gemini Live based on PDFs and YouTube videos.
An APK parsing helps predict features that may appear in a service in the future based on unfinished code. However, it is possible that such predicted features may not make it to the public release.
In the beta version of the Google app v16.1.38, in addition to uploading files to Gemini Live, we were able to enable two more features: “Talk Live About Video” and “Talk Live About PDF.”
Live conversation about video allows you to chat with Gemini, and the YouTube video provides context for the conversation.
Talk Live about PDF works the same way as shown in the video above, but instead of a YouTube video, the source context is a PDF file open on your device.
With these two features, you don’t need to be in the Gemini app to trigger file or video analysis. You can be in a PDF reader or YouTube app, bring up Gemini using the power button or trigger word, and click on the corresponding chip that pops up to transfer the information to Gemini Live.
Using the Gemini Live interface instead of the standard Gemini interface will be beneficial because of its conversational approach. You can easily ask follow-up questions without having to press buttons repeatedly, as you would otherwise have to do with the standard Gemini interface. As mentioned, you don’t even need to be in Gemini to start chatting with Gemini Live about PDFs and YouTube videos, so you’ll have a conversational assistant practically at your fingertips.
None of these new features are currently available in Gemini Live. We’ll keep you posted when they come out and learn more.
2025-01-13 13:56:52