ChatGPT is consistently evolving, integrating new features such as text-based interactions, voice chat, and image and vision capabilities. According to a recent report, OpenAI is testing the rollout of a new feature Live Video, a new part of its Advanced Voice Mode. Recently spotted in alpha, this feature could soon roll out to a wider swath of users.
Table of Contents
ChatGPT Could Soon Answer Questions by Analyzing Your Smartphone’s Camera
In May, OpenAI showcased the capabilities of its Advanced Voice Mode, where the system was able to recognize a dog in a camera feed, remember its name, and answer questions with minimal user intervention. Almost instantly, the demo showed the system understanding and responding to a live camera feed. This next step is being facilitated by Live Video, which aims to allow the AI to listen and see in real-time, recognize both objects and pets, provide hands-free assistance, and accommodate responses based on the video itself.
The feature first appeared in alpha form when a few users could test the Live Video (vision) functionality, Android Authority noted, but it hasn’t yet been widely released. The report adds that access to this feature was mentioned in the most recent ChatGPT v1.2024.317 beta build, indicating that the feature could be marketed as a “Live camera” once it reaches the beta phase.
However, users were told not to use the Live camera to do things such as live navigation or make decisions regarding health or safety, suggesting that OpenAI is still working to refine its functionality.
This suggests that OpenAI is nearing a potential beta rollout of Live Video, probably for ChatGPT Plus or potentially paid subs before others. The company, however, has not given a specific time frame in which this feature will roll out to all users outside of the alpha group. Along with the Live Video feature, OpenAI teased some updates back in May 2024 where it claimed to have made basic improvements to GPT-4o’s vision and voice abilities, though it’s unclear what this actually entailed.
