Microsoft's Copilot can now see, speak and think deeply
These new capabilities allow Copilot to see what you're looking at, and a voice feature that lets you talk to Copilot in a natural way.
Just a few weeks after announcing the next wave of Copilot updates, Microsoft is pushing its AI assistant even further with key updates and a refreshed interface—featuring a warmer tone and personalized, card-based layout—that could place it in closer competition with Google’s Gemini Live and OpenAI’s ChatGPT.
These updates, which include Copilot Vision, Think Deeper, and Copilot Voice, also seem designed to provide users with a more personalized, privacy-conscious experience.
What is Copilot Vision?
One of the most significant features is Copilot Vision, which is expected to let users interact with on-screen content in real-time. Unlike other AI tools, Vision should help users understand web pages and provides suggestions or answers based on what they’re viewing.
But privacy is also a key priority here as Microsoft says that none of the data processed through Vision is stored or used for training AI models. The feature will operate only on pre-approved websites, helping Microsoft avoid issues similar to its past legal dispute with The New York Times over AI scraping of paywalled content.
Initially, Copilot Vision will only be available to a limited number of Copilot Pro subscribers in the U.S. as part of the Copilot Labs rollout.
What is Copilot Voice?
Meanwhile, the new Copilot Voice feature will introduce a more conversational layer, enabling users to interact with the assistant across various platforms, including WhatsApp.
Similar to OpenAI’s Advanced Voice Mode, this feature adapts to the user’s tone and communication style, making interactions feel more natural.
However, Microsoft has introduced time-based usage limits for Pro subscribers to ensure performance stability during peak usage times. Copilot Voice is currently available in English across Australia, Canada, New Zealand, the United Kingdom, and the United States, with plans for further expansion.
What is Think Deeper?
Another key feature is Think Deeper, which taps into OpenAI’s models to deliver step-by-step responses to more complex queries. This makes it particularly useful for users making decisions or comparing multiple options.
Although similar features exist in Google Assistant and ChatGPT, Microsoft seems to be focusing on integrating this feature within the Microsoft 365 environment, giving it a unique position in productivity-focused tasks. Microsoft says Think Deeper will start rolling out through Copilot Labs to select Pro users in Canada, Australia, New Zealand, the UK and US.
The updated Copilot experience is available today on iOS, Android, the web at copilot.microsoft.com, and through the Copilot Windows app. But users in the European Economic Area (EEA) and the U.K. will experience delays in accessing the personalization features due to ongoing privacy considerations.
With over 75 million users using the AI assistant on Windows, these enhancements could position Copilot as a competitive alternative to AI tools like Google’s Gemini and ChatGPT. But its long-term success will depend on how well users adapt to its evolving capabilities, particularly its focus on privacy and personalization.