Microsoft Copilot Gets Major Upgrades Including Screen Vision and AI Podcasts

BigGo Editorial Team
Microsoft Copilot Gets Major Upgrades Including Screen Vision and AI Podcasts

Microsoft has unveiled a significant expansion of its AI assistant capabilities, positioning Copilot to compete more effectively against rivals like Google's Gemini and OpenAI's ChatGPT. These updates represent Microsoft's strategic push to integrate AI more deeply into everyday computing experiences, with features that extend from basic web searches to interactive screen analysis.

Introducing Microsoft Copilot as your AI companion for everyday tasks
Introducing Microsoft Copilot as your AI companion for everyday tasks

Copilot Vision Expands to Windows and Mobile Devices

Copilot Vision, which initially debuted in Microsoft Edge, is now expanding to Windows 11 PCs, laptops, and mobile devices. This feature enables the AI assistant to see and interact with content on your screen, offering contextual assistance across applications. When using Copilot Vision on Windows, users can selectively share specific applications with the AI, allowing it to provide suggestions and highlight relevant interface elements without taking full control. Microsoft has emphasized that privacy protections are in place, with the feature only activating when explicitly requested by the user. Windows Insiders will get first access to preview this capability next week, with a broader release expected later this year.

Deep Research and Enhanced Search Capabilities

Following similar offerings from competitors, Microsoft has introduced Copilot Deep Research, allowing users to request comprehensive research on specific topics. The AI will scour the web for relevant information and compile detailed reports, though non-Copilot Pro subscribers will be limited to five Deep Research queries monthly. Each query takes approximately three to six minutes to complete. Additionally, Microsoft has globally launched an improved Copilot Search feature that delivers intelligently curated information with citations, aiming to minimize misleading content while providing more structured responses than traditional search engines.

AI Agent Functionality with Copilot Actions

Microsoft is joining the trend of AI agents with Copilot Actions, a feature that enables the assistant to perform tasks on behalf of users. Launch partners include travel services like Booking.com, Expedia, Kayak, and dining platform OpenTable. This functionality essentially works as an advanced autofill system, where Copilot can complete forms with user information across supported websites. For example, users can verbally describe travel plans, and Copilot will handle the process of entering dates, locations, and payment information on partner sites.

Personalization Through Copilot Memory

The new Copilot Memory feature allows the AI to remember user preferences and past interactions to deliver more personalized responses. Similar to capabilities already available in competing AI systems, this feature enables Copilot to avoid suggesting content users dislike (such as recipes with ingredients they've previously mentioned disliking) or to recall information from past conversations. Microsoft has indicated that comprehensive privacy controls will be available through the Copilot dashboard, allowing users to manage what information is remembered or opt out entirely.

Content Creation Tools: Podcasts and Pages

Microsoft has introduced AI-generated podcasts through Copilot, catching up to similar offerings from Google's Gemini and NotebookLM. Users can either select from AI-suggested topics based on their interests or provide specific documents and websites as content sources. The podcasts are interactive, allowing users to engage with the content while listening. Additionally, Copilot Pages (previously known as Copilot Canvas in business environments) provides a workspace for organizing thoughts, notes, and research projects, similar to ChatGPT Canvas or Notion.

Exploring personalized podcasting experiences with Microsoft Copilot
Exploring personalized podcasting experiences with Microsoft Copilot

Enhanced Shopping Experience

Copilot's shopping capabilities have been expanded to include more detailed product research and comparison features. The assistant can now analyze different products (such as comparing smartphone models) and will soon offer direct purchase links within conversations. A new price tracking feature will also alert users when products they're interested in go on sale, giving Microsoft a potential edge over competing AI assistants in the e-commerce space.

Rollout Timeline

Microsoft has indicated that these new features will be deployed gradually over the coming weeks and months, with availability varying by platform, market, and language. Some features, like Copilot Search, are already accessible globally, while others remain in development or limited preview. The phased rollout suggests Microsoft is taking a measured approach to ensure stability as these advanced capabilities reach users worldwide.