share_log

微软硬刚谷歌AI搜索服务上线,Windows AI助手重磅升级:Copilot可分析网站内容、类GPT语音模式对话

microsoft toughly competes with google AI search service launched, Windows AI assistant heavy upgrade: Copilot can analyze website content, similar to GPT voice mode dialogue.

wallstreetcn ·  08:34

The weather is good today The weather is good today.
Before the conference, some comments suggested that Nvidia may not announce any breakthrough achievements, but Huang Renxun and other Nvidia executives may take this opportunity to emphasize the achievements of Nvidia in the AI boom and demonstrate the company's long-term growth prospects. Some comments also believe that any relevant comments by Huang Renxun may become a driving force for the stock price. Huang Renxun's comments on AI chips during his recent trip to Asia have caused the stock price to rebound, and his related comments may boost market sentiment and make investors feel that Nvidia has not yet reached its revenue peak.

microsoft has launched a series of new Copilot features, among which Copilot Vision can interpret popular website content, the data is immediately deleted after the conversation, inaccessible to paywalls and sensitive content; Copilot Daily provides voice news summaries, for this microsoft pays cooperating publishers such as Reuters and Financial Times; Think Deeper reasons through complex issues, or supports the OpenAI o1 model; personalized features recommend Copilot usage based on user interactions history; Microsoft's Bing generative search competing with Google AI Overviews launched in the USA on Tuesday.

Microsoft came up with a big move this Tuesday, and their personal AI assistant Copilot received a major upgrade. Microsoft is rolling out a series of new Copilot features to all Windows users, including a new tool that can understand and respond to computer screen issues. Meanwhile, Microsoft's web search engine Bing officially launched the AI-generated summarization feature AI Overviews, directly competing with Google's similar generative AI search function.

From Tuesday, October 1st, in the Eastern Time Zone, Microsoft launched a new version of the Copilot App for Apple's iOS system, Google's Android system, Windows, and the web, claiming that all these App styles are more "unique" and "heartwarming." Microsoft also introduced chatbots into Meta's social media platform WhatsApp, allowing users to chat with Copilot via direct messages (DM), similar to the experience of using other robots on Meta's messaging platform.

Copilot Vision interprets website content and deletes data immediately after the conversation.

Copilot Vision is the most prominent feature of Copilot. As the name suggests, it can see the content that users view on their personal computers (PCs), specifically the websites they visit using Microsoft's AI browser Microsoft Edge.

Copilot Vision is a brand new exclusive experimental optional feature of Copilot Pro. Users can use it to analyze the text and images on webpages and answer user questions about the content, for example, users can ask how to make the food shown in an image and have Copilot provide a recipe.

Users can call up Copilot by typing "@copilot" in the address bar of Edge, similar to the search technology provided by Google on the Android system and Chrome browser. However, Microsoft states that Copilot Vision is more powerful than the previous screen analysis feature and places more emphasis on privacy.

Microsoft stated that Copilot Vision can suggest the next steps for users, answer their questions, help guide them towards anything they want to do, and assist in completing tasks. Users can simply converse with it in natural language. For example, if a user wants to furnish a new apartment, Copilot Vision can help search for furniture, find suitable color palettes, consider all choices from carpets to blankets, and even suggest how to arrange the items the user is viewing.

Regarding privacy, Microsoft emphasizes that users can immediately delete conversation data with Copilot Vision after the conversation. The feature does not store or use processed audio, images, or text for model training, at least not in this preview version. Moreover, the types of websites Copilot Vision can analyze are limited to interpreting pre-approved "popular" websites. Currently, Microsoft blocks the feature from handling paywalled and "sensitive" content on websites, without disclosing what falls under sensitive content.

Copilot Vision is currently only available in the USA. Microsoft states that the feature will adhere to a website's "robot-readable controls for AI," such as regulations prohibiting robots from scraping data for AI training. However, the company has not clearly specified which controls Vision will respect; there are several controls in use currently. We have requested Microsoft for clarification.

Copilot Daily provides voice summaries of current events. Microsoft pays collaborating publishers for this service.

Microsoft released a new feature called Copilot Daily on Tuesday, offering users voice summaries of weather and current events. To support this feature, Microsoft will pay fees to publishers to acquire content appearing in Copilot Daily.

Amazon and Google's voice assistants Alexa and Google Assistant have long been providing similar daily briefings. Microsoft claims that Copilot Daily "can help alleviate the familiar sensation of information overload" by being "concise, simple, and easy to understand, extracting content only from authorized sources," and will offer reminders and custom options as its usage evolves over time.

Microsoft currently only launches the Copilot Daily feature in the USA and United Kingdom. Reuters, Axel Springer, Hearst Magazines, USA Today Network and The Financial Times have partnered with Microsoft to provide information sources for this feature. Microsoft said they plan to 'quickly' add paid publishing partners and expand Copilot Daily to more countries.

Think Deeper to solve complex problems or support OpenAI's o1 model.

Similar to Vision, the new feature Think Deeper of Copilot aims to make Microsoft's AI assistant more flexible.

Microsoft stated that Think Deeper allows Copilot to reason about more complex problems, thanks to the 'reasoning model', which requires more time for reasoning and then provides step-by-step answers. Microsoft did not disclose specific reasoning models, only stating that they are using 'OpenAI's latest model, with some modifications by Microsoft'. Media reports speculate it should refer to a customized version of OpenAI's o1 model.

Starting from this Tuesday, Think Deeper is available to a limited number of users at Copilot Labs in Australia, Canada, New Zealand, the USA, and the United Kingdom.

Copilot Voice, similar to ChatGPT's advanced voice mode.

The new feature of Copilot, Copilot Voice, is first launched in New Zealand, Canada, Australia, the United Kingdom, and the USA in English versions. Microsoft has added four synthetic voices, allowing users to choose which voice their Copilot will use for conversations.

Similar to OpenAI's Advanced Voice Mode for ChatGPT, Copilot Voice can recognize the user's tone during conversations and respond accordingly. Users can also interject anytime during Copilot Voice responses, similar to conversing with a human.

However, Copilot Voice has restrictions on usage time. Microsoft stated that Copilot Pro's subscription users can get more Copilot Voice conversation time, but the specific duration is "variable" and depends on demand.

Personalization uses past interactions to recommend Copilot usage.

Microsoft stated that after enabling new personalization settings, Copilot will better meet the user's preferences. It will use the user's past interactions and history, as well as interactions with other Microsoft applications and services, to recommend ways of using Copilot to the user. This can help users get started with Copilot, providing a convenient guide to its practical functions and conversation starters.

The personalization feature of Copilot can be turned off in the Copilot settings menu in Windows and will not be launched in the United Kingdom and European Union countries in the near future.

Bing Generative Search was launched in the United States on Tuesday.

In July of this year, Microsoft launched a trial version of Bing Generative Search. This Tuesday, the service officially launched for all users in the USA. The easiest way to access it is by searching "Bing generative search" on Bing.

Microsoft announced that they will introduce an option to make it easier for users to trigger Bing Generative Search for "information queries".

Bing's generative search is seen as a product of Microsoft's positive confrontation with Google AI search. Wall Street News introduced in May that Google introduced three major innovations in search patterns at the 2024 Google I/O Developer Conference, the first of which is the AI-generated summary feature called AI Overviews, which displays the generated summary at the top of the search results.

Bing's generative search provides a variety of AI models to summarize information from the internet and generate summary content in response to search queries. For example, when a user searches for "What is an Italian Western movie?", Bing's generative search will display a summary of the history and examples of this type of movie, as well as the source link.

Microsoft believes that Bing's generative search utility is not limited to finding answers. Microsoft states that it can understand search queries, review millions of information sources, dynamically match content, and generate search results in a new AI-generated layout, thus more effectively meeting the intent of user queries.

Editor/Jeffy

The translation is provided by third-party software.


The above content is for informational or educational purposes only and does not constitute any investment advice related to Futu. Although we strive to ensure the truthfulness, accuracy, and originality of all such content, we cannot guarantee it.
    Write a comment