Source: Science and Technology Innovation Board Daily

Author: Song Ziqiao

The biggest highlight of the 5th day of the OpenAI technology live broadcast was not the AI product, but the $Apple (AAPL.US)$ “Marriage.” According to OpenAI, ChatGPT is fully connected to Apple, including iPhone, iPad, and Mac, and Apple devices that support Apple Intelligence (Apple Intelligence) can enable the ChatGPT function.

In the early morning of December 12, after announcing this collaboration, OpenAI CEO Sam Altman made a series of presentations with Dave from the engineering team and McDon from the product team.

This time, Apple Intelligence's deep integration of ChatGPT mainly includes three aspects:

1. Siri has a smart assistant

Users can wake up Siri or writing tools in almost any app. By double-clicking the command key, you can bring up the Siri prompt box, and when Siri determines that the task is too complicated, the system will ask if you need ChatGPT's assistance and hand over the problem to ChatGPT.

In the scenario of organizing a Christmas party, the OpenAI team used Siri to ask ChatGPT for suggestions and generated a complete party plan, including guest lists, music, and entertainment arrangements.

2. More powerful writing tools

When Apple's writing tools are combined with ChatGPT, users can complete various text tasks more efficiently. Whether it's refining, summarizing, or creating an article from scratch, ChatGPT can help.

During the demo session, the OpenAI team interpreted a 49-page technical report on the O1 model using ChatGPT on an Apple notebook. ChatGPT can accurately identify the various coding techniques mentioned in the document and their application scenarios, and explains in detail how these technologies work together to improve the model's coding ability.

In addition, ChatGPT can create pie charts according to user requirements to show the extent of influence of different technologies on programming ability, and demonstrates powerful data visualization capabilities.

3. Add visual intelligence capabilities

When a user takes a photo or selects an image in an album, the camera control function will conduct a preliminary analysis of the image and extract key elements in the image, such as information such as people, objects, and scenes. This information is then passed on to ChatGPT for further understanding and processing.

An interesting demo showcased the visual intelligence ChatGPT brings to Apple devices. The OpenAI team hosted an impromptu “Christmas sweater contest.” When developers press and hold the iPhone's camera control button, ChatGPT can analyze the content of the screen in real time. Not only can the system recognize the characteristics of everyone's sweaters, but it can also rank these holiday outfits in an almost humorous way. ChatGPT finally announced that Sam Altman's plain sweater was the most “fun.”

The partnership between Apple and OpenAI began at the WWDC conference in June of this year. Apple announced a technical cooperation agreement with OpenAI and plans to deeply integrate ChatGPT into the Apple product matrix.

However, at the time, Apple had not given up on building its own AI smart assistant. In October, Apple officially released the first wave of Apple Intelligence features, but features such as the writing tool, the newly designed Siri (horse racing light effect), and notification summaries are still slightly conservative. In November, people familiar with the matter revealed to the media that Apple is working hard to develop a more conversational Siri digital assistant with the aim of catching up with OpenAI's ChatGPT and other voice services.

Edit/Rocky