OpenAI added help for a number of note-taking and coding apps throughout the ChatGPT app for macOS on Thursday. The AI agency described this function as agentic and highlighted that the chatbot will be capable of learn on-screen data within the supported apps and assist customers with queries. This function is presently accessible to solely the paid subscribers of the AI platform and customers can use the Superior Voice Mode whereas working with these apps. OpenAI acknowledged that Home windows customers and people on the free tier of the app will get this function subsequent yr.
ChatGPT Now Works With Some Third-Get together Apps
The brand new function was introduced on day 11 of OpenAI’s 12-day delivery schedule. This new agentic functionality, which permits the chatbot to learn data in a number of note-taking and coding apps is being added to the macOS app of ChatGPT, the corporate highlighted in an X (previously referred to as Twitter) publish.
Kevin Weil, the Chief Product Officer at OpenAI additional revealed that ChatGPT can work with roughly 30 macOS apps. The complete listing consists of Apple Notes, BBEdit, MatLab, Nova, Script Editor, TextMate, VSCode Insiders, VSCodium, Cursor, WindSurf, Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover, WebStorm, Prompts, Warp, Notion, and Quip.
With this function, customers can open a supported app and go to any display screen or content material. They will then use the shortcut Choice + Area to open a small text-field view of the app. The chatbot can see what the consumer sees within the app, as soon as activated. Then, the consumer can both use textual content prompts or the Superior Voice Mode to ask queries, and ChatGPT can reply to them. Customers may also spotlight a particular a part of textual content or code after which use pure instructions resembling “the best way to make this higher” and the AI will perceive the context.
Whereas the corporate calls it an agentic function, it’s technically extra of a vision-based function. The agentic perform is required solely when gaining permission to entry these apps. Nonetheless, ChatGPT won’t be able to work together with these apps and can’t carry out duties resembling writing textual content or code or altering current data.
For privateness, customers will be capable of management when and which apps could be accessed by ChatGPT. Moreover, OpenAI acknowledged that customers could have the identical degree of management over this information as they’d over the rest of their dialog historical past.
This function is presently accessible to ChatGPT Plus, Professional, Groups, Enterprise, and Edu subscribers. Free customers and people utilizing the Home windows app must wait until the subsequent yr to get this function.