ChatGPT on macOS now floats, talks and works across your favorite apps

OpenAI has significantly upgraded its ChatGPT macOS app, enhancing functionality with new features aimed at improving user interaction and productivity. The latest update introduces Advanced Voice Mode and the “Working with Apps” feature, allowing users to engage with ChatGPT through voice commands while using various applications.

With the launch timed for Day 11 of OpenAI’s “12 Days of OpenAI” event, the updated macOS app now floats on users’ screens, functioning as a digital sidekick. Users no longer need to type their requests; they can simply speak aloud to prompt ChatGPT to assist with tasks like drafting emails, brainstorming ideas, or debugging code. This hands-free capability positions the app as a valuable tool for multitasking.

The “Working with Apps” feature greatly enhances the app’s utility, enabling it to interface with numerous applications, particularly coding environments. Users can grant ChatGPT access to apps on their Mac, allowing the AI to read and analyze on-screen content. For instance, if a user is working in a complex code editor like Warp, they can ask ChatGPT for insights or code suggestions without needing to switch tabs or copy and paste content manually. OpenAI demonstrated this capability by having ChatGPT write directly into Xcode, showcasing its potential for app development tasks.

Everyone can use the ChatGPT Mac app now

Beyond coding tools, ChatGPT’s app compatibility also extends to productivity applications. It can now generate content in apps like Apple Notes and Notion, aiding users in organizing thoughts and ideas, including sourcing information from the internet. This collaboration spans a variety of third-party applications, enhancing workflow for users across different domains.

As part of this expanded functionality, OpenAI has added support for several Integrated Development Environments (IDEs) and tools. Newly included apps are BBEdit, Android Studio, and many more under various categories such as IDEs, Terminal apps, and productivity tools. This all-encompassing integration emphasizes the commitment to creating a seamless experience for macOS users working with diverse applications.

Privacy remains a priority; users can control when and which apps ChatGPT is allowed to access. OpenAI ensures that user data is handled with care, granting users the ability to oversee their conversation histories within the app. This transparency is essential for maintaining trust while leveraging AI assistance in various workflows.

The features introduced in the ChatGPT for macOS app are accessible to Plus, Pro, Team, Enterprise, and Edu subscribers. However, there is currently no indication of when or if these capabilities will be available to free users. The app itself can be downloaded for free from OpenAI’s website, giving macOS users direct access to its features while offering enhanced functionalities to subscribers.

Featured image credit: OpenAI