OpenAI announced Thursday that it has updated its ChatGPT desktop app to add support for ChatGPT Voice, allowing users to speak to the app to control AI agents and perform tasks on their computers.
This new feature takes advantage of a new family of voice models called ChatGPT-Live that OpenAI launched earlier this month.
OpenAI says ChatGPT Voice works with both ChatGPT Work and Codex, and you can also leverage your computer usage skills to search websites and apps. Additionally, on macOS, Appshots allows users to give apps access to on-screen content, including alt text.
When launched, the smartphone version of ChatGPT Voice had smoother conversations and better interruption handling, but it wasn’t built to take actions on your smartphone.
Thursday’s desktop update brings improvements that will allow users to issue complex commands with many steps and have ChatGPT respond when it requires input.
In a demo video, OpenAI showed how developers can ask ChatGPT to create a new thread, create a pull request, or identify the root cause of a bug with a single command.
The company says users can use Codex’s ChatGPT Voice from their iOS app through remote access.
Anthropic has also updated Claude’s voice modes. This lets you tap the company’s Opus, Sonnet, and Haiku models to complete tasks in apps like Gmail, Calendar, Slack, Notion, and Canva.
