ChatGPT Updated With Support for These New Voice and Image Features

ChatGPT has been up to date with help for voice conversations and picture recognition, OpenAI introduced on Monday. The corporate’s AI-powered chatbot will quickly have the ability to perceive photographs captured or shared by customers and supply particulars or associated data throughout platforms the place the chatbot is offered. It’ll even be able to back-and-forth dialog utilizing OpenAI’s Whisper speech recognition instrument and a brand new text-to-speech (TTS) know-how from the corporate that’s claimed to supply “human-like” audio on the corporate’s ChatGPT app for smartphones.

OpenAI revealed in a weblog publish that the corporate’s new picture recognition functionality for ChatGPT might be accessible on all platforms, whereas the voice conversations characteristic might be accessible on iOS and Android by way of an opt-in setting. These options might be accessible to ChatGPT Plus and Enterprise subscribers, and there isn’t any phrase on whether or not it should roll out to customers on the free tier sooner or later.

The voice conversations coming to ChatGPT will be enabled by going to Settings > New Options and toggling the choice to allow voice conversations. You’ll be able to then choose from 5 voices — OpenAI says it has labored with skilled voice actors to supply the brand new characteristic. The ChatGPT app will have the ability to reply questions by changing your spoken queries into textual content that may be understood by the chatbot, and responses might be become audio utilizing the corporate’s new TTS know-how.

ChatGPT is not the one service that can use OpenAI’s new TTS know-how — Spotify on Monday introduced a brand new AI-based voice translation instrument for podcast creators that may robotically translate a podcast from English to French, German, and Spanish. The instrument is being examined with a number of podcast hosts and translated episodes might be accessible to all customers wherever Spotify is offered, based on the streaming platform. 

OpenAI says the brand new picture recognition instrument runs on the corporate’s multimodal GPT-3.5 and GPT-4 fashions and are able to analysing photographs and textual content contained in images, screenshots, and paperwork. Customers can both seize a picture or share an current one on their cellphone with ChatGPT to get insights from the chatbot.

ChatGPT may also permit customers to share a number of photographs that may be mentioned with the chatbot, based on OpenAI. If you need it to give attention to a selected space, the built-in drawing instrument will let you mark part of the picture. For instance, drawing round a dislodged bicycle chain in a photograph shared with ChatGPT may permit the chatbot to indicate you methods to repair the issue.