OpenAI’s ChatGPT 4 is here…and it accepts image inputs

I got an email yesterday that OpenAI has started rolling out ChatGPT 4, the latest in the iterations of the artificial intelligence chatbot developed by OpenAI and launched in November 2022.

One of the coolest things about ChatGPT 4 is that it accepts image inputs. GPT-4 can accept a prompt of text and images, which—parallel to the text-only setting—lets the user specify any vision or language task. Specifically, it generates text outputs (natural language, code, etc.) given inputs consisting of interspersed text and images. However this feature is not yet available to everyone. OpenAI is starting with a single partner, Be My Eyes, to prepare the image input capability for wider availability.

Open Ai says it is its most advanced system, producing safer and more useful responses.

“ChatGPT 4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks.”

OpenAI says the distinction between GPT-3.5 and GPT-4 can be subtle. “The difference comes out when the complexity of the task reaches a sufficient threshold—GPT-4 is more reliable, creative, and able to handle much more nuanced instructions than GPT-3.5.”

For safety and alignment, OpenAI claims it spent 6 months making GPT-4 safer and more aligned. OpenAI  incorporated more human feedback, including feedback submitted by ChatGPT users, to improve GPT-4’s behaviour. it also worked with over 50 experts for early feedback in domains including AI safety and security.

It says GPT-4 is 82% less likely to respond to requests for disallowed content and 40% more likely to produce factual responses than GPT-3.5 on its internal evaluations.

ChatGPT Plus subscribers will get access to ChatGPT 4 with a dynamically adjusted usage cap while developers can sign up on a waitlist to access the API. When you sign up for the waitlist, you will get rate-limited access to the GPT-4 API – which uses the same ChatCompletions API as gpt-3.5-turbo.

ChatGPT 4 pricing is $0.03 per 1000 prompt tokens and $0.06 per 1000 completion tokens (with an 8K context window (about 13 pages of text). gpt-4-32k with a 32K context window (about 52 pages of text) will cost $0.06 per 1K prompt tokens, and $0.12 per 1K completion tokens. Prompt tokens are the parts of words fed into GPT-4 while completion tokens are the content generated by GPT-4.