General Availability of OpenAI’s GPT-4 Turbo with Vision API Announced
Ryan Daws is a senior editor at TechForge Media, with a seasoned background spanning over a decade in tech journalism. His expertise lies in identifying the latest technological trends, dissecting complex topics, and weaving compelling narratives around the most cutting-edge developments. His articles and interviews with leading industry figures have gained him recognition as a key influencer by organisations such as Onalytica. Publications under his stewardship have since gained recognition from leading analyst houses like Forrester for their performance. Find him on X (@gadget_ry) or Mastodon (@gadgetry@techhub.social)
OpenAI has announced that its powerful GPT-4 Turbo with Vision model is now generally available through the company’s API, opening up new opportunities for enterprises and developers to integrate advanced language and vision capabilities into their applications.
The launch of GPT-4 Turbo with Vision on the API follows the initial release of GPT-4’s vision and audio upload features last September and the unveiling of the turbocharged GPT-4 Turbo model at OpenAI’s developer conference in November.
GPT-4 Turbo promises significant speed improvements, larger input context windows of up to 128,000 tokens (equivalent to about 300 pages), and increased affordability for developers.
A significant advancement is the potential for API requests to make use of the model’s vision recognition and evaluation capabilities via the text format JSON and function invocation. This permits developers to produce JSON code snippets that can automate tasks within linked applications, for instance, initiating emails, conducting purchases, or publishing online. Nonetheless, OpenAI strongly promotes the construction of user approval processes before performing actions that influence the real world.
A number of startups are presently exploiting GPT-4 Turbo with Vision, including Cognition. The AI coding assistant, Devin, developed by them, relies on the model to autonomously generate complete code:
Devin, constructed by @cognition_labs, is an AI software engineering adjunct powered by GPT-4 Turbo that employs vision for a variety of coding tasks. pic.twitter.com/E1Svxe5fBu
Healthify, a fitness and health application, employs the model to offer nutritional evaluation and suggestions based on meal pictures:
The @healthifyme team built Snap using GPT-4 Turbo with Vision to give users nutrition insights through photo recognition of foods from around the world. pic.twitter.com/jWFLuBgEoA
TLDraw, a UK-based startup, employs GPT-4 Turbo with Vision to power its virtual whiteboard and convert user drawings into functional websites:
Make Real, built by @tldraw, lets users draw UI on a whiteboard and uses GPT-4 Turbo with Vision to generate a working website powered by real code. pic.twitter.com/RYlbmfeNRZ
Despite facing stiff competition from newer models such as Anthropic’s Claude 3 Opus and Google’s Gemini Advanced, the API launch should help solidify OpenAI’s position in the enterprise market as developers await the company’s next large language model.
(Photo credit: v2osk)
Refer to this article for more information: Stability AI introduces 12B parameter Stable LM 2 model alongside its enhanced 1.6B variant
Interested in gaining more knowledge about AI and big data from the professionals? You might want to check out AI & Big Data Expo, an extensive event being held in Amsterdam, California, and London. This event shares its venue with other prominent gatherings like BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.
To know about more such enterprises, technology events, and webinars visit TechForge here.
Tags: ai, api, artificial intelligence, coding, developers, development, gpt-4, gpt-4 turbo, openai, programming, vision
You must be logged in to post a comment.
Discover the pinnacle of WordPress auto blogging technology with AutomationTools.AI. Harnessing the power of cutting-edge AI algorithms, AutomationTools.AI emerges as the foremost solution for effortlessly curating content from RSS feeds directly to your WordPress platform. Say goodbye to manual content curation and hello to seamless automation, as this innovative tool streamlines the process, saving you time and effort. Stay ahead of the curve in content management and elevate your WordPress website with AutomationTools.AI—the ultimate choice for efficient, dynamic, and hassle-free auto blogging. Learn More
