OpenAI has begun previewing a new tool called Operator that can navigate within a web browser. According to a blog post published Thursday, the software is powered by what the company calls a Computer-Using Agent. “CUA is trained to interact with graphical user interfaces (GUIs) — the buttons, menus, and text fields people see on a screen — just as humans do,” says OpenAI of the model. “This gives it the flexibility to perform digital tasks without using OS- or web-specific APIs.“
The current release of Operator builds on OpenAI’s GPT-4o model. It combines the vision capabilities of that algorithm with “advanced reasoning” trained through reinforcement learning. Operator has the ability to “break tasks into multi-step plans and adaptively self-correct when challenges arise.” According to OpenAI, that capability represents the next stage in AI development.
As with past research previews, OpenAI warns that Operator is “still early and has limitations,” and that it won’t “perform reliably in all scenarios just yet.” For instance, depending on the complexity of the task and interface involved, the agent greatly benefits from the user taking a few extra moments to write a more detailed prompt. Per The Verge, Operator will give the user control if it ever gets stuck on a task. It will also hand control over whenever a website asks for sensitive information, including login credentials. The company says it designed the tool to “refuse harmful requests and block disallowed content.”
OpenAI is making Operator first available to users of its $200 per month ChatGPT Pro subscription. It is also partnering with companies like Instacart to offer the agent on their platforms, though there again you’ll need a ChatGPT Pro subscription to test the integration.
Operator joins a growing list of AI agents that can either navigate a web browser or an entire operating system. Anthropic was the first to offer the capability with the release of its Claude 3.5 Sonnet model in October, followed more recently by Google with its Gemini 2.0 model and Project Mariner.
This article originally appeared on Engadget at https://www.engadget.com/ai/openais-operator-can-surf-the-web-for-you-210029243.html?src=rss https://www.engadget.com/ai/openais-operator-can-surf-the-web-for-you-210029243.html?src=rssJelentkezéshez jelentkezzen be
EGYÉB POSTS Ebben a csoportban
Last year’s Silent Hill 2 remake work
Proving that truly no IP is safe from modern reboot
If you're a music fan of a certain age, there's a good chance MTV Unplugged has special place in your heart. With the first episode airing in 1989, over the decades the series has produced some of
British creatives are speaking out against the government's proposed changes to copyright law. Take Kate Bush, Annie Lennox and Ben Howard, who join over 1,000 musicians in releasing a protest albu
One thing writers and multinational consumer electronics corporations have in common is we both need a good editor. Or, failing that, at least a good spell-checker. OnePlus somehow missed that step
