The next wave of AI is here: Autonomous AI agents are amazing—and scary

The relentless hype around AI makes it difficult to separate the signal from the noise. So it’s understandable if you’ve tuned out recent talk about autonomous AI agents. A word of advice: Don’t. The significance of agentic AI may actually exceed the hype.  

An Autonomous AI agent can interact with the environment, make decisions, take action, and learn from the process. This represents a seismic shift in the use of AI and, accordingly, presents corresponding opportunities—and risks.

The P in GPT

To date, generative AI tools, largely subject to human supervision, have been designed to function by being pretrained (the P in GPT) on vast amounts of data such as large language models (LLMs) or other defined data sources and then to provide responses to inputs or prompts (a question or instruction) provided by users. This has proven to be an impressive way to come up with humanlike responses to queries or prompts—like a baby imitating sounds or words without really knowing what it is saying. Kind of adorable, but unlikely to conjure Newton’s Principia or a Beethoven symphony. So, are these generative tools really functioning as creative, independent beings? Doubtful. But that may be changing dramatically.

A new approach allows AI to interact directly and more autonomously with data and react in a dynamic way—a lot more like what humans do. This technology relies on autonomous AI agents, which Bill Gates believes are going to upend the software industry, bringing about the biggest revolution in computing since we went from typing commands to tapping on icons. And that may be an understatement.

AI Agents

AI agents are designed to make decisions without human intervention to perform predefined (for now) tasks. They can reach into the outside world, find data they hadn’t previously encountered, analyze it, then take action—far more like human interaction with the environment and less like relying on the fixed data universe of a chess program or a chatbot and an LLM that cannot go beyond its pretrained knowledge. Sounds great. What could possibly go wrong?

This is a major step forward, replacing a clever statistical approach to replicating human expression with something capable of taking in previously unknown outside stimuli, processing it, and taking action without having to be pretrained or retrained. We are removing our intermediate role creating and governing AI’s conceptual and decision-making universe. 

That’s both the point and the problem. It’s fair to say the AI baby is not just on its way to taking a few steps; it could be speeding down the highway in your new car, music blaring, swigging a bottle of tequila. 

The upside is clear. Less need for specific training and oversight. Scalability is only limited by compute resources. You can remove the human intermediary and send out agents to go and complete vast amounts of tasks on their own. After all, they are agents, they have agency—the ability to make decisions and choices. And mistakes.

What could possibly go wrong?

As software rather than a human actor, AI agent mistakes can be instantly and almost infinitely compounded, replicated, and cascaded. It is also a target for hackers. There are obvious doomsday scenarios like a rogue AI agent improperly triggering a massive wave of securities trading or unintentionally launching a military retaliation. When it comes to decisions with potentially catastrophic consequences, human oversight is by no means perfect, but most of us feel at least a modicum of comfort knowing there’s an expert human hand hovering over the go button.

There are less dramatic yet still highly impactful effects in the legal and compliance sphere that pose significant business risk. More and more companies are using AI-driven tools across the entire employee lifecycle, from selecting candidates to interviewing and hiring and continuing through performance assessment (raises, promotions, and termination). These tools are increasingly deploying AI agents. Providers often tout AI agents as supporting and improving the quality of critical HR decisions. But subtle errors in system design or implementation could lead to unfair outcomes. There’s a name for this phenomenon: algorithmic bias. At the same time, states are adopting laws penalizing both developers and users of such tools if their use results in unfair treatment of employees. And naturally, litigation is likely to follow.  

Risky Business

It is undeniable that AI agents present a significant opportunity to increase productivity by automating routine tasks and freeing people up for more creativity and problem-solving. But the risks are just as undeniable.

While jettisoning supervision and oversight may be a necessity with kids at a certain point, the metaphor only goes so far when it comes to the emancipation of AI through autonomous agents. For now, as we gleefully remove the training wheels, we should be mindful of balancing our understandable enthusiasm with reasonable caution to avoid any catastrophic crashes. 

https://www.fastcompany.com/91281577/autonomous-ai-agents-are-both-exciting-and-scary?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creato 1mo | 22 feb 2025, 12:40:05


Accedi per aggiungere un commento

Altri post in questo gruppo

iMessage still lags behind its peers. 4 ways Apple should update it for iOS 19

Few apps are as inextricably linked to the iPhone as Apple’s Messages. Introduced with the original iPhone almost 18 years ago, the app (then called “Text”) has become the primar

29 mar 2025, 09:50:03 | Fast company - tech
Elon Musk’s xAI startup just bought X for $45 billion

Elon Musk said on Friday that his xAI has acquired X, the social media app formerly known as Twitter, in an all-stock transaction for $45 billion, including $12 billion in debt.

“x

29 mar 2025, 00:40:02 | Fast company - tech
Facebook’s new throwback move: a feed just for friends

Meta wants to revive Facebook’s old-school appeal by introducing a new Friends Tab, which will focus solely on posts shar

28 mar 2025, 19:50:09 | Fast company - tech
OpenAI’s Studio Ghibli-style images renew the debate Over AI and copyright

This week, the internet had a rare opportunity to transform their selfies and family photos into stunning Studio Ghibli–style portraits. What started as a lighthearted trend quickly took a darker

28 mar 2025, 19:50:08 | Fast company - tech
A Nvidia chip shortage is coming, warns major Chinese server maker

One of China’s largest server makers, H3C, has flagged potential shortages of Nvidia’s H20 chi

28 mar 2025, 15:20:06 | Fast company - tech
Why the ‘iPhone of smartwatches’ remains so elusive

Ever since it became obvious that the iPhone was one of the most transformative consumer products in history, a question has been floating out there: Would its impact ever be matched by a device i

28 mar 2025, 13:10:02 | Fast company - tech