The next wave of AI is here: Autonomous AI agents are amazing—and scary

The relentless hype around AI makes it difficult to separate the signal from the noise. So it’s understandable if you’ve tuned out recent talk about autonomous AI agents. A word of advice: Don’t. The significance of agentic AI may actually exceed the hype.  

An Autonomous AI agent can interact with the environment, make decisions, take action, and learn from the process. This represents a seismic shift in the use of AI and, accordingly, presents corresponding opportunities—and risks.

The P in GPT

To date, generative AI tools, largely subject to human supervision, have been designed to function by being pretrained (the P in GPT) on vast amounts of data such as large language models (LLMs) or other defined data sources and then to provide responses to inputs or prompts (a question or instruction) provided by users. This has proven to be an impressive way to come up with humanlike responses to queries or prompts—like a baby imitating sounds or words without really knowing what it is saying. Kind of adorable, but unlikely to conjure Newton’s Principia or a Beethoven symphony. So, are these generative tools really functioning as creative, independent beings? Doubtful. But that may be changing dramatically.

A new approach allows AI to interact directly and more autonomously with data and react in a dynamic way—a lot more like what humans do. This technology relies on autonomous AI agents, which Bill Gates believes are going to upend the software industry, bringing about the biggest revolution in computing since we went from typing commands to tapping on icons. And that may be an understatement.

AI Agents

AI agents are designed to make decisions without human intervention to perform predefined (for now) tasks. They can reach into the outside world, find data they hadn’t previously encountered, analyze it, then take action—far more like human interaction with the environment and less like relying on the fixed data universe of a chess program or a chatbot and an LLM that cannot go beyond its pretrained knowledge. Sounds great. What could possibly go wrong?

This is a major step forward, replacing a clever statistical approach to replicating human expression with something capable of taking in previously unknown outside stimuli, processing it, and taking action without having to be pretrained or retrained. We are removing our intermediate role creating and governing AI’s conceptual and decision-making universe. 

That’s both the point and the problem. It’s fair to say the AI baby is not just on its way to taking a few steps; it could be speeding down the highway in your new car, music blaring, swigging a bottle of tequila. 

The upside is clear. Less need for specific training and oversight. Scalability is only limited by compute resources. You can remove the human intermediary and send out agents to go and complete vast amounts of tasks on their own. After all, they are agents, they have agency—the ability to make decisions and choices. And mistakes.

What could possibly go wrong?

As software rather than a human actor, AI agent mistakes can be instantly and almost infinitely compounded, replicated, and cascaded. It is also a target for hackers. There are obvious doomsday scenarios like a rogue AI agent improperly triggering a massive wave of securities trading or unintentionally launching a military retaliation. When it comes to decisions with potentially catastrophic consequences, human oversight is by no means perfect, but most of us feel at least a modicum of comfort knowing there’s an expert human hand hovering over the go button.

There are less dramatic yet still highly impactful effects in the legal and compliance sphere that pose significant business risk. More and more companies are using AI-driven tools across the entire employee lifecycle, from selecting candidates to interviewing and hiring and continuing through performance assessment (raises, promotions, and termination). These tools are increasingly deploying AI agents. Providers often tout AI agents as supporting and improving the quality of critical HR decisions. But subtle errors in system design or implementation could lead to unfair outcomes. There’s a name for this phenomenon: algorithmic bias. At the same time, states are adopting laws penalizing both developers and users of such tools if their use results in unfair treatment of employees. And naturally, litigation is likely to follow.  

Risky Business

It is undeniable that AI agents present a significant opportunity to increase productivity by automating routine tasks and freeing people up for more creativity and problem-solving. But the risks are just as undeniable.

While jettisoning supervision and oversight may be a necessity with kids at a certain point, the metaphor only goes so far when it comes to the emancipation of AI through autonomous agents. For now, as we gleefully remove the training wheels, we should be mindful of balancing our understandable enthusiasm with reasonable caution to avoid any catastrophic crashes. 

https://www.fastcompany.com/91281577/autonomous-ai-agents-are-both-exciting-and-scary?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

созданный 2mo | 22 февр. 2025 г., 12:40:05


Войдите, чтобы добавить комментарий

Другие сообщения в этой группе

‘Thank you for your attention to this matter!’: Trump’s favorite sign-off has become a viral meme

Thanksgiving may not arrive until November, but you wouldn’t know it from perusing Donald Trump’s social media feeds. He’s been giving thanks quite a lot lately. “

23 апр. 2025 г., 14:50:08 | Fast company - tech
Microsoft says these are the AI terms you need to know

Microsoft released its annual Work Trend Index report on Tuesday, which argued that 2025 is the year that companies stop simply experimenting with AI and start building it into key missions.

23 апр. 2025 г., 14:50:07 | Fast company - tech
Microsoft thinks AI colleagues are coming soon

Artificial intelligence has rapidly started finding its place in the workplace, but this year will be remembered as the moment when companies pushed past simply experimenting with AI and started b

23 апр. 2025 г., 14:50:06 | Fast company - tech
José Andrés on AI, crisis tech, and rethinking the food system

As the founder of World Central Kitchen, renowned chef and humanitarian José Andrés has truly mastered the art of leading through crisis. Andrés shares insights from his new book, Change the R

23 апр. 2025 г., 14:50:04 | Fast company - tech
20 years ago, this simple video rewired the way we share our lives online

The elephant enclosure at your local zoo is an interesting place to be. But until 20 years ago, it was somewhere you’d encounter in person—with reverence and intimacy. A video

23 апр. 2025 г., 12:30:06 | Fast company - tech
‘It is absolutely crushing to my business’: Trump’s tariffs hit Kickstarter campaigns hard

Curt Covert would love for people to play his latest board game—but with sky-high tariffs, he’s not sure anyone ever will.

“At 54%, I had a plan,” Covert tells Fast Company, ref

23 апр. 2025 г., 12:30:05 | Fast company - tech