AI is the latest tool in the cybersecurity cat-and-mouse game

Welcome to AI DecodedFast Company’s weekly newsletter that breaks down the most important news in the world of AI. You can sign up to receive this newsletter every week here.

Fraud is getting smarter, thanks to AI

AI-powered cybercrimes are on the rise, according to a recent report from cybersecurity firm Arkose Labs, letting hackers accelerate their attacks and making automated fraud more humanlike and harder to spot than ever. 

One of the best defenses, Arkose and others in the industry say, is more AI. But only about one in five enterprises reported being “very well prepared” to deploy their own AI to defend against cyberattacks, according to the report, even though 88% say they’ve seen “a significant increase in AI-powered bot attacks” in the past two years.

Bots are being used by hackers to take over legitimate accounts at target companies andto create numerous bogus accounts, to take advantage of sign-up bonuses, according to the report. And some bots have even begun to target large language model systems themselves. They’re submitting their own prompts to AI to extract data to train their own models or even relaying prompts on behalf of their own customers, effectively selling their own subscriptions to AI services without authorization.

Other studies have recently found that generative AI can be used to automate phishing and social-engineering attacks. A recent report from Morgan Stanley pointed out that the technology can be used to create more targeted phishing messages faster than humans, meaning the attacks can not only be launched more quickly, they can be more effective. Some AI algorithms can also make AI more adept at guessing passwords, according to the report.

All that has led cybersecurity companies like Arkose Labs to develop new technology specifically designed to thwart modern bots. About three in five organizations believe AI to be essential to security threat response, according to a Capgemini report released Tuesday.

“The use of AI and Gen AI has so far proved to be a double-edged sword,” said Marco Pereira, global head for cybersecurity, cloud infrastructure services, at Capgemini, in a statement. “While it introduces unprecedented risks, organizations are increasingly relying on AI for faster and more accurate detection of cyber incidents.” 

But AI-powered attacks are still a growing challenge—and in many cases, hackers may have a head start on harnessing the technology. “Enterprises are operating in an AI economy where bad actors leverage the technology for high ROI attacks while legitimate businesses lag due to internal hurdles like governance and approval processes,” said Arkose Labs CFO Frank Teruel in a statement.

Keeping generative AI itself secure is also an increasingly big business. Prompt Security, which helps businesses avoid data leaks and harmful content while using generative AI, announced Wednesday it had raised $18 million in a Series A funding round.

Commission Proposes “Manhattan Project” for AI

Among the recommendations listed in the annual report released to Congress Tuesday by the U.S.-China Economic and Security Review Commission: a call to establish “a Manhattan Project-like program” aimed at developing artificial general intelligence.

“AGI is generally defined as systems that are as good as or better than human capabilities across all cognitive domains and would surpass the sharpest human minds at every task,” according to the report, which suggests Congress could provide funding for AI, data, and cloud computing companies to keep the U.S. in the lead on AI.

Whether today’s technology is anywhere close to the path to artificial general intelligence is hotly debated in AI circles, but the Commission seems determined to ensure that if such superintelligent AI does pop up any time soon, it does so on U.S. soil. Commission member Jacob Helberg—a senior advisor to Palantir CEO Alex Karp, generally known for his hawkish views on China—told Reuters that China is “racing toward AGI” and suggested such steps as making it easier to build data centers could boost U.S. AI development. AI data centers have seen pushback lately amid concerns that their high energy list could raise consumer power bills, accelerate climate change, and cause other environmental issues. 

In general, China is making rapid progress in AI, according to the Commission’s report, though it still lags behind the U.S. and its allies in developing AI models and, especially, in producing the cutting-edge chips needed to power AI. The U.S. and allies, such as chipmaking powerhouse Taiwan, have worked to restrict China’s access to the latest processing hardware and the technology needed to make it.

“China is aggressively working to address this deficit,” according to the report.

Looking at the next big things in AI

Fast Company released its 2024 Next Big Things in Tech honorees this week, which includes a number of companies working in artificial intelligence

Among those companies recognized by Fast Company is Bellwether, a company incubated at Alphabet’s X research lab that processes satellite imagery with AI to help respond to disasters; Enko Chem, which uses AI to design new, environmentally friendly weedkillers for agricultural use; and Qualcomm, whose Snapdragon chips are enabling new AI features on more than 100 mobile devices from manufacturers including Samsung, Honor, and Xiaomi.

Other honorees included Cerebras Systems, which is building AI supercomputers based on chips it says are speedier and more power-efficient than the GPUs commonly used for generative AI; and Nanotronics Imaging, which says its AI-powered computer-chip manufacturing plants are more efficient and significantly cheaper to build than traditional plants. 

You can find the complete list here.

More AI coverage from Fast Company

Want exclusive reporting and trend analysis on technology, business innovation, future of work, and design? Sign up for Fast Company Premium.

https://www.fastcompany.com/91232928/ai-is-the-latest-tool-in-the-cybersecurity-cat-and-mouse-game?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creată 1mo | 21 nov. 2024, 19:10:02


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

AI use cases are going to get even bigger in 2025

Over the past two years, generative AI has dominated tech conversations and media headlines. Tools like ChatGPT, Gemini, Midjourney, and Sora captured imaginations with their ability to create tex

25 dec. 2024, 07:30:03 | Fast company - tech
YouTube TV price hike got you down? 5 free alternatives

Was YouTube TV’s recent price increase the straw that broke the camel’s back for you? Wh

25 dec. 2024, 07:30:02 | Fast company - tech
TikTok is full of bogus, potentially dangerous medical advice

TikTok is the new doctor’s office, quickly becoming a go-to platform for medical advice. Unfortunately, much of that advice is pretty sketchy.

A new report by the healthcare software fi

25 dec. 2024, 00:30:03 | Fast company - tech
45 years ago, the Walkman changed how we listen to music

Back in 1979, Sony cofounder Masaru Ibuka was looking for a way to listen to classical music on long-haul flights. In response, his company’s engineers dreamed up the Walkman, ordering 30,000 unit

24 dec. 2024, 15:10:04 | Fast company - tech
The greatest keyboard never sold

Even as the latest phones and wearables tout speech recognition with unprecedented accuracy and spatial computing products flirt with replacing tablets and laptops, physical keyboards remain belov

24 dec. 2024, 12:50:02 | Fast company - tech
The 25 best new apps of 2024

One of the most pleasant surprises about this year’s best new apps have nothing to do with AI.

While AI tools are a frothy area for big tech companies and venture capitalists, ther

24 dec. 2024, 12:50:02 | Fast company - tech
The future belongs to systems of action

The world of enterprise tech is built on sturdy foundations. For decades, systems of record—the databases, customer relationship management (CRM), and enterprise resource planning (ERP) platforms

23 dec. 2024, 22:50:06 | Fast company - tech