How Anthropic has doubled down on AI safety

Anthropic, which was formed by a group of safety-conscious defectors from OpenAI, spent 2023 establishing itself as one of just a handful of envelope-pushing developers of commercial AI models.

The company raised almost $7 billion in 2023 (from Amazon and Google, among others), and last October it told investors that it was generating revenue at a $100 million annualized run rate. In July, the startup launched the second major release of its LLM, dubbed Claude 2, with improved performance on standardized tests, a larger memory for text input, and improved computer coding ability.

Numerous AI app developers use Claude 2’s API (often alongside those of other state-of-the-art models) for its unique skills in text summary and generation. On the safety side, the company implemented a novel way of keeping Claude away from toxic or dangerous content—an approach the company calls “Constitutional AI.”

Instead of laboriously providing a model with human feedback, the researchers give a model a list of general principles (a “constitution”) to follow when creating its responses. A second AI then monitors the first, continually critiquing how well it follows the principles.

Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.

https://www.fastcompany.com/91033423/anthropic-most-innovative-companies-2024?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 11mo | Mar 19, 2024, 12:20:03 PM


Login to add comment

Other posts in this group

Credo AI’s vision for ethical and transparent AI governance

Brendan Vaughn, editor-in-chief of ‘Fast Company,’ interviews Credo AI’s CEO on AI governance trends at the World Economic Forum 2025.

https://www.fastcompany.com/91275783/credo-ais-vision-fo

Feb 10, 2025, 5:50:05 PM | Fast company - tech
AI summit in Paris brings together Big Tech and U.S. VP Vance

Major world leaders are meeting for an AI summit in Paris, where challenging diplomatic talks are expected as tech titans fight for dominance in the

Feb 10, 2025, 5:50:03 PM | Fast company - tech
Roblox joins $27 million industry nonprofit to support online safety

A group of internet businesses, including Roblox, Google, OpenAI, and Discord, have cofounded a nonprofit called Robust Open Online Safety Tools (ROOST).

The new organization will fund f

Feb 10, 2025, 3:30:08 PM | Fast company - tech
Chess.com is thinking three moves ahead with its friends and family subscription

Chess.com has a new subscription option for chess families and tight-knit players: a friends and family plan.

The site, where players around the world can face off against live opponents

Feb 10, 2025, 3:30:06 PM | Fast company - tech
Why tomorrow’s breakthroughs will come from polyintelligent thinking

In news outlets, business publications, and scholarly journals, there is a crescendo of commentary about the combined power of human intelligence and artificial intelligence. Without question, tha

Feb 10, 2025, 1:10:10 PM | Fast company - tech
Find the perfect free Zoom background at these 3 sites

Maybe I should begin this article by arguing that nothing spices up a mundane meeting like a creative, beautiful, or hilarious background for your Zoom calls. But the reality is that most of us ju

Feb 10, 2025, 6:20:04 AM | Fast company - tech
EV Winter is here. Carmakers are betting on a thaw

The move to electric vehicles is the auto industry’s biggest transformation since cars replaced horses early last century. Just about every traditional automaker is going through its own reckoning

Feb 9, 2025, 11:20:04 PM | Fast company - tech