How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 2d | 18 mars 2025, 11:50:23


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

March Madness: Disrupter bets $1 million that AI bracket will beat pro gambler

Perhaps the surest sign that artificial intelligence really is taking over the world will come the day it wins your favori

20 mars 2025, 01:10:02 | Fast company - tech
DOGE is demanding ‘wins’ from this elite government tech group—while promising major layoffs

Technology Transformation Services (TTS), a high-tech consulting group housed within the General Services Administration (GSA), is tasked with helping agencies modernize their internal systems and

19 mars 2025, 18:10:03 | Fast company - tech
What happened to Netflix’s big bet on gaming?

In 2021, Netflix’s executive vice president of game development Mike Verdu made a big

19 mars 2025, 15:40:09 | Fast company - tech
TSMC’s massive Arizona chips project praised by Taiwan’s president

Taiwan’s President William Lai Ching-te said that a Taiwanese semiconductor

19 mars 2025, 15:40:08 | Fast company - tech
The viral reckoning at Republican town halls

“Tyranny is rising in the White House, and a man has declared himself our king,” a voter tells Georgia Rep. Rich McCormick in a now-viral

19 mars 2025, 13:30:04 | Fast company - tech
‘Don’t get sidetracked by the headlines’: Betterment CEO Sarah Levy offers her investing advice

Recent market swings are causing whiplash for everyday investors. Sarah Levy, CEO of the digital investment platform Betterment, offers her advice during this volatile moment. Amid the noise aroun

19 mars 2025, 11:10:05 | Fast company - tech