How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 7d | Mar 18, 2025, 11:50:23 AM


Login to add comment

Other posts in this group

Otter’s new AI agents are built to boost sales and streamline meetings

Otter, the AI-powered meeting assistant and transcription service, is introducing a new AI agent capable of answering spoken questions from meeting participants in r

Mar 25, 2025, 3:30:05 PM | Fast company - tech
Waymo is expanding its robotaxi service to D.C. next year

Waymo, Alphabet’s autonomous vehicle company, plans to expand its ride-hailing service, Waymo One

Mar 25, 2025, 1:10:08 PM | Fast company - tech
California lawmakers take on ‘surveillance pricing’ as FTC retreats

You pay $75 more for your hotel room than the guest in an identical room next to yours. A friend is charged an extra $10 while online shopping for the same item. The difference in these prices isn

Mar 25, 2025, 1:10:07 PM | Fast company - tech
Samsung CEO Han Jong-Hee, head of consumer electronics, dies at 63

Han Jong-Hee, a senior Samsung Electronics executive credited with elevating the

Mar 25, 2025, 1:10:06 PM | Fast company - tech
These genetically engineered houseplants are 30 times better at clearing toxins

It’s not every day that microbial genetics leads to a chic influencer party in Los Angeles. Yet there stood Patrick Torbey, the lone scientist in a plant-filled wine bar, addressing a roomful of s

Mar 25, 2025, 10:50:03 AM | Fast company - tech
‘I can’t stop’: Diners are stealing from restaurants—and posting about it on TikTok

Restaurant diners can be a sticky-fingered bunch. Who hasn’t been tempted to slip a particularly nice cocktail glass or a tiny saltshaker into their bag after lunch?

But as dining out ge

Mar 25, 2025, 10:50:02 AM | Fast company - tech