How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 30d | 18 mars 2025, 11:50:23


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

Tesla’s first quarter EV registrations slump 15.1% in California

Tesla‘s electric-vehicle registrations in California dropped 15.1% during the first quarter, industry data showed, signaling an

16 avr. 2025, 22:50:04 | Fast company - tech
TikTok starts testing Footnotes, a new feature that looks a lot like X’s Community Notes

TikTok is launching its own version of community notes on the platform, called “Footnotes.”

The crowd-sourced approach to moderation, where users add additional context to p

16 avr. 2025, 20:30:10 | Fast company - tech
‘I would get way more views if I didn’t help thousands of people’: MrBeast defends his philanthropy‑as‑content strategy

MrBeast has again defended his philanthropy‑as‑content, clapping back at critics who say he is “only in it for the views.”

On April 13, in a post on X, Jimmy Donaldson—better k

16 avr. 2025, 20:30:09 | Fast company - tech
Zuckerberg once floated spinning off Instagram over antitrust fears, email reveals in trial

Meta CEO Mark Zuckerberg once considered separating Instagram from its parent company due to worries about antitrust litigation, a

16 avr. 2025, 18:20:05 | Fast company - tech
Trump’s China tariffs spark viral TikTok work-arounds

President Trump’s trade wars have officially landed on TikTok.

U.S. TikTok users’ For You Pages are being flooded with videos from Chinese manufacturers urging Americans to bypass

16 avr. 2025, 15:50:06 | Fast company - tech
The ‘chicken jockey’ trend is turning ‘Minecraft’ screenings into total chaos

If you’re planning to see the new Minecraft movie and haven’t heard of the viral “chicken jockey” trend w

16 avr. 2025, 13:40:03 | Fast company - tech
Docusign expands beyond signatures with new AI-powered contract management tools

For about 20 years, Docusign has been known as a tool for collecting digital signatures—helping businesses replace paper forms with electronic versions that are just as secure and legally binding.

16 avr. 2025, 13:40:03 | Fast company - tech