ChatGPT was the tech story of 2023 because it put the power of language AI directly into the hands of consumers. And yet ChatGPT was just the outside wrapper, the user interface, sitting atop a stack of foundation models, server chips, and other enabling technologies all working in the background. And it’s from within the realm of these enabling technologies that some of 2023’s most meaningful advancements came.
ChatGPT got a brain upgrade with the addition of OpenAI’s new GPT-4 model in March 2023. GPT-4 immediately outperformed competing models from Google, Meta, and Anthropic on a range of benchmarks, delivering more factual answers with fewer “hallucinations” and better reasoning and problem solving (it reached human-level scores on standardized tests), with enhanced safety guardrails. Importantly, GPT-4 is multimodal; that is, it can generate responses from text, image, and audio input.
The surprising performance of LLMs like GPT-4 owes a lot to supersizing not just the models but also the amount of computing power used to train them. Training GPT-4 reportedly required between 10,000 and 25,000 of Nvidia’s A100 graphics processing units (GPUs). In fact, the GPUs used to train the biggest LLMs have come almost exclusively from Nvidia, whose chips have become table stakes for researchers trying to build toward state-of-the-art performance.
Even as many enterprises struggled to apply generative AI in meaningful ways in 2023, the tech industry sunk billions into the race toward bigger and smarter models. Meta made big waves in 2023 with the release of its family of Llama LLMs on the open-source repository Hugging Face (Llama models have been downloaded more than 30 million times). In July, Anthropic debuted its new Claude 2 LLM, which was immediately recognized for its nuanced text generation and summarization skill and its capacity to remember hundreds of pages of prompt information. Cohere continued pushing on the performance of its language models, which Amazon AWS began distributing through its Bedrock AI platform in July.
While 2023 was a big year for advances in the biggest component parts of the AI hardware and software stack—LLMs and GPUs—a whole ecosystem of supporting infrastructure is just beginning to define itself. It’s quite possible that 2024’s biggest stories will concern smaller models that run on phones, or new governance systems that hold AI systems true to company policies, transparency requirements from laws like the EU’s AI Act, and state laws on data privacy, bias, and discrimination.
Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.
Войдите, чтобы добавить комментарий
Другие сообщения в этой группе
An unsubstantiated online theory has recently taken hold, claiming that family vloggers are fleeing Los Angeles to escape newly introduced California laws designed to protect children featured in
At a press conference in the Oval Office earlier this month, Elon Musk—a billionaire who is not, at least formally, the President of the United States—was asked how the Department of Government Ef
Last Energy, a nuclear upstart backed by an Elon Musk-linked venture capital fund, says it plans to construct 30 microreactors on a site in Texas to supply electricity to data centers across the s
Democratic lawmakers demanded answers from billionaire Elon Musk’s Department of Govern
For years, the creator economy has become increasingly accepted as the future of media. These days, makeup tutorials on TikTok could have the same impact for a brand as a multi-million dollar mark
For more than two decades, users have turned to search engines like Google, typed in a query, and received a familiar list of 10 blue links—the gateway to the wider web. Ranking high on that list,
