Breaking: A Big Tech company is ramping up its AI development. (Whaaat??) In this case, the protagonist of this now-familiar tale is Meta, which Reuters reports is testing its first in-house chip for AI training. The idea is to lower its gargantuan infrastructure costs and reduce its dependence on NVIDIA (a company that apparently brings out Mark Zuckerberg's "adult language" side). If all goes well, Meta hopes to use it for training by 2026.
Meta has reportedly kicked off a small-scale deployment of the dedicated accelerator chip, which is designed to specialize in AI tasks (and is, therefore, more power-efficient than general-purpose NVIDIA GPUs). The deployment began after the company completed its first "tape-out," the phase in silicon development where a complete design is sent for a manufacturing test run.
The chip is part of the Meta Training and Inference Accelerator (MTIA) series, the company's family of custom in-house silicon focused on generative AI, recommendation systems and advanced research.
Last year, the company started using an MTIA chip for inference, a predictive process that happens behind the scenes in AI models. Meta began using the inference one for its Facebook and Instagram news feed recommendation systems. Reuters reports that it plans to start using the training silicon for that as well. The long-term plan for both chips is said to begin with recommendations and eventually use them for generative products like the Meta AI chatbot.
The company is one of NVIDIA's biggest customers after placing orders for billions of dollars' worth of GPUs in 2022. That was a pivot for Meta after it bailed on a previous in-house inference silicon that failed a small-scale test deployment — much like the one it's doing now for the training chip.
This article originally appeared on Engadget at https://www.engadget.com/ai/meta-is-reportedly-testing-its-first-in-house-ai-training-chip-174550664.html?src=rss https://www.engadget.com/ai/meta-is-reportedly-testing-its-first-in-house-ai-training-chip-174550664.html?src=rssLogin to add comment
Other posts in this group
We've come a long way from the days of discarding smartphones as soon as a new model comes out. Many shoppers are now demanding devices that will last for years, and they are being more conscientio
It's no secret that Spotify isn't a big money
NASA's SPHEREx observatory is
Electric vehicle company Rivian is rolling out new software today. The lead feature is Enhanced Highway Assist, which controls steering, acceleration, and braking on compatible highways. It relies
One day after X went down for hours, security researchers are throwing cold water on Elon Musk’s public comments about who might be behind the DDoS attack. On Monday, as X was still struggling to
iRobot just announced some new Roomba vacuums and they feature interesting capabilities. The Roomba 205 DustCompactor Combo Robot is being advertised as "the industry's first onboard mechanical deb
The Remote Desktop app for Windows is (almost) dead; long live the Windows
