Experts share their views on DeepSeek. Credit: CFOTO / Future Publishing / Getty Images All of a sudden, DeepSeek is everywhere.
Its R1 model is open source, allegedly trained for a fraction of the cost of other AI models, and is just as good, if not better than ChatGPT.
This lethal combination hit Wall Street hard , causing tech stocks to tumble, and making investors question how much money is needed to develop good AI models. DeepSeek engineers claim R1 was trained on 2,788 GPUs which cost around $6 million, compared to OpenAI’s GPT-4 which reportedly cost $100 million to train.
DeepSeek’s cost efficiency also challenges the idea that larger models and more data leads to better performance. Amidst the frenzied conversation about DeepSeek’s capabilities, its threat to AI companies like OpenAI, and spooked investors, it can be hard to make sense of what’s going on. But AI experts with veteran experience have weighed in with valuable perspectives. DeepSeek proves what AI experts have been saying for years: bigger isn’t better
Hampered by trade restrictions and access to Nvidia GPUs, China-based DeepSeek had to get creative in developing and training R1. That they were able to accomplish this feat for only $6 million (which isn’t a lot of money in AI terms) was a revelation to investors.
But AI experts weren’t surprised. "At Google, I asked why they were fixated on building THE LARGEST model. Why are you going for size? What function are you trying to achieve? Why is the thing you were upset about that you didn’t have THE LARGEST model? They responded by firing me," posted Timnit Gebru, who was famously terminated from Google for calling out AI bias, on X. Tweet may have been deleted Hugging Face ‘s climate and AI lead Sasha Luccioni pointed out how AI investment is precariously built on marketing and hype. "It’s wild that hinting that a single (high-performing) LLM is able to achieve that performance without brute-forcing the shit out of thousands of GPUs is enough to cause this," said Luccioni. Tweet may have been deleted Clarifying why DeepSeek R1 is such a […]
Fallbrook couple had their children help them harvest magic mushrooms: DA
A baggie containing so-called magic mushrooms The U.S. Attorney’s Office,
