Meta Platforms Inc. CEO Mark Zuckerberg said on Thursday that the company is currently training its new large language model Llama 3, which is intended to compete with OpenAI's GPT-4.
"Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit. We're bringing our two major AI research efforts (FAIR and GenAI) closer together to support this," Zuckerberg said in an Instagram post.
Additionally, the CEO revealed that the company is "building massive compute infrastructure to support our future roadmap" that will include 350,000 Nvidia H100s by the end of the year.