Grok, Elon Musk’s AI chatbot, is now open source for researchers and developers thanks to xAI

The network architecture and base model weights of xAI’s Grok-1 LLM are available to the public

On March 17, Elon Musk’s artificial intelligence (AI) company, xAI, released the large language model (LLM) Grok-1 as open source. The billionaire made the announcement that the AI chatbot will be open-sourced last week on his social media site X, which was once known as Twitter. Developers and researchers can now access it. Notably, the xAI developers said that only the pre-trained LLM has been made available to the general public. This implies that although Grok lacks training data, you may still build upon it using the weights and network design.

“We are releasing the base model weights and network architecture of Grok-1, our large language model,” xAI wrote in a blog post announcing the open release. Grok-1 is a Mixture-of-Experts model with 314 billion parameters that was trained from scratch using xAI. The AI company also mentioned that the Apache 2.0 license is being used to distribute the LLM as open source software. GitHub is where interested parties can obtain the AI model.

Read also:-
The second-largest purchaser of electoral bonds is this company. They Made a Donation

The Apache 2.0 license permits both commercial use and modification and redistribution, according to a VentureBeat report. This implies that programmers can customize the LLM for certain uses, add to it, and market it. Developers will have to disclose any modifications made to the original code, and the model cannot be trademarked.

The version of Grok-1 that has been made accessible is from October 2023, before the model was trained using data from X, and this gives the Grok chatbot a distinct personality, even though a commercial license is being offered. This implies that obtaining the data will be the responsibility of any researchers or developers wishing to use the model.

The publicly available Grok-1 model, according to xAI, is a Mixture-of-Experts (MoE) model with 314 billion parameters. Compared to other LLMs in the public domain, like the Mistral 8x7B or Meta LLaMa 2, the parameter size is substantially higher. The AI’s context window grows as the parameter size increases. It may now respond with greater contextual accuracy and thoroughness as a result.

On November 3, 2023, Grok, a chatbot intended to rival the industry leaders, was introduced. Only a select group of individuals who bought the X Premium+ subscription had access to it. At the time, Musk also mentioned that Grok would receive a stand-alone app.