, Elon Musk
Grok, Elon Musk’s AI chatbot, is now open source for researchers and developers thanks to xAI
Published
2 months agoon
The network architecture and base model weights of xAI’s Grok-1 LLM are available to the public
On March 17, Elon Musk’s artificial intelligence (AI) company, xAI, released the large language model (LLM) Grok-1 as open source. The billionaire made the announcement that the AI chatbot will be open-sourced last week on his social media site X, which was once known as Twitter. Developers and researchers can now access it. Notably, the xAI developers said that only the pre-trained LLM has been made available to the general public. This implies that although Grok lacks training data, you may still build upon it using the weights and network design.
“We are releasing the base model weights and network architecture of Grok-1, our large language model,” xAI wrote in a blog post announcing the open release. Grok-1 is a Mixture-of-Experts model with 314 billion parameters that was trained from scratch using xAI. The AI company also mentioned that the Apache 2.0 license is being used to distribute the LLM as open source software. GitHub is where interested parties can obtain the AI model.
Read also:-
The second-largest purchaser of electoral bonds is this company. They Made a Donation
The Apache 2.0 license permits both commercial use and modification and redistribution, according to a VentureBeat report. This implies that programmers can customize the LLM for certain uses, add to it, and market it. Developers will have to disclose any modifications made to the original code, and the model cannot be trademarked.
The version of Grok-1 that has been made accessible is from October 2023, before the model was trained using data from X, and this gives the Grok chatbot a distinct personality, even though a commercial license is being offered. This implies that obtaining the data will be the responsibility of any researchers or developers wishing to use the model.
The publicly available Grok-1 model, according to xAI, is a Mixture-of-Experts (MoE) model with 314 billion parameters. Compared to other LLMs in the public domain, like the Mistral 8x7B or Meta LLaMa 2, the parameter size is substantially higher. The AI’s context window grows as the parameter size increases. It may now respond with greater contextual accuracy and thoroughness as a result.
On November 3, 2023, Grok, a chatbot intended to rival the industry leaders, was introduced. Only a select group of individuals who bought the X Premium+ subscription had access to it. At the time, Musk also mentioned that Grok would receive a stand-alone app.
You may like
-
Kohli brings out alternative arsenal to counter spin bowling ahead
-
The Supreme Court rules that former Jharkhand Chief Minister Hemant Soren’s plea in a money laundering case was “infructuous.”
-
Janhvi Kapoor Wears A Red Cutout Dress Inspired By A Cricket Ball, Similar To Zendaya’s Movie-Themed Outfits
-
Two winners of the Miss USA pageant have resigned, citing disrespect and mental health issues.
-
Why Does MS Dhoni Have a Muscle Tear While Playing for CSK? The ‘Theory’ of an Ex-IPL Team Official Paints a Grim Image
-
पक्षी मित्र योजना में बांधे परिंडे