← Back to journal

xAI releases Grok-1 weights

xAI released the base weights and architecture for its 314 billion parameter mixture-of-experts model under Apache 2.0.

xAI released Grok-1's base weights and architecture under the Apache 2.0 license. It was a raw pretraining checkpoint rather than the conversational product on X.

A 314 billion parameter open release was not convenient for most people to run, but it put a large commercial model into the public research ecosystem. That distinction is worth keeping in the record.