Model index
SpaceXAI·Grok

Grok-1 Base

Grok-1’s raw pretrained base weights: a 314B MoE with roughly 25% active per token, not the Grok chat model.

LegacyLanguageOpen weights
MODEL NUMBER297
First public date
2024-03-17
Organization
SpaceXAI
Family
Grok
01

Specifications

Only published specifications are shown.

Total parameters
314B
Architecture
MoE
Input modalities
Text
Output modalities
Text
Open weights
Yes
License
Apache-2.0
Status
Legacy
02

Overview

Release dates

— Grok-1 Base released model weights. ↗

03

Architecture & capabilities

04

Release history

Open weights

Grok-1 Base released model weights.

View source
05

Related models

Select a card to view the related model.

06

Sources

Suggest a correction

Copy this template, add the field, proposed value, and primary source, and share it with the archive maintainer.