SpaceXAI·Grok

Grok-1 Base

Grok-1’s raw pretrained base weights: a 314B MoE with roughly 25% active per token, not the Grok chat model.

LegacyLanguageOpen weights

MODEL NUMBER239

Specifications

Only published specifications are shown.

Total parameters

314B

Architecture

MoE

Input modalities

Text

Output modalities

Text

Open weights

Yes

License

Apache-2.0

Status

Legacy

Grok-1’s raw pretrained base weights: a 314B MoE with roughly 25% active per token, not the Grok chat model.

2024-03-17Open weights

Grok-1 Base released model weights.

Select a card to view the related model.