Release dates
— MiniMax-Text-01 released model weights. ↗
MiniMax-Text-01
A hybrid MoE using Lightning Attention, with 456B total and 45.9B active parameters, trained at 1M context and extrapolatable to 4M.
MODEL NUMBER304
- First public date
- 2025-01-15
- Organization
- MiniMax
- Family
- MiniMax M
01
Specifications
Only published specifications are shown.
- Total parameters
- 456B
- Active parameters
- 45.9B
- Architecture
- Hybrid
- Context
- 1,000,000 tokens
- Input modalities
- Text
- Output modalities
- Text
- Open weights
- Yes
- Status
- Legacy
02
Overview
03
Architecture & capabilities
Attention
Lightning AttentionSoftmax Attention
Model capabilities
Long context
04
Release history
MiniMax-Text-01 released model weights.
View source05
Related models
Select a card to view the related model.
06
Sources
Suggest a correction
Copy this template, add the field, proposed value, and primary source, and share it with the archive maintainer.