Model index
Z.ai·GLM

ChatGLM2-6B

The second-generation bilingual dialogue model, using multi-query attention and expanding context to 32K.

LegacyLanguageOpen weights
MODEL NUMBER278
First public date
2023-06-25
Organization
Z.ai
Family
GLM
01

Specifications

Only published specifications are shown.

Total parameters
6B
Architecture
Dense
Context
32,768 tokens
Input modalities
Text
Output modalities
Text
Open weights
Yes
License
ChatGLM2 Model License↗
Status
Legacy
02

Overview

Release dates

— ChatGLM2-6B released model weights. ↗

03

Specifications alongside predecessor

Compared with ChatGLM-6B ↗

PreviousChatGLM-6B6.2B · 2K ctx
CurrentChatGLM2-6B6B · 33K ctx
04

Architecture & capabilities

Attention

MQA
05

Release history

Open weights

ChatGLM2-6B released model weights.

View source
06

Related models

Select a card to view the related model.

07

Sources

Suggest a correction

Copy this template, add the field, proposed value, and primary source, and share it with the archive maintainer.