Z.ai·GLM

ChatGLM2-6B

The second-generation bilingual dialogue model, using multi-query attention and expanding context to 32K.

LegacyLanguageOpen weights

MODEL NUMBER220

Specifications

Only published specifications are shown.

Total parameters

Architecture

Dense

Context

33K

Input modalities

Text

Output modalities

Text

Open weights

Yes

Status

Legacy

The second-generation bilingual dialogue model, using multi-query attention and expanding context to 32K.

PreviousChatGLM-6B6.2B · 2K ctx

CurrentChatGLM2-6B6B · 33K ctx

MQA

2023-06-25Open weights

ChatGLM2-6B released model weights.

Select a card to view the related model.