Fix to https://huggingface.co/tiny-random/glm-5/discussions/1

#2

Set index_head_dim to 128 as in the original model config https://huggingface.co/zai-org/GLM-5/blob/main/config.json#L18

yujiepan changed pull request status to merged

Sign up or log in to comment