应该是hidden_state[:, -1]
Fixed in https://huggingface.co/THUDM/glm-4-9b-chat/commit/12c80499bc07e21c05c11ee2a6035371bf53f1a6
· Sign up or log in to comment