add padding_side in tokenizer _pad() method

#22

by framolfese - opened Jul 10

←

Jul 10

No description provided.

Jul 10

I have added the padding_side parameter to the tokenizer _pad() function to be compliant with glm-4-9b-chat tokenizer: https://huggingface.co/THUDM/glm-4-9b-chat/blob/main/tokenization_chatglm.py

framolfese changed pull request status to open Jul 10

ZHANGYUXUAN-zR changed pull request status to merged Jul 10

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment