Code

fix tokenizer of chatglm2#2711

Code

Merged

merrymercy merged 4 commits intolm-sys:mainlm-sys/FastChat:mainfrom wangshuai09:dev_fix_tokenizer_of_chatglm2wangshuai09/FastChat:dev_fix_tokenizer_of_chatglm2Copy head branch name to clipboardNov 22, 2023

+4-1

Commits

Commits on Nov 22, 2023

• add padding_side argument

  wangshuai09

  committed
  60f6d75

  Copy full SHA for 60f6d75

• add padding_side argument

  wangshuai09

  committed
  7bcfdcf

  Copy full SHA for 7bcfdcf

• format check

  wangshuai09

  committed
  958011d

  Copy full SHA for 958011d

• fix

  wangshuai09

  committed
  64c930f

  Copy full SHA for 64c930f