fnlp
/

moss-moon-003-sft

Text Generation

Model card Files Files and versions Community

txsun commited on Apr 20, 2023

Commit

490560a

•

1 Parent(s): aedb7d4

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -30,7 +30,7 @@
     "normalized": true,
     "rstrip": false,
     "single_word": false
-  }
   "auto_map": {
     "AutoTokenizer": [
       "tokenization_moss.MossTokenizer",

     "normalized": true,
     "rstrip": false,
     "single_word": false
+  },
   "auto_map": {
     "AutoTokenizer": [
       "tokenization_moss.MossTokenizer",