01-ai
/

Yi-1.5-34B-Chat-16K

Text Generation

text-generation-inference

Model card Files Files and versions

mia00 commited on Jun 5, 2024

Commit

bbd743f

·

verified ·

1 Parent(s): b25e4ca

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +6 -6

tokenizer.json CHANGED Viewed

@@ -2116,17 +2116,17 @@
         },
         "content": " "
       },
-      {
-        "type": "Strip",
-        "content": " ",
-        "start": 1,
-        "stop": 0
-      },
       {
         "type": "ByteFallback"
       },
       {
         "type": "Fuse"
       }
     ]
   },

         },
         "content": " "
       },
       {
         "type": "ByteFallback"
       },
       {
         "type": "Fuse"
+      },
+      {
+        "type": "Strip",
+        "content": " ",
+        "start": 1,
+        "stop": 0
       }
     ]
   },