InstaDeepAI
/

segment_nt

Feature Extraction

Model card Files Files and versions Community

hdallatorre commited on Mar 4

Commit

2899450

•

1 Parent(s): 7962681

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -1,6 +1,6 @@
 {
   "clean_up_tokenization_spaces": true,
   "eos_token": null,
-  "model_max_length": 2048,
   "tokenizer_class": "EsmTokenizer"
 }

 {
   "clean_up_tokenization_spaces": true,
   "eos_token": null,
+  "model_max_length": 5001,
   "tokenizer_class": "EsmTokenizer"
 }