Spaces:

AshtonIsNotHere
/

xlmr-longformer_comparison

Runtime error

AshtonIsNotHere commited on Feb 3, 2023

Commit

7c1a2ad

•

1 Parent(s): b840e20

Fix join

Files changed (1) hide show

app.py CHANGED Viewed

@@ -55,7 +55,7 @@ def xlmr_base_fn(text):
         truncated_text = ''.join(tokens[lbound:rbound])
         # Handle lowbar from xlmr tokenizer
-        truncated_text = ''.join([x if ord(x) != 9601 else ' ' for x in result])
     else:
         truncated_text = text

         truncated_text = ''.join(tokens[lbound:rbound])
         # Handle lowbar from xlmr tokenizer
+        truncated_text = ''.join([x if ord(x) != 9601 else ' ' for x in truncated_text])
     else:
         truncated_text = text