markussagen commited on
Commit
98bc749
1 Parent(s): c03980e

Add model card tags

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -1,3 +1,12 @@
 
 
 
 
 
 
 
 
 
1
  ## XLM-R Longformer Model / XLM-Long
2
  XLM-R Longformer (or XLM-Long for short) is a XLM-R model that has been extended to allow sequence lengths up to 4096 tokens, instead of the regular 512. The model was pre-trained from the XLM-RoBERTa checkpoint using the Longformer [pre-training scheme](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) on the English WikiText-103 corpus.
3
 
 
1
+ ---
2
+ tags:
3
+ - longformer
4
+ language: multilingual
5
+ license: apache-2.0
6
+ datasets:
7
+ - wikitext
8
+ ---
9
+
10
  ## XLM-R Longformer Model / XLM-Long
11
  XLM-R Longformer (or XLM-Long for short) is a XLM-R model that has been extended to allow sequence lengths up to 4096 tokens, instead of the regular 512. The model was pre-trained from the XLM-RoBERTa checkpoint using the Longformer [pre-training scheme](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) on the English WikiText-103 corpus.
12