hdallatorre commited on
Commit
e7798fb
1 Parent(s): e7e9ef6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -37,6 +37,13 @@ pip install --upgrade git+https://github.com/huggingface/transformers.git
37
  ```
38
 
39
  A small snippet of code is given here in order to retrieve both logits and embeddings from a dummy DNA sequence.
 
 
 
 
 
 
 
40
  ```python
41
  # Load model and tokenizer
42
  from transformers import AutoTokenizer, AutoModel
 
37
  ```
38
 
39
  A small snippet of code is given here in order to retrieve both logits and embeddings from a dummy DNA sequence.
40
+ ```
41
+ ⚠️ The maximum sequence length is set by default at the training length of 30,000 nucleotides, or 5001 tokens (accounting for the CLS token). However, Segment-NT has been
42
+ shown to generalize up to sequences of 50,000 bp. In case you need to infer on sequences between 30kbp and 50kbp, make sure to change the `rescaling_factor` argument in
43
+ the config to `num_dna_tokens_inference / max_num_tokens_nt` where `num_dna_tokens_inference` is the number of tokens at inference (i.e 6669 for a sequence of 40008 base
44
+ pairs) and `max_num_tokens_nt` is the max number of tokens on which the backbone nucleotide-transformer was trained on, i.e `2048`.
45
+ ```
46
+
47
  ```python
48
  # Load model and tokenizer
49
  from transformers import AutoTokenizer, AutoModel