RaphaelMourad commited on
Commit
27939c7
·
verified ·
1 Parent(s): 2fda03b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -10,7 +10,8 @@ tags:
10
 
11
  The Jamba-DNA-v1-134M-hg38 Large Language Model (LLM) is a pretrained generative DNA sequence model with 134M parameters.
12
  It is derived from Jamba model, which was simplified for DNA: the number of layers and the hidden size were reduced.
13
- The model was pretrained using 10kb DNA sequences from the hg38 human genome assembly.
 
14
 
15
  ## Model Architecture
16
 
 
10
 
11
  The Jamba-DNA-v1-134M-hg38 Large Language Model (LLM) is a pretrained generative DNA sequence model with 134M parameters.
12
  It is derived from Jamba model, which was simplified for DNA: the number of layers and the hidden size were reduced.
13
+ The model was pretrained using 100kb DNA sequences from the hg38 human genome assembly.
14
+ In comparison, Mistral DNA models were trained using 10 kb DNA sequences, so there are able to deal with a small genomic sequence context.
15
 
16
  ## Model Architecture
17