Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,53 @@
|
|
1 |
---
|
2 |
datasets:
|
3 |
- genbio-ai/transcript_isoform_expression_prediction
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
---
|
5 |
# Bi-modal model for RNA isoform expression prediction
|
6 |
|
7 |
-
|
8 |
* Input: dna_seq, rna_seq
|
9 |
* Output: expression level in 30 tissues
|
10 |
|
11 |
-
Backbones:
|
12 |
-
* DNA: Enformer (fully finetuning)
|
13 |
-
* RNA: AIDO.RNA-1.6B-CDS (lora finetuning)
|
14 |
|
15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
datasets:
|
3 |
- genbio-ai/transcript_isoform_expression_prediction
|
4 |
+
metrics:
|
5 |
+
- spearmanr
|
6 |
+
- r_squared
|
7 |
+
base_model:
|
8 |
+
- genbio-ai/AIDO.RNA-1.6B-CDS
|
9 |
+
- EleutherAI/enformer-official-rough
|
10 |
+
tags:
|
11 |
+
- biology
|
12 |
---
|
13 |
# Bi-modal model for RNA isoform expression prediction
|
14 |
|
15 |
+
## RNA isoform expression prediction
|
16 |
* Input: dna_seq, rna_seq
|
17 |
* Output: expression level in 30 tissues
|
18 |
|
|
|
|
|
|
|
19 |
|
20 |
+
## Model architecture
|
21 |
+
* Backbones:
|
22 |
+
* DNA: Enformer (fully finetuning)
|
23 |
+
* RNA: AIDO.RNA-1.6B-CDS (lora finetuning)
|
24 |
+
* Fusion method: concat fusion
|
25 |
+
|
26 |
+
|
27 |
+
## Usage
|
28 |
+
|
29 |
+
**Download model**
|
30 |
+
```python
|
31 |
+
from huggingface_hub import snapshot_download
|
32 |
+
from pathlib import Path
|
33 |
+
|
34 |
+
model_name = "genbio-ai/AIDO.MM-Enformer-RNA-1.6B-CDS-ConcatFusion-rna-isoform-expression-ckpt"
|
35 |
+
genbio_models_path = Path.home().joinpath('genbio_models', model_name)
|
36 |
+
genbio_models_path.mkdir(parents=True, exist_ok=True)
|
37 |
+
snapshot_download(repo_id=model_name, local_dir=genbio_models_path)
|
38 |
+
```
|
39 |
+
|
40 |
+
**Evaluation script**
|
41 |
+
|
42 |
+
Once you download the model, you can use the model in [ModelGenertor](https://github.com/genbio-ai/ModelGenerator) using the following script:
|
43 |
+
```bash
|
44 |
+
CONFIG_FILE=... # put the config file path here
|
45 |
+
CKPT_PATH=... # put the model checkpoint path here
|
46 |
+
|
47 |
+
mgen test --config $CONFIG_FILE \
|
48 |
+
--data.batch_size 16 \
|
49 |
+
--trainer.logger null \
|
50 |
+
--model.strict_loading False \
|
51 |
+
--model.reset_optimizer_states True \
|
52 |
+
--ckpt_path $CKPT_PATH
|
53 |
+
```
|