Encoder only version of the ANKH large model (paper). The encoder only version is ideal for protein representation tasks.

To download

from transformers import T5EncoderModel, AutoTokenizer

model_path = 'Synthyra/ANKH_large'
model = T5EncoderModel.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)

We are working on implementing a version of T5 based PLMs with Flex attention once learned relative position bias is supported (used in T5). Stay tuned.

Downloads last month: 5

Safetensors

Model size

1.15B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Synthyra/ANKH_large

Pretrained PLMs

Collection

11 items • Updated Jan 16