File size: 453 Bytes
70e6b89 83317ab 70e6b89 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
license: mit
base_model:
- entropy/roberta_zinc_480m
tags:
- chemistry
---
# Roberta Zinc Compression Head
This model is trained to compress embeddings generated by the [roberta_zinc_480m](https://huggingface.co/entropy/roberta_zinc_480m) model from the native size of 768 to compressed sizes 512, 256, 128, 64, and 32.
The compressed embeddings are trained to maintain cosine similarity computed using the native embeddings.
---
license: mit
--- |