Add Galactica model
### Model description

Galactica is a large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins.

Web: galactica.org
Code: https://github.com/paperswithcode/galai

PS: It seems to use OPT architecture so maybe we can reuse the code used for adding these model. I would like to add this model :)

### Open source status

- [X] The model implementation is available
- [X] The model weights are available

### Provide useful links for the implementation

_No response_
If the architecture is the same, it's just a matter of converting the checkpoints to the HF format and uploading them, no need to add a new model in the library :-)<|||||>Hi, Sylvain!

Yes, It is the same (Even I have run the forward pass with their wrapper and the HF `OPTForCausalLM` and the output is the same. I think the ckpts are already converted (They have a config file that makes them work with HF).

2 questions:

1) The tokenizer is read from a single file `tokenizer.json` with the `Tokenizer.from_file()` method. How do I split it into separated files? (config, merges, vocab, etc)
2) Do I upload the models with my personal account? Like this: https://huggingface.co/mrm8488/galactica-125m ?

Thanks!<|||||>Not working correctly right now.<|||||>@sgugger Can you guide us better?<|||||>@mrm8488 would probably be best to include under the `facebook` org, some folks at HF like @patrickvonplaten should be able to upload them there<|||||>@patrickvonplaten We need your help on this one.<|||||>Hey guys, stoked for the integration - just one model specific thing, if user enters prompt like:

"[START_AMINO]MVATE[END_AMINO]" -> need to tokenize so the bit inside the special tokens is character-based tokenized -> i.e M, V, A, T, E. we have the logic in https://github.com/paperswithcode/galai/blob/main/galai/model.py, see "escape_custom_split_sequence".<|||||>Any update?<|||||>> Any update?

It is WIP! Thanks! :)<|||||>Model is fully added see: https://huggingface.co/models?other=galactica - thanks a lot @mrm8488 for you work here! Closing this :-) 