text: Title: [FEATURE] Support long_llama
  Body: LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
  
  Github:
  https://github.com/CStanKonrad/long_llama
  
  Models:
  https://huggingface.co/syzymon
  