readme: Experimental 20B instruction tuned model based on gpt-neox-20b
  --------------------------------------------------
  # Model may create undesirable content, use at your own risk. 
  Finetuned on a variety of instruction datasets. 
  See: https://github.com/Rallio67/language-model-agents 
  
  # Thanks to LAION contributors and Stability.ai
  for help building datasets and compute resources.
  
  # Prompt the  model by typing:
  User: followed by your question. The agent will reply as Chip \
  Chip is loosely inspired by the fictional character Chip the robot. \
  see: https://en.wikipedia.org/wiki/Not_Quite_Human_(film))
  
  # For multiple rounds of dialogue:
  After your question add two new lines followed by Chip:
  (\n\nChip:)
  
  # Example code snippet to run on your own system:
  ```
  from transformers import AutoModelForCausalLM, AutoTokenizer
  import torch
  
  chip_map= {'gpt_neox.embed_in': 0,
   'gpt_neox.layers': 0,
   'gpt_neox.final_layer_norm': 0,
   'embed_out': 0}
  
  name = "chip_20B_instruct_alpha"
  model = AutoModelForCausalLM.from_pretrained(name, device_map=chip_map, torch_dtype=torch.float16, load_in_8bit=True )
  tokenizer = AutoTokenizer.from_pretrained(name)
  
  def generate_from_model(model, tokenizer):
      encoded_input = tokenizer(text, return_tensors='pt')
      output_sequences = model.generate(
                                      input_ids=encoded_input['input_ids'].cuda(0),
                                      do_sample=True,
                                      max_new_tokens=35,
                                      num_return_sequences=1,
                                      top_p=0.95,
                                      temperature=0.5,
                                      penalty_alpha=0.6,
                                      top_k=4,
                                      output_scores=True,
                                      return_dict_in_generate=True,
                                      repetition_penalty=1.03,
                                      eos_token_id=0,
                                      use_cache=True
                                    )
      gen_sequences = output_sequences.sequences[:, encoded_input['input_ids'].shape[-1]:]
      for sequence in gen_sequences:
          new_line=tokenizer.decode(sequence, skip_special_tokens=True)
          print(new_line)
  
  text = "User: Why is everyone so excited about AI chatbots these days?"
  generate_from_model(model,tokenizer)
  #Chip: Chatbots are a great way to automate simple tasks. They can help you save time and make your life easier. For example, they can
  ```
  
  Sampling Settings:
  -------
  top_p=0.95,
  temperature=0.5,
  penalty_alpha=0.6,
  top_k=4,
  repetition_penalty=1.03
  
  Example Generations:
  ---------------
  >User: Are a manatee and a dolphin more likely to be friends or foes?
  
  Chip: They are both mammals, so they would probably be more likely to be friends.
  
  Chip: They are both mammals, so they would most likely be friends. They both eat plants and animals, so they would have similar diets.
  
  Chip: They are both mammals, so they should have similar social behaviors. I think that they would probably get along well together!
  
  Chip: I’m not sure what you mean by “friends” or “foes”. Do you mean whether they are likely to get along, or whether they are likely to fight each other?
  
  >User: Why are roses red?
  
  Chip: The red color of roses is due to the presence of anthocyanins, which are a class of flavonoids. Anthocyanins are responsible for giving flowers their vibrant colors, and they are also responsible for protecting plants from UV radiation.
  
  Chip: Roses are red because they contain a pigment called anthocyanin. Anthocyanins are responsible for the color of many flowers, fruits, and vegetables. The pigment is found in all parts of the plant, including the leaves, stems, and roots.
  
  Chip: Roses are red because of a pigment called anthocyanin. Anthocyanins are found in many plants, including blueberries and eggplants. They are responsible for the color of many flowers and fruits.
  
  Chip: The color of a rose is determined by the pigment called anthocyanin. Anthocyanins are responsible for the red, purple, and blue colors in many plants. Roses contain a lot of anthocyanin, which gives them their distinctive red color.
  
  >User: What's a good recipe for bbq ribs?
  
  Chip: Ingredients:
   • 2 racks of baby back pork ribs (about 4 pounds each)
   • 1 bottle of your favorite barbecue sauce
   • 1/2 cup brown sugar
   • 1 tablespoon garlic powder
   • 1 teaspoon onion powder
   • 1 teaspoon paprika
   • 1 teaspoon cumin
   • Salt and pepper to taste
  
  Instructions:
  1. Preheat the oven to 350 degrees Fahrenheit.
  2. Place the ribs on a rimmed baking sheet, meat side up.
  3. In a bowl, mix together the barbecue sauce, brown sugar, garlic powder, onion powder, paprika, cumin, salt, and pepper.
  4. Spoon about 1/4 cup of the sauce mixture over the top of each rack of ribs.
  5. Bake in preheated oven for 30 minutes or until the ribs are tender.
  6. Serve with remaining sauce on the side. Enjoy!
  
  Chip: Ingredients:-2 racks of bab