readme: Experimental 7B instruction tuned model based on pythia-6.9B-deduped
  --------------------------------------------------
  # Model may create undesirable content, use at your own risk. 
  Finetuned on a variety of instruction datasets. 
  See: https://github.com/Rallio67/language-model-agents 
  
  # Thanks to LAION contributors and Stability.ai
  for help building datasets and compute resources.
  
  # Prompt the  model by typing:
  User: followed by your question. The agent will reply as Chip \
  Chip is loosely inspired by the fictional character Chip the robot. \
  see: https://en.wikipedia.org/wiki/Not_Quite_Human_(film))
  
  # For multiple rounds of dialogue:
  After your question add two new lines followed by Chip:
  (\n\nChip:)
  
  # Example code snippet to run on your own system:
  ```
  from transformers import AutoModelForCausalLM, AutoTokenizer
  import torch
  
  chip_map= {'gpt_neox.embed_in': 0,
   'gpt_neox.layers': 0,
   'gpt_neox.final_layer_norm': 0,
   'embed_out': 0}
  
  name = "chip_7B_instruct_alpha"
  model = AutoModelForCausalLM.from_pretrained(name, device_map=chip_map, torch_dtype=torch.float16, load_in_8bit=True )
  tokenizer = AutoTokenizer.from_pretrained(name)
  
  def generate_from_model(model, tokenizer):
      encoded_input = tokenizer(text, return_tensors='pt')
      output_sequences = model.generate(
                                      input_ids=encoded_input['input_ids'].cuda(0),
                                      do_sample=True,
                                      max_new_tokens=35,
                                      num_return_sequences=1,
                                      top_p=0.95,
                                      temperature=0.5,
                                      penalty_alpha=0.6,
                                      top_k=4,
                                      output_scores=True,
                                      return_dict_in_generate=True,
                                      repetition_penalty=1.03,
                                      eos_token_id=0,
                                      use_cache=True
                                    )
      gen_sequences = output_sequences.sequences[:, encoded_input['input_ids'].shape[-1]:]
      for sequence in gen_sequences:
          new_line=tokenizer.decode(sequence, skip_special_tokens=True)
          print(new_line)
  
  text = "User: Why is everyone so excited about AI chatbots these days?"
  generate_from_model(model,tokenizer)
  #Chip: Chatbots are a great way to automate simple tasks. They can help you save time and make your life easier. For example, they can
  ```
  
  Sampling Settings:
  -------
  top_p=0.95,
  temperature=0.5,
  penalty_alpha=0.6,
  top_k=4,
  repetition_penalty=1.03
  
  Example Generations:
  ---------------
  >User: Are a manatee and a dolphin more likely to be friends or foes?
  
  Chip: Manatees and dolphins are both mammals, so they are more likely to be friends.
  
  Chip: Yes, a manatee and a dolphin are more likely to be friends than foes. Manatees are herbivores that eat sea grasses, while dolphins are carnivores that eat fish. Manatees and dolphins are both mammals, so they are more likely to be friends than foes.
  
  Chip: I’m not sure what you mean by “friends” or “foes”. Do you mean that they are both mammals, or that they are both mammals that live in the ocean?
  
  Chip: Yes, a manatee and a dolphin are more likely to be friends than foes. Manatees and dolphins are both mammals that live in the ocean, and they are both mammals that live in the ocean. So a manatee and a dolphin are more likely to be friends than foes.
  
  
  >User: Why are roses red?
  
  Chip: Roses are red because they contain a pigment called anthocyanin. Anthocyanin is a type of flavonoid, which is a type of chemical compound that gives color to plants. Anthocyanin is also found in other plants, such as blueberries, blackberries, and strawberries.
  
  Chip: Roses are red because they are a hybrid of two different species. The first species is Rosa rugosa, which is a white rose. The second species is Rosa damascena, which is a yellow rose. The hybrid rose is a red rose because it is the result of crossing the two species.
  
  Chip: Roses are red because of the pigment called anthocyanin. Anthocyanin is a red pigment that is found in many plants, including roses. Anthocyanin is also found in many fruits and vegetables, such as apples, grapes, and blueberries.
  
  Chip: Roses are red because they contain a compound called anthocyanin. Anthocyanin is a pigment that gives roses their color. Anthocyanin is also found in other plants, such as blueberries and cranberries, and is responsible for their color.
  
  
  >User: What's a good recipe for bbq ribs?
  
  Chip:
  1.  Preheat your oven to 350 degrees Fahrenheit.
  2.  Place your ribs in a large roasting pan.
  3.  In a small bowl, mix together the barbecue sauce, honey, garlic, and brown sugar.
  4.  Pour the sauce over the ribs and spread it evenly over the surface.
  5.  Bake the ribs for 1 hour, then reduce the oven temperature to 325 degrees Fahrenheit.
  6.  Bake the ribs for an additional 2 hours, or u