readme: ---
  license: bsd-3-clause
  ---
  # CodeGen (CodeGen-Mono 350M)
  
  Clone of [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) converted to ONNX and optimized.
  
  ## Usage
  
  ```python
  from transformers import AutoTokenizer
  from optimum.onnxruntime import ORTModelForCausalLM
  
  model = ORTModelForCausalLM.from_pretrained("TextCortex/codegen-350M-optimized")
  tokenizer = AutoTokenizer.from_pretrained("TextCortex/codegen-350M-optimized")
  
  text = "def hello_world():"
  input_ids = tokenizer(text, return_tensors="pt").input_ids
  generated_ids = model.generate(
      input_ids,
      max_length=64,
      temperature=0.1,
      num_return_sequences=1,
      early_stopping=True,
  )
  out = tokenizer.decode(generated_ids[0], skip_special_tokens=True)
  print(out)
  ```
  
  Refer to the original model for more details.