smajumdar94's picture
Create EXPLAINABILITY.md
b5b68d6 verified
Field Response
Intended Task/Domain: Reasoning for Code Generation
Model Type: Transformer
Intended Users: Solving competitive programming questions and evaluation for benchmark comparison.
Output: Text
Describe how the model works: he model generates a reasoning trace and responds with a final solution in response to a user prompting a programming question.
Name the adversely impacted groups this has been tested to deliver comparable outcomes regardless of: Not Applicable
Technical Limitations & Mitigation: This model is not applicable for Software Engineering tasks. It primarily should be used for competitive coding challenges that require optimized code solutions that can operate in appropriate space and time complexity.
Verified to have met prescribed NVIDIA quality standards: Yes
Performance Metrics: Pass@1 score
Potential Known Risks: The model may provide incorrect code solutions that fail to solve the problem. The model may enter a feedback loop and constantly generate reasoning tokens without generating the final solution.
Licensing: NVIDIA Open Model License Agreement