INT8 ONNX version of sachith-surge/Evol-Orca-LaMini-flan-t5-small to use with Transformers.js.
Example usage
import { pipeline } from '@xenova/transformers';
const generator = await pipeline('text2text-generation', 'Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small');
const output = await generator("How can I become more healthy?", { add_special_tokens: true, max_new_tokens: 50, repetition_penalty: 1.2});
console.log(output); // 1. Exercise: Exercise can help you stay fit and healthy. It can help you stay fit and...
- Downloads last month
- 2
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the HF Inference API does not support transformers.js models with pipeline type text2text-generation