Hi @lewtun, I’m new to ONNX and having difficulties moving my pipeline into ONNXRuntime. Currently my workflow is like this:
config = AutoConfig.from_pretrained(path_finetuned)
model = AutoModelForSequenceClassification.from_pretrained(path_finetuned, config=config)
tokenizer = AutoTokenizer.from_pretrained("distilbert-base-cased")
classifier = TextClassificationPipeline(model=model, tokenizer=tokenizer)
I am able to convert my the model to ONNX by:
convert(framework="pt",         model="distilbert-base-cased",          output=Path("/onnx/fine-tuned.onnx"),         pipeline_name="sentiment-analysis",         opset=13)
However, I’m having difficulties moving the ONNX graph towards a similar pipeline classifier = TextClassificationPipeline(...). Could you share your approach?