Monai, Medical Imaging, Pytorch, Triton Inference Server, Torchserve.
preprocess(img_path=img_path) client = httpclient.InferenceServerClient(url="localhost:8000") inputs = httpclient.InferInput("input__0", transformed_image.shape, datatype="FP32") inputs.set_data_from_numpy(transformed_image, binary_data=True) outputs = httpclient.InferRequestedOutput("output__0",