Hi. I have managed to successfully use pretrained DialoGPT model in tensorflow serving (thanks to Merve). Rest API is up and running as it should. The issue occurs when I try to send the data to it. When I try to pass in the example input (available at Huggingface’s API documentation under conversational model section). I get an error “error”:“Missing ‘inputs’ or ‘instances’ key”. This is the part where I get confused.
In the tutorial I watched on youtube it’s stated that “instances” are bassically inputs (video section is available on: tf serving tutorial | tensorflow serving tutorial | Deep Learning Tutorial 48 (Tensorflow, Python) - YouTube), but something else is written in the tensorflow serving documentation (available on: RESTful API  |  TFX  |  TensorFlow).So my question is, how can I get the values that need to be passed into the “instances” key, what are they? Are they in any file in the model’s huggingface repository? Thank you for answering in advance. (And sorry because you have to copy paste URLs, but platform wouldn’t let me use more than 2). This is the code I’ve written in node.js to test the Rest API:
const axios = require('axios');

const ai_url = "http://localhost:8601/v1/models/dialogpt:predict";

const payload = {
    "instances": [],
    "inputs": {
        "past_user_inputs": ["Which movie is the best ?"],
        "generated_responses": ["It's Die Hard for sure."],
        "text": "Can you explain why ?"
    }
}
console.log(JSON.stringify(payload));

axios.post(ai_url, { data: payload })
    .then(function (response) {
        console.log("data: " + JSON.stringify(response.data));
        console.log(ai_response);
    })
    .catch(function (error) {
        console.log(error);
        console.log(error.response.data.detail);
        console.log(error.response);
    });

```This text will be hidden