numind

/

NuExtract-1.5

like 177

Follow

NuMind 179

Error being returned:

{"error":"'str' object has no attribute 'pop'"}

Steps to reproduce:

• Spin up this model in a HF Inference endpoint
• Copy paste the HF inference endpoint boilerplate
• Customize input field with prompt template found in Model Card

Code I'm running ("default" HF inference endpoint boilerplate) alongside the prompt template used in the Usage example in the Model Card

import requests

API_URL = "https://bkqo4fhhs95p3jmw.us-east-1.aws.endpoints.huggingface.cloud"
headers = {
    "Accept" : "application/json",
    "Authorization": "Bearer hf_XXXXX",
    "Content-Type": "application/json" 
}

def query(payload):
    response = requests.post(API_URL, headers=headers, json=payload)
    return response.json()

output = query({
    "inputs": "<|input|>\n### Template:\n{template}\n### Text:\n{text}\n\n<|output|>",  // Used my own template and text strings
    "parameters": {
        "max_new_tokens": 300
    }
})