numind

/

NuExtract-2.0-2B

like 15

Follow

NuMind 280

For the GPTQ model, the template generation function seems to work normally less frequently than for the base model.
Can you tell me how to fix this?
I am extracting the template by injecting an image with the prompt below.

[
        {
            "role": "system",
            "content": [
                {
                    "type": "text",
                    "text": "You are NuExtract, an information extraction tool created by NuMind.",
                }
            ],
        },
        {
            "role": "user",
            "content": [
                {
                    "type": "text",
                    "text": "Please create a template to extract key-value pairs from the following image. <|vision_start|><|image_pad|><|vision_end|>",
                },
                {
                    "type": "image_url",
                    "image_url": {"url": f"data:image/jpeg;base64,{encode_image("XXX.jpg")}"},
                },
            ],
        },
    ]