Agent does not work !!!

#1
by Dannsht - opened

Final answer:
Error in generating final LLM output:
422 Client Error: Unprocessable Entity for url: https://api-inference.huggingface.co/models/Qwen/Qwen2.5-Coder-32B-Instruct/v1/chat/completions (Request ID: DsIAps4f3pKHdabBXYhA6)

Input validation error: inputs tokens + max_new_tokens must be <= 16000. Given: 70022 inputs tokens and 0 max_new_tokens
Make sure 'text-generation' task is supported by the model.

yes. I tried it too. Does not work. Same error.

Sign up or log in to comment