Text Generation
Transformers
Safetensors
falcon
conversational
text-generation-inference

Web search fails with RuntimeError

#13
by abitrolly - opened

"{"error":"Request failed during generation: Server error: Unexpected <class 'RuntimeError'>: CUDA error: device-side assert triggered\nCUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.\nCompile with TORCH_USE_CUDA_DSA to enable device-side assertions.\n","error_type":"generation"}"

That's the error I got for some queries and the AI reports that it can not read URLs. I can hear its frustration.

Sign up or log in to comment