Spaces:
Running
Running
Question regarding the Stream parameter
#271
by
gregharding618
- opened
I'm using the API. With Stream=True or Stream=False, the responses take 37+ seconds regardless, and I get the entire response at once. I was under the impression stream would send word by word with little delay between the start of the request and the first word? Am I misunderstanding what stream does?
gregharding618
changed discussion status to
closed