This models don't have generation_config.json therefore potentially generation can continue infinitely. Updated docs so in every generate call max_new_tokens/max_length similar to https://github.com/openvinotoolkit/openvino.genai/pull/670

katuni4ka changed pull request status to merged

Sign up or log in to comment