 max inference batch size, adjust according to cuda memory  inference = Inference(model_path, data_path, eet_batch_size)  inp = "田园一听这话，轻挑的嘴角放了下来，两腿叉开，踱着方步，跨过汤婆子，一屁股坐在了老人面前。</s>刘萌和健军一左一右站在他身旁，像是王朝、马汉护着包公断案。" text = inference([inp] * 10, append_right_eos=True)  ``` This interface supports batch inputs, so if you need to generate multiple results for one input, you can copy the input multiple times. The interface supports results generated for multiple different inputs, e.g. ```python text = inference(["四个月后，正是草长花秾的暮春季节。</s>令狐冲和盈盈新婚燕尔，携手共赴华山。","院子中传来急促的脚步声，他停下手中的招式，将开元刀插入刀鞘。"]) ```  