Large Language Models, NLP, Python, AI.
attention_mask=inputs["attention_mask"], pad_token_id=tokenizer.pad_token_id, max_new_tokens=128, ) res.append((instr, resp, to_response(pred[0]))) pdf = pd.DataFrame(res, columns=["instruction", "response", "generated"]) display(pdf) Model Evaluation Although the current model is under-trained, it