Models For mental health, MentalLlama-chat-13B (Yang et al., 2023c) finetunes a Llama-chat-13B
model on IMHI training set. MentalLlama-chat-13B model with zero-shot prompting outperforms
ChatGPT with few-shot prompting or with zero-shot prompting for 9 out of 10 tasks in IMHI. Liu
et al. (2023) proposes to fine-tune a Llama checkpoint to generate impression text given radiology
report findings. The resulting Radiology-Llama-2 model outperforms ChatGPT and GPT-4 by a large
margin on both MIMIC-CXR and OpenI datasets.

3.5.4 Generating Structured Responses

Generating formatted responses in accordance with instructions is a core ability to support agentic
capabilities or simply reduce the manual efforts in parsing or translating model responses.
ChatGPT’sOne-yearAnniversary-AreOpen-Source LargeLanguageModelsCatchingup