ππ€π New Research Alert - NAACL 2024 (Big Five Personality Traits Collection)! πππ€ π Title: PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits π¬
π Description: This research examines the ability of LLMs to express personality traits and finds that LLMs can generate content consistent with assigned personality profiles and that humans can recognize certain traits with up to 80% accuracy. However, accuracy drops significantly when annotators are aware that the content was generated by an AI.
π₯ Authors: Hang Jiang et al.
π Conference: NAACL, June 16β21, 2024 | Mexico City, Mexico π²π½
We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens, whose overall performance, as measured by both academic benchmarks and internal testing, rivals that of models such as Mixtral 8x7B and GPT-3.5 (e.g., phi-3-mini achieves 69% on MMLU and 8.38 on MT-bench), despite being small enough to be deployed on a phone. The innovation lies entirely in our dataset for training, a scaled-up version of the one used for phi-2, composed of heavily filtered web data and synthetic data. The model is also further aligned for robustness, safety, and chat format. We also provide some initial parameter-scaling results with a 7B and 14B models trained for 4.8T tokens, called phi-3-small and phi-3-medium, both significantly more capable than phi-3-mini (e.g., respectively 75% and 78% on MMLU, and 8.7 and 8.9 on MT-bench).
reacted to isidentical's
post with π₯over 1 year ago