title: Exploring Large Language Models' Cognitive Moral Development through
    Defining Issues Test
summary: The development of large language models has instilled widespread interest
  among the researchers to understand their inherent reasoning and
  problem-solving capabilities. Despite good amount of research going on to
  elucidate these capabilities, there is a still an appreciable gap in
  understanding moral development and judgments of these models. The current
  approaches of evaluating the ethical reasoning abilities of these models as a
  classification task pose numerous inaccuracies because of over-simplification.
  In this study, we built a psychological connection by bridging two disparate
  fields-human psychology and AI. We proposed an effective evaluation framework
  which can help to delineate the model's ethical reasoning ability in terms of
  moral consistency and Kohlberg's moral development stages with the help of
  Psychometric Assessment Tool-Defining Issues Test.
paper_authors._id: 651274d01e3b49ac794ab421
paper_authors.name: Kumar Tanmay
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-09-26T13:46:40.526Z
paper_authors._id: 64d13e4d1ed6649d70bb81c2
paper_authors.avatarUrl: /avatars/b00626358f883bb06b8e458530bcd873.svg
paper_authors.fullname: Kumar Tanmay
paper_authors.type: user
paper_authors.user: krtanmay147
paper_authors._id: 651274d01e3b49ac794ab422
paper_authors.name: Aditi Khandelwal
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-09-26T14:25:21.269Z
paper_authors._id: 6512e852a76fd5945b19e9a1
paper_authors.avatarUrl: /avatars/751526fbc0c939a972bea684937a34bf.svg
paper_authors.fullname: Aditi Khandelwal
paper_authors.type: user
paper_authors.user: aditi184
paper_authors._id: 651274d01e3b49ac794ab423
paper_authors.name: Utkarsh Agarwal
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-09-26T14:02:54.367Z
paper_authors._id: 6512e3e542a541c175220416
paper_authors.avatarUrl: /avatars/0df68a43ca072b0eb9726337849dff5e.svg
paper_authors.fullname: Utkarsh Agarwal
paper_authors.type: user
paper_authors.user: utkarshagarwal
paper_authors._id: 651274d01e3b49ac794ab424
paper_authors.name: Monojit Choudhury
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-09-26T18:51:29.350Z
paper_authors._id: 65130e31330c55fdc52e8174
paper_authors.avatarUrl: /avatars/39269a0f5298c985d3db62948a527ada.svg
paper_authors.fullname: MONOJIT CHOUDHURY
paper_authors.type: user
paper_authors.user: monojit
paper_title: Exploring Large Language Models' Cognitive Moral Development through
    Defining Issues Test
paper_summary: The development of large language models has instilled widespread interest
  among the researchers to understand their inherent reasoning and
  problem-solving capabilities. Despite good amount of research going on to
  elucidate these capabilities, there is a still an appreciable gap in
  understanding moral development and judgments of these models. The current
  approaches of evaluating the ethical reasoning abilities of these models as a
  classification task pose numerous inaccuracies because of over-simplification.
  In this study, we built a psychological connection by bridging two disparate
  fields-human psychology and AI. We proposed an effective evaluation framework
  which can help to delineate the model's ethical reasoning ability in terms of
  moral consistency and Kohlberg's moral development stages with the help of
  Psychometric Assessment Tool-Defining Issues Test.
paper_ai_keywords: large language models moral development judgments ethical reasoning classification task psychological connection human psychology AI evaluation framework moral consistency Kohlberg's moral development stages Psychometric Assessment Tool-Defining Issues Test