Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties
Temporal reasoning is fundamental to human cognition and is crucial for
various real-world applications. While recent advances in Large Language Models
have demonstrated promising capabilities in temporal reasoning, existing
benchmarks primarily rely on rule-based construction, lack contextual depth,
and involve a limited range of temporal entities. To address these limitations,
we introduce Chinese Time Reasoning (CTM), a benchmark designed to evaluate
LLMs on temporal reasoning within the extensive scope of Chinese dynastic
chronology. CTM emphasizes cross-entity relationships, pairwise temporal
alignment, and contextualized and culturally-grounded reasoning, providing a
comprehensive evaluation. Extensive experimental results reveal the challenges
posed by CTM and highlight potential avenues for improvement.
67bd3d6b60186d7478467208
Zhenglin Wang
claimed_verified
2025-02-25T09:39:15.633Z
6643261b8876db14227eeb19
/avatars/67428c9e37a2273697c0547e1783ec6b.svg
Zhenglin Wang
user
wzl0228
67bd3d6b60186d7478467209
Jialong Wu
claimed_verified
2025-02-25T15:06:02.856Z
644a4fbc2166258fccc664bc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/8k3b44MbhQiWuo6i8BnYl.jpeg
Jialong Wu
user
callanwu
67bd3d6b60186d747846720a
Pengfei LI
67bd3d6b60186d747846720b
Yong Jiang
admin_assigned
2025-02-25T16:29:23.380Z
678ddd806aa55e76bfffb953
/avatars/f447936c286a6a2d2874a760210b2f17.svg
Yong Jiang
user
yongjiangNLP
67bd3d6b60186d747846720c
Deyu Zhou
admin_assigned
2025-02-25T16:29:35.320Z
64e821f2bddc5b1072b15c2e
/avatars/618b5a48f2fa62daff4e1922a9aa9e8b.svg
zhoudeyu
user
zhoudeyu
Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties
Temporal reasoning is fundamental to human cognition and is crucial for
various real-world applications. While recent advances in Large Language Models
have demonstrated promising capabilities in temporal reasoning, existing
benchmarks primarily rely on rule-based construction, lack contextual depth,
and involve a limited range of temporal entities. To address these limitations,
we introduce Chinese Time Reasoning (CTM), a benchmark designed to evaluate
LLMs on temporal reasoning within the extensive scope of Chinese dynastic
chronology. CTM emphasizes cross-entity relationships, pairwise temporal
alignment, and contextualized and culturally-grounded reasoning, providing a
comprehensive evaluation. Extensive experimental results reveal the challenges
posed by CTM and highlight potential avenues for improvement.
The Chinese Time Reasoning (CTM) benchmark assesses Large Language Models' capabilities in temporal reasoning across Chinese dynastic history, focusing on cross-entity relationships and culturally-grounded analysis.
Large Language Models temporal reasoning Chinese Time Reasoning CTM cross-entity relationships pairwise temporal alignment contextualized reasoning culturally-grounded reasoning