Nitzan Kligler, Chen Yu, Yafit Gabay
Reduced Implicit but not Explicit Knowledge of Cross-Situational Statistical Learning in Developmental Dyslexia
Cognitive science
development robust artificial intelligence models echocardiography limited availability annotated clinical data address challenge improve performance cardiac imaging models developed echoclip visionlanguage foundation model echocardiography learns relationship cardiac ultrasound images interpretations expert cardiologists across wide range patients indications imaging training 1032975 cardiac ultrasound videos corresponding expert text echoclip performs well diverse range benchmarks cardiac image interpretation despite explicitly trained individual interpretation tasks echoclip assess cardiac function mean absolute error 71 predicting left ventricular ejection fraction external validation dataset identify implanted intracardiac devices area curve auc 084 092 097 pacemakers percutaneous mitral valve repair artificial aortic valves respectively also developed longcontext variant echoclipr using custom tokenizer based common echocardiography concepts echoclipr accurately identified unique patients across multiple videos auc 086 identified clinical transitions heart transplants auc 079 cardiac surgery auc 077 enabled robust imagetotext search mean crossmodal retrieval rank top 1 candidate text reports capabilities represent substantial step toward understanding applying foundation models cardiovascular imaging preliminary interpretation echocardiographic findings