María Verónica Alderete, María Marta Formichella
Access to ICT at Argentine elementary school children's homes and its impact on school achievements
Education and information technologies
precisely predicting molecular properties crucial drug discovery scarcity labeled data poses challenge applying deep learning methods largescale selfsupervised pretraining proven effective solution often neglects domainspecific knowledge tackle issue introduce taskoriented multilevel learning based bert tomlbert duallevel pretraining framework considers structural patterns domain knowledge molecules tomlbert achieved stateoftheart prediction performance 10 pharmaceutical datasets capability mine contextual information within molecular structures extract domain knowledge massive pseudolabeled data duallevel pretraining accomplished significant positive transfer two components making complementary contributions interpretive analysis elucidated effectiveness duallevel pretraining lies prior learning taskrelated molecular representation overall tomlbert demonstrates potential combining multiple pretraining tasks extract taskoriented knowledge advancing molecular property prediction drug discovery