A method for assessing diagnostic certainty in diagnostic reporting natural language, the method comprising receiving a natural language impression portion of a diagnostic report submitted for certainty evaluation, the impression portion having one or more sentences of natural language, accessing a pre-trained and fine-tuned language model, applying the one or more sentences to the trained language model for evaluation of the one or more sentences as a whole, receiving an assessment of certainty for the respective one or more sentences, based on the evaluation, communicating the assessment of certainty to a user before accepting the impression portion, and accepting submission of the impression portion only after the impression portion satisfies certainty criteria, or if the certainty criteria is not required obtaining validation from the user.
DEEP-LEARNING BASED CERTAINTY QUALIFICATION IN DIAGNOSTIC REPORTS