A computerized method of analyzing a waveform using a machine learning transformer model includes obtaining labeled waveform training data and unlabeled waveform training data, supplying the unlabeled waveform training data to the transformer model to pre-train the transformer model by masking a portion of an input to the transformer model, and supplying the labeled waveform training data to the transformer model without masking a portion of the input to the transformer model to fine-tune the transformer model. Each waveform in the labeled waveform training data includes at least one label identifying a feature of the waveform. The method also includes supplying a target waveform to the transformer model to classify at least one feature of the target waveform. The at least one classified feature corresponds to the least one label of the labeled waveform training data.
Waveform Analysis And Detection Using Machine Learning Transformer Models