.
downstream and upstream tasks and supervised and self-supervised pre-training strategies. Tabular models, transfer learning setups and baselines The four tabular neural networks selected for the study use transformer-based architectures found to be most competitive with GBDT tabular approaches. Two