SegBook: A Simple Baseline and Cookbook for Volumetric Medical Image
  Segmentation
Computed Tomography (CT) is one of the most popular modalities for medical
imaging. By far, CT images have contributed to the largest publicly available
datasets for volumetric medical segmentation tasks, covering full-body
anatomical structures. Large amounts of full-body CT images provide the
opportunity to pre-train powerful models, e.g., STU-Net pre-trained in a
supervised fashion, to segment numerous anatomical structures. However, it
remains unclear in which conditions these pre-trained models can be transferred
to various downstream medical segmentation tasks, particularly segmenting the
other modalities and diverse targets. To address this problem, a large-scale
benchmark for comprehensive evaluation is crucial for finding these conditions.
Thus, we collected 87 public datasets varying in modality, target, and sample
size to evaluate the transfer ability of full-body CT pre-trained models. We
then employed a representative model, STU-Net with multiple model scales, to
conduct transfer learning across modalities and targets. Our experimental
results show that (1) there may be a bottleneck effect concerning the dataset
size in fine-tuning, with more improvement on both small- and large-scale
datasets than medium-size ones. (2) Models pre-trained on full-body CT
demonstrate effective modality transfer, adapting well to other modalities such
as MRI. (3) Pre-training on the full-body CT not only supports strong
performance in structure detection but also shows efficacy in lesion detection,
showcasing adaptability across target tasks. We hope that this large-scale open
evaluation of transfer learning can direct future research in volumetric
medical image segmentation.
674549961934982716d2233c
Jin Ye
674549961934982716d2233d
Ying Chen
674549961934982716d2233e
Yanjun Li
admin_assigned
2024-11-26T22:51:27.798Z
6741c26133e10fc6d4526c32
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/rsFgSp1qogazSOEcMHN7L.png
Yanjun Li
user
ballinli
674549961934982716d2233f
Haoyu Wang
admin_assigned
2024-11-26T22:51:19.444Z
6665daf28c8082c859632c67
/avatars/4868985a626dda42aa3e7b80c61d214d.svg
Haoyu Wang
user
haoyuwang6
674549961934982716d22340
Zhongying Deng
admin_assigned
2024-11-26T22:51:13.162Z
66b7a5d1b4958a65e26e1d05
/avatars/10ceeea495628731c056be4afe5e10a4.svg
Zhongying Deng
user
zdcam294
674549961934982716d22341
Ziyan Huang
admin_assigned
2024-11-26T22:51:07.578Z
643fddd6388f31f64ccb9344
/avatars/c029b59cfbbc4124489e72fa8e71ee9a.svg
Ziyan Huang
user
ziyanhuang
674549961934982716d22342
Yanzhou Su
674549961934982716d22343
Chenglong Ma
admin_assigned
2024-11-26T22:50:55.842Z
666432a35adc67db967560d3
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/u7-8F9-aH7uDAPgEYq12E.jpeg
Chenglong Ma
user
ChenglongMa
674549961934982716d22344
Yuanfeng Ji
674549961934982716d22345
Junjun He
admin_assigned
2024-11-26T22:50:50.224Z
66b593026cef22e6ba6adb8a
/avatars/8a94d55b85177e84d65dd0bd537e335f.svg
JunjunHe
user
JunjunHe
SegBook: A Simple Baseline and Cookbook for Volumetric Medical Image
  Segmentation
Computed Tomography (CT) is one of the most popular modalities for medical
imaging. By far, CT images have contributed to the largest publicly available
datasets for volumetric medical segmentation tasks, covering full-body
anatomical structures. Large amounts of full-body CT images provide the
opportunity to pre-train powerful models, e.g., STU-Net pre-trained in a
supervised fashion, to segment numerous anatomical structures. However, it
remains unclear in which conditions these pre-trained models can be transferred
to various downstream medical segmentation tasks, particularly segmenting the
other modalities and diverse targets. To address this problem, a large-scale
benchmark for comprehensive evaluation is crucial for finding these conditions.
Thus, we collected 87 public datasets varying in modality, target, and sample
size to evaluate the transfer ability of full-body CT pre-trained models. We
then employed a representative model, STU-Net with multiple model scales, to
conduct transfer learning across modalities and targets. Our experimental
results show that (1) there may be a bottleneck effect concerning the dataset
size in fine-tuning, with more improvement on both small- and large-scale
datasets than medium-size ones. (2) Models pre-trained on full-body CT
demonstrate effective modality transfer, adapting well to other modalities such
as MRI. (3) Pre-training on the full-body CT not only supports strong
performance in structure detection but also shows efficacy in lesion detection,
showcasing adaptability across target tasks. We hope that this large-scale open
evaluation of transfer learning can direct future research in volumetric
medical image segmentation.
A large-scale benchmark evaluates the transferability of full-body CT pre-trained models across different medical image modalities and segmentation tasks, demonstrating effective modality and target adaptability.
STU-Net transfer learning CT images MRI dataset size bottleneck effect structure detection lesion detection volumetric medical segmentation