A foundation model enpowered by a multi-modal prompt engine for universal seismic geobody interpretation across surveys
<|reference_start|>A foundation model enpowered by a multi-modal prompt engine for universal seismic geobody interpretation across surveys: Seismic geobody interpretation is crucial for structural geology studies and various engineering applications. Existing deep learning methods show promise but lack support for multi-modal inputs and struggle to generalize to different geobody types or surveys. We introduce a promptable foundation model for interpreting any geobodies across seismic surveys. This model integrates a pre-trained vision foundation model (VFM) with a sophisticated multi-modal prompt engine. The VFM, pre-trained on massive natural images and fine-tuned on seismic data, provides robust feature extraction for cross-survey generalization. The prompt engine incorporates multi-modal prior information to iteratively refine geobody delineation. Extensive experiments demonstrate the model's superior accuracy, scalability from 2D to 3D, and generalizability to various geobody types, including those unseen during training. To our knowledge, this is the first highly scalable and versatile multi-modal foundation model capable of interpreting any geobodies across surveys while supporting real-time interactions. Our approach establishes a new paradigm for geoscientific data interpretation, with broad potential for transfer to other tasks.<|reference_end|>
@article{gao2024a,
    title={A foundation model enpowered by a multi-modal prompt engine for
  universal seismic geobody interpretation across surveys},
    author={Hang Gao, Xinming Wu, Luming Liang, Hanlin Sheng, Xu Si, Gao Hui,
  Yaxing Li},
    journal={arXiv preprint arXiv:2409.04962},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.04962},
    primaryClass={physics.geo-ph cs.LG}
}