Storseismic: An Approach to Pre-Train a Neural Network to Store Seismic Data Features

Abstract

Machine Learning (ML) has recently been helpful for many seismic processing and imaging tasks. However, these tasks are often handled separately with their own neural network model and training. We propose StorSeismic, a unified framework to store the features in seismic data and use them later for varying seismic processing tasks. Through the help of the self-attention mechanism embedded in the Bidirectional Encoder Representation from Transformers (BERT), a Transformer-based network architecture, we capture and store the local and global features of seismic data in the pre-training stage, then utilize them in various seismic processing tasks in the fine-tuning stage. Using this framework, we could achieve a more efficient and flexible training process than existing approaches. Two applications on denoising and velocity estimation demonstrate the flexibility and the potential of this proposed framework in adapting to various seismic processing tasks.