Applying Vision Transformers on Spectral Analysis of Astronomical ObjectsLuis Felipe Strano Moraes, Ignacio Becker, Pavlos Protopapas, Guillermo Cabrera-Viveshttps://arxiv.org/abs/2506.00294
Applying Vision Transformers on Spectral Analysis of Astronomical ObjectsWe apply pre-trained Vision Transformers (ViTs), originally developed for image recognition, to the analysis of astronomical spectral data. By converting traditional one-dimensional spectra into two-dimensional image representations, we enable ViTs to capture both local and global spectral features through spatial self-attention. We fine-tune a ViT pretrained on ImageNet using millions of spectra from the SDSS and LAMOST surveys, represented as spectral plots. Our model is evaluated on key task…