LAST: Utilizing Synthetic Image Style Transfer to Tackle Domain Shift in Aerial Image Segmentation

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent deep learning models often struggle with performance degradation due to domain shifts. Addressing domain adaptation in aerial image segmentation is challenging due to the limited availability of training data. To tackle this, we utilized the Unreal Engine to construct a synthetic dataset featuring images captured under diverse conditions such as fog, snow, and nighttime settings. We then proposed a latent space style transfer model that generates alternate domain versions based on the real aerial dataset. This approach eliminates the need for additional annotations on shifted domain data. We benchmarked nine different state-of-the-art segmentation methods on the ISPRS Vaihingen, Potsdam datasets, and their shifted foggy domains. Extensive experiments reveal that domain shift leads to significant performance drops, with an average decrease of - 3.46% mIoU on Vaihingen and -5.22% mIoU on Potsdam. Finally, we adapted the model to perform well in the shifted domain, achieving improvements of +2.97% mIoU on Vaihingen and +3.97% mIoU on Potsdam, while maintaining its effectiveness in the original domain.

Original languageEnglish
Title of host publicationProceedings of the 14th International Conference on Pattern Recognition Applications and Methods
EditorsModesto Castrillon-Santana, Maria De Marsico, Ana Fred
PublisherScience and Technology Publications, Lda
Pages32-42
Number of pages11
ISBN (Print)9789897587306
DOIs
Publication statusPublished - 2025
Event14th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2025 - Porto, Portugal
Duration: 2025 Feb 232025 Feb 25

Publication series

NameInternational Conference on Pattern Recognition Applications and Methods
Volume1
ISSN (Electronic)2184-4313

Conference

Conference14th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2025
Country/TerritoryPortugal
CityPorto
Period25/2/2325/2/25

Keywords

  • Aerial Image Processing
  • Domain Shift
  • Semantic Segmentation
  • Style Transfer

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'LAST: Utilizing Synthetic Image Style Transfer to Tackle Domain Shift in Aerial Image Segmentation'. Together they form a unique fingerprint.

Cite this