A new benchmark for spatiotemporal fusion of Sentinel-2 and Sentinel-3 OLCI images
Overview4:58CCAI
paperi.ai
0:00 / 0:00
Meryeme Boumahdi, Ángel García‐Pedrero, Mario Lillo‐Saavedra, Consuelo Gonzalo‐Martín
Satellites face a basic trade-off: one sees Earth often but roughly, another sees detail but less often. This study asks whether their views can be combined into a clearer picture of a changing planet.
In Earth Observation, the use of multiple sensors has gained considerable attention as a tool to overcome the limitations inherent in individual data. Despite this, the operational lifespans of sensors are finite, creating an ongoing need to explore and integrate new sensors to sustain critical Earth Observation capabilities across diverse applications. Addressing this imperative, there is a need to establish a novel benchmark dataset featuring the integration of new sensors. In response, we present a new benchmark remote sensing dataset, making a significant contribution to the existing literature. This curated dataset leverages Sentinel2 and Sentinel-3 OLCI, comprising more than 689 image pairs. It spans a wide range of temporal and spatial variations, capturing diverse landscapes, ecosystems, and weather conditions. Importantly, this dataset is publicly accessible, facilitating researchers in the development of more robust data fusion methods. Moreover, we conduct a comprehensive evaluation of widely used spatiotemporal fusion (STF) methods, conducting a detailed quantitative and qualitative comparison as an applicationof this dataset. The dataset is freely available at https://doi.org/10.5281/zenodo.14860220
Transcript
Satellites face a basic trade-off: one sees Earth often but roughly, another sees detail but less often. This study asks whether their views can be combined into a clearer picture of a changing planet. Satellite images come from multiple sensors because one sensor cannot overcome every limitation on its own.
Combining their views can help sustain Earth observation across different applications. The study presents a public dataset built from Sentinel-two and Sentinel-three. It covers diverse landscapes, ecosystems, weather conditions, and changes over time and space.
The dataset is publicly accessible and is used to compare widely used methods for combining satellite images, so researchers can work toward more robust results. The field has made progress in combining satellite data, but available methods have not been examined thoroughly using shared benchmark datasets.
Comparisons often use different datasets and specific sensors, making consistent evaluation difficult when locations, landscapes, situations, and newer sensors vary. Few public datasets are suitable for data fusion, making consistent comparison difficult and leaving researchers without a common testing ground.
The dataset combines images from two European satellite systems with different timing, detail, and colour information. In everyday terms, it is like matching a frequent wide-angle snapshot with a less frequent close-up. It is large in both the detail of its images and the number of paired images, and it keeps a large difference in detail between the two sources.
It also includes different ecosystems, landscapes, weather conditions, and changes over time and space, then compares five commonly used image-combining methods. The benchmark covers 15 sites across different ecosystems and geographic locations, with 689 pairs of images from the two satellite systems.
The sites were chosen to challenge image-combining methods with rapid environmental changes, urban expansion, and changing coastal ecosystems. Each pair joins a broader image with 16 information channels at 300 metres of detail to a sharper image with 10 channels at details ranging from 10 to 60 metres.
The study tests representative image-combining methods on the benchmark dataset. The goal is to examine current performance when using these satellite images, while creating a foundation for future work. The comparison measures how closely each predicted image matches the real image across every information channel used in the test.
All the methods can combine different channels from both satellite systems, even when the difference in detail between the sources is large. One method produced results closer to the best possible values than the others across all six channels, while another also produced results comparable to it.
Across five dates at each site, four measures compare predicted images with the real images, revealing that performance changes with both location and timing rather than staying consistent across methods. The differences are most noticeable where the landscape changes more sharply over time.
When landscapes are fairly uniform and change slowly, the five methods show no significant differences. But their performance separates in more varied landscapes and places changing more quickly. The method called ESTARFM is more suitable for varied landscapes and sudden events when preserving structural detail matters, even though it does not always have the lowest errors.
When matching pairs of broad and sharp images are not always available, SFSDAF or STARFM still gives competitive results and can work with a minimum number of image pairs. The benchmark pairs images from Sentinel-two and Sentinel-three, two European satellites with varied temporal, spatial, and spectral characteristics across the dataset.
It spans distinct sites in different regions, with diverse spatial features and a wide range of spectral bands for testing image-combining methods. Its varied sites provide a difficult test of whether these methods can handle different land types and changes over time.
The study also compares the performance of five of the most widely used spatiotemporal fusion methods discussed in the literature. The results reveal the central limitation: all the methods struggle to capture fine spatial details in highly varied landscapes and sudden changes such as forest fires.
The new public benchmark makes satellite-image fusion easier to test fairly across many landscapes and changing conditions. It also shows that sudden events and complex places remain difficult to reconstruct reliably.
A derivative work by Paperi · AI-generated script, voice and captions
· pages and figures unaltered
Made with Paperi.
Drop in a research PDF — get a narrated video walkthrough like this one,
with highlights that follow the narration. Free to start.
Regenerative farming asks agriculture to do more than produce food: it must also rebuild soil, support living variety, and reduce harm to the climate. This paper asks whether a self-directing fleet of flying machines can help make that practical.What if regenerative farming could be monitored by a team of different drones that learns to fly safely, coordinate its tasks, and send field data through a satellite-linked network? This paper builds a proof of concept for that idea.
When a map places a label beside a location, the choice may feel obvious: put it above and to the right. But users in this study preferred something different, putting the label directly above.For decades, map labels have commonly been prioritized from the top-right. But when users compare the alternatives, the position they prefer most is actually straight above the point.
Atieh Sahraeidolatkhaneh, Morgan Nilsen, Fredrik Sikström
When a machine builds a metal part layer by layer, a small pool of molten metal changes shape as the heat changes. This study finds that one simple dimension of that pool can reveal temperature well enough to help control the build.What if a simple camera image could stand in for a difficult temperature measurement during metal 3D printing? This study finds that the melt pool’s length tracks temperature better than its area.