{"authors":[{"id":"orcid_______::ffb4b7e65f66ebdb2003444f52068c5d","fullName":"Vinge, Rikard Karl Axel","name":"Rikard Karl Axel","surname":"Vinge","rank":1,"pid":{"id":{"scheme":"orcid","value":"0000-0002-7306-3403"},"provenance":null}},{"id":null,"fullName":"Marszalek, Michael","name":"Michael","surname":"Marszalek","rank":2,"pid":null},{"id":null,"fullName":"Schneider, Jannik","name":"Jannik","surname":"Schneider","rank":3,"pid":null},{"id":"orcid_______::2c64ef8b9cc7e0c5d664731d315bb353","fullName":"Albrecht, Conrad M","name":"Conrad M.","surname":"Albrecht","rank":4,"pid":{"id":{"scheme":"orcid","value":"0009-0009-2422-7289"},"provenance":null}}],"openAccessColor":null,"publiclyFunded":false,"eoscIfGuidelines":null,"type":"publication","language":{"code":"und","label":"Undetermined"},"countries":[{"code":"DE","label":"Germany","provenance":null}],"subjects":[{"subject":{"scheme":"keyword","value":"neural compression"},"provenance":null},{"subject":{"scheme":"FOS","value":"0211 other engineering and technologies"},"provenance":null},{"subject":{"scheme":"FOS","value":"02 engineering and technology"},"provenance":null},{"subject":{"scheme":"keyword","value":"satellite imagery"},"provenance":null},{"subject":{"scheme":"keyword","value":"foundation model benchmarking"},"provenance":null}],"mainTitle":"Earth Observation embeddings at the test: A novel benchmark to evaluate (neural) compression for satellite imagery","subTitle":null,"descriptions":["<jats:p>With the rapidly growing production and utilization of Earth Observation (EO) data, the past decade sparked interest in the efficient compression of EO data into low-dimensional embeddings. In a parallel development, EO Foundation Models (FM), trained on large amounts of unlabeled data to be used in a wide range of applications, also utilize low-dimensional embeddings to distill representations of EO data [1, 2, 3]. In one aspect, EO FMs may serve as (lossy) neural compressors to improve data transfer and lower storage needs &amp;#8211; effectively reducing the carbon footprint of EO data [4]. While the development in EO FMs rapidly advances, there is need for a novel benchmark scheme to evaluate the quality of (compressed) embeddings. The statement &amp;#8220;foundational&amp;#8221; or &amp;#8220;general purpose representation&amp;#8221; needs a test. As part of the Horizon Europe project &amp;#8220;Embed2Scale&amp;#8221; [5], co-funded by the European Union (Horizon Europe contract No. 101131841), the Swiss State Secretariat for Education (SERI), and UK Research and Innovation (UKRI), we present a novel approach to benchmark learnt compression of multimodal Copernicus Sentinel data for various relevant application domains. In the form of a competition, contestants provide embeddings that are evaluated on a diverse set of problems based on real-life use cases relevant for the research community, governments, and corporate businesses. The problems are hidden from the contestants to evaluate the applicability of the embeddings to unknown problems. The benchmark statistically evaluates the performance of downstream tasks through fine-tuning of neural networks that fit into commodity hardware. We underline a practically relevant scenario where end users rarely have access to costly and energy-intensive acceleration hardware. The overall performance, i.e. the evaluation across all the benchmark&amp;#8217;s problems, is crucial and ensures a diverse and fair evaluation of the embeddings. After the competition, the datasets in the benchmark are published and made available to the community. [1] X. Sun et al., &amp;#8220;RingMo: A remote sensing foundation model with masked image modeling,&amp;#8221; IEEE Transactions on Geoscience and Remote Sensing, 2022. [2] D. Wang et al., &amp;#8220;Advancing plain vision transformer toward remote sensing foundation model,&amp;#8221; IEEE Transactions on Geoscience and Remote Sensing, 2022. [3] C. Bodnar et al., &amp;#8220;Aurora: A foundation model of the atmosphere,&amp;#8221; Tech. Rep., 2024. [4] R. Wilkinson, M.M. Mleczko, R.J.W. Brewin, K.J. Gaston, M. Mueller, J.D. Shutler, X. Yan, K. Anderson, Environmental impacts of earth observation data in the constellation and cloud computing era,Science of The Total Environment, Volume 909,2024,168584,ISSN 0048-9697, https://doi.org/10.1016/j.scitotenv.2023.168584 [5] https://embed2scale.eu/</jats:p>"],"publicationDate":"2025-03-15","publisher":"Copernicus GmbH","embargoEndDate":null,"sources":["Crossref"],"formats":null,"contributors":null,"coverages":null,"bestAccessRight":{"code":"c_abf2","label":"OPEN","scheme":"http://vocabularies.coar-repositories.org/documentation/access_rights/"},"container":null,"documentationUrls":null,"codeRepositoryUrl":null,"programmingLanguage":null,"contactPeople":null,"contactGroups":null,"tools":null,"size":null,"version":null,"geoLocations":null,"id":"doi_dedup___::f89223c8215d5b8eaecd83d13c7eea92","originalIds":["10.5194/egusphere-egu25-16756","50|doiboost____|f89223c8215d5b8eaecd83d13c7eea92","50|od______1640::4e55c2625db498ee1b5c19baf7dc2322","oai:elib.dlr.de:213326","oai:zenodo.org:15837422","50|od______2659::f89223c8215d5b8eaecd83d13c7eea92","50|r3c4b2081b22::f33476ed4b8eb5ab54f76c8087f570e2","10.5194/EGUSPHERE-EGU25-16756"],"pids":[{"scheme":"doi","value":"10.5194/egusphere-egu25-16756"}],"dateOfCollection":null,"lastUpdateTimeStamp":null,"indicators":{"citationImpact":{"citationCount":0.0,"influence":2.1746283E-9,"popularity":2.2497804E-9,"impulse":0.0,"citationClass":"C5","influenceClass":"C5","impulseClass":"C5","popularityClass":"C5"}},"projects":[{"id":"corda_____he::a2a0fafb6dfd86daab44030c00641263","code":"101131841","acronym":"Embed2Scale","title":"Earth Observation & Weather Data Federation with AI Embeddings","funder":"European Commission","pids":[{"scheme":"doi","value":"10.3030/101131841"}]}],"organizations":[{"legalName":"Helmholtz Association of German Research Centres","acronym":"Helmholtz Association of German Research Centres","id":"openorgs____::4dee7ea0d1fd1b48c199ee744e21dc13","pids":[{"scheme":"FundRef","value":"501100009318"},{"scheme":"mag_id","value":"1305996414"},{"scheme":"ISNI","value":"0000000119425154"},{"scheme":"ROR","value":"https://ror.org/0281dp749"},{"scheme":"OrgRef","value":"734041"},{"scheme":"fundref","value":"501100009318"},{"scheme":"fundref","value":"501100001656"},{"scheme":"FundRef","value":"501100001656"},{"scheme":"OrgReg","value":"DE1061"},{"scheme":"GRID","value":"grid.211011.2"},{"scheme":"wikidata","value":"Q679913"},{"scheme":"Wikidata","value":"Q679913"}],"countries":[{"code":"DE","label":"Germany"}],"websiteurl":"http://www.helmholtz.de/en/"},{"legalName":"German Aerospace Center","acronym":"DLR","id":"openorgs____::3d003ceb4289a4da0941a1ab20469e3e","pids":[{"scheme":"wikidata","value":"Q38825517"},{"scheme":"OrgRef","value":"647619"},{"scheme":"ISNI","value":"0000000089837915"},{"scheme":"Wikidata","value":"Q38825517"},{"scheme":"FundRef","value":"501100002946"},{"scheme":"OrgReg","value":"DE1110"},{"scheme":"PIC","value":"999981731"},{"scheme":"GRID","value":"grid.7551.6"},{"scheme":"fundref","value":"501100002946"},{"scheme":"Wikidata","value":"Q157332"},{"scheme":"ROR","value":"https://ror.org/04bwf3e34"},{"scheme":"mag_id","value":"2898391981"},{"scheme":"wikidata","value":"Q157332"}],"countries":[{"code":"DE","label":"Germany"}],"websiteurl":"http://www.dlr.de/dlr/en/desktopdefault.aspx/tabid-10002/"},{"legalName":"Forschungszentrum Jülich","acronym":"FZJ","id":"openorgs____::cb92d2ed6f9a724e1c181a734c59f713","pids":[{"scheme":"wikidata","value":"Q697111"},{"scheme":"RRID","value":"RRID:SCR_023416"},{"scheme":"OrgRef","value":"1091669"},{"scheme":"OrgReg","value":"DE1113"},{"scheme":"GRID","value":"grid.8385.6"},{"scheme":"ROR","value":"https://ror.org/02nv7yv05"},{"scheme":"mag_id","value":"171892758"},{"scheme":"Wikidata","value":"Q697111"},{"scheme":"PIC","value":"999980470"},{"scheme":"fundref","value":"501100003163"},{"scheme":"FundRef","value":"501100003163"},{"scheme":"ISNI","value":"000000012297375X"}],"countries":[{"code":"DE","label":"Germany"}],"websiteurl":"http://www.fz-juelich.de/portal/EN/Home/home_node.html"}],"communities":[{"code":"eosc","label":"EOSC","provenance":null}],"collectedFrom":[{"key":"opendoar____::358aee4cc897452c00244351e4d91f69","value":"ZENODO"},{"key":"opendoar____::84f0f20482cde7e5eacaf7364a643d33","value":"DLR publication server"},{"key":"openaire____::081b82f96300b6a6e3d282bad31cb6e2","value":"Crossref"},{"key":"re3data_____::c4b2081b224be6b3e79d0e5e5556f631","value":"European Union Open Data Portal"}],"instances":[{"pids":[{"scheme":"doi","value":"10.5194/egusphere-egu25-16756"}],"type":"Article","urls":["https://doi.org/10.5194/egusphere-egu25-16756"],"publicationDate":"2025-03-15","refereed":"peerReviewed","hostedBy":{"key":"openaire____::55045bd2a65019fd8e6741a755395c8c","value":"Unknown Repository"},"collectedFrom":{"key":"openaire____::081b82f96300b6a6e3d282bad31cb6e2","value":"Crossref"}},{"alternateIdentifiers":[{"scheme":"doi","value":"10.5194/egusphere-egu25-16756"}],"accessRight":{"code":"c_14cb","label":"CLOSED","scheme":"http://vocabularies.coar-repositories.org/documentation/access_rights/","openAccessRoute":null},"type":"Conference object","urls":["https://doi.org/10.5194/egusphere-egu25-16756","https://elib.dlr.de/213326/"],"publicationDate":"2025-01-01","refereed":"nonPeerReviewed","hostedBy":{"key":"opendoar____::84f0f20482cde7e5eacaf7364a643d33","value":"DLR publication server"},"collectedFrom":{"key":"opendoar____::84f0f20482cde7e5eacaf7364a643d33","value":"DLR publication server"}},{"alternateIdentifiers":[{"scheme":"doi","value":"10.5194/egusphere-egu25-16756"},{"scheme":"oai","value":"oai:zenodo.org:15837422"}],"license":"CC BY","accessRight":{"code":"c_abf2","label":"OPEN","scheme":"http://vocabularies.coar-repositories.org/documentation/access_rights/","openAccessRoute":null},"type":"Other literature type","urls":["http://dx.doi.org/10.5194/egusphere-egu25-16756","https://zenodo.org/records/15837422"],"publicationDate":"2025-07-08","refereed":"nonPeerReviewed","hostedBy":{"key":"opendoar____::358aee4cc897452c00244351e4d91f69","value":"ZENODO"},"collectedFrom":{"key":"opendoar____::358aee4cc897452c00244351e4d91f69","value":"ZENODO"}},{"alternateIdentifiers":[{"scheme":"doi","value":"10.5194/egusphere-egu25-16756"}],"type":"Other literature type","urls":["http://dx.doi.org/10.5194/EGUSPHERE-EGU25-16756"],"publicationDate":"2025-01-01","refereed":"nonPeerReviewed","hostedBy":{"key":"openaire____::55045bd2a65019fd8e6741a755395c8c","value":"Unknown Repository"},"collectedFrom":{"key":"re3data_____::c4b2081b224be6b3e79d0e5e5556f631","value":"European Union Open Data Portal"}}],"links":[{"header":{"relationType":"resultProject","relationClass":"isProducedBy","relatedIdentifier":"corda_____he::a2a0fafb6dfd86daab44030c00641263","relatedRecordType":"project","relationProvenance":"sysimport:crosswalk:repository","trust":"0.9"},"collectedfrom":[{"dsId":"openaire____::3f264f93cf3b0cfc4ede188a6300455c","dsName":"CORDA - COmmon Research DAta Warehouse - Horizon Europe"}],"projectTitle":"Earth Observation & Weather Data Federation with AI Embeddings","code":"101131841","funding":{"funder":{"id":"ec__________::EC","shortname":"EC","name":"European Commission","jurisdiction":{"code":"EU","label":"European Union"},"pid":null},"level0":{"id":"ec__________::EC::HE","description":"Horizon Europe Framework Programme","name":"HE"},"level1":{"id":"ec__________::EC::HE::HORIZON-RIA","description":"HORIZON  Research and Innovation Actions","name":"HORIZON-RIA"},"level2":{"id":null,"description":null,"name":null}},"startDate":"2024-01-01","endDate":"2026-12-31"}],"otherTitles":null,"inDiamondJournal":false,"green":true,"isGreen":true,"isInDiamondJournal":false}