Improving Multi-Dimensional Data Formats, Access, and Assimilation Tools for the Twenty-First Century

SON 64 AUTORES - MANDRINI, C.H.

Otro; Decadal Survey for Solar and Space Physics (Heliophysics) 2024-2033; 2023

Heliophysics image data largely relies on a forty-year-old ecosystem built on the venerableFlexible Image Transport System (FITS) data standard. While many in situ measurementsuse newer standards, they are difficult to integrate with multiple data streams requiredto develop global understanding. Additionally, most data users still engage with datain much the same way as they did decades ago. However, contemporary missions andmodels require much more complex support for 3D multi-parameter data, robust dataassimilation strategies, and integration of multiple individual data streams required to derivecomplete physical characterizations of the Sun and Heliospheric plasma environment. Inthis white paper we highlight some of the 21st century challenges for data frameworks inheliophysics, consider an illustrative case study, and make recommendations for importantsteps the field can take to modernize its data products and data usage models. Our specificrecommendations include:• Investing in data assimilation capability to drive advanced data-constrained models,• Investing in new strategies for integrating data across multiple instruments to realizemeasurements that cannot be produced from single observations,• Rethinking old data use paradigms to improve user access, develop deep understanding,and decrease barrier to entry for new datasets,• Investing in research on data formats better suited for multi-dimensional data and cloud-based computing.