Scientific Data Management: Essential Technology for Data-Intensive Science
Ultascale scientific computing often generate enormous quantities of data that are nned to be managed and explored. The process of scientific exploration typically takes place in two phases. In the data collection/generation phase large volumes of data are generated by simulation programs running on supercomputers or collected from experiments’ instruments. In the data analysis phase, it is necessary to have effective data searching, analysis, and data movement tools to in order to find and dynamically explore the information in the data. I will present advanced data management technology that greatly increase the effectiveness of scientific data exploration.
Lawrence Berkeley National Laboratory