Abstract: ORNL has embraced leadership-class computing, and has quickly become one of the leading institutions for the DOE and NSF for large scale computations. One of the most challenging problems associated with running on the large computers is dealing with the huge amounts of data that is generated. Researchers are quickly becoming overwhelmed with the daunting task, not only of running their simulations on 100K processors, but also of efficiently extracting and transporting the many TB's of data generated by the simulations, and analyzing this data, and share it with their colleagues in a timely manner. The impact of these challenges and the overall time to solution is only growing as computers are getting faster. In order to help address these challenges we have been developing a suite of software solutions, which are gaining acceptance by the largest codes that are part of the DOE open science. Our suite of software solutions includes new API’s (ADIOS) that allow for both MPI-IO and asynchronous I/O through Remote Direct Memory Access (RDMA), workflow automation using the Kepler workflow package, fast wide area data transfers, and dashboards that combine data management, provenance management, and data analysis for monitoring complex simulations. In this talk Dr. Klasky introduces these solutions and will show how this technology is being used in several fusion SciDAC projects.

Short Bio: Dr. Klasky is currently a senior research scientist at Oak Ridge National Laboratory, and head of the end to end task in the scientific computing group at the National Center Computational Sciences. Dr. Klasky received his Ph.D. in physics from the University of Texas at Austin, and then went on to Syracuse University, and then the Princeton Plasma Physics Laboratory. Dr. Klasky is currently on 4 DOE SciDAC projects, including the Gyrokinetic Particle Simulation Center, Gyrokinetic Simulation of Energetic Particles, Center for Plasma Edge Simulations, and the Scientific Data Management Center, for work on data management techniques for petascale simulations.