The critical resources and expertise required for NOAA research are distributed nationally and globally. NOAA has a rich mix of satellite, model, and reanalysis data; software programs in many computer languages, including C/C++, Fortran, IDL, Matlab and Python; cluster, grid and cloud computer facilities; and NOAA scientists, engineers, and partners located in many locations. Effective collaboration, which can bridge distances and heterogeneity, is both difficult and increasingly necessary. Legacy computer code must be integrated with more modern and flexible languages and technologies. Fusion of data from multiple satellites, surface measurements, radars, and models can together provide a coherent picture of phenomena no single data source can capture, and expertise across fields and specialties is needed to understand tightly coupled physical systems.
Graphyte: Graphyte Toolkit
Graphyte is a platform based on a NOAA supported project called the Graphyte Toolkit, which brings together several important components needed in a platform for NOAA collaborative scientific computing. These components include the ability to edit, build and run software, utilizing a mix of computer languages currently in use at NOAA, through a web interface. The project will develop the components necessary to provide a full featured collaborative platform, including the ability to transparently scale and utilize HPC grids, clusters, and clouds. A collaborative system must deploy state of the art job-management to permit builds and experimental runs to be executed where appropriate computing resources are available. In this manner, NOAA can right-size computing resources as needed and exploit under-utilized computing power.