TeraGrid Data Transfer

Document #:

OSG-doc-651-v1

Document type:

Presentations

Submitted by:

Marcia Teckenbrock

Updated by:

Marcia Teckenbrock

Document Created:

05 Jul 2007, 17:16

Contents Revised:

05 Jul 2007, 17:16

DB Info Revised:

05 Jul 2007, 10:10

Actually Revised:

14 May 2009, 10:10

Abstract:

The NSF TeraGrid project, initiated in 2001, currently links high-performance computing and data resources at centers located at nine U.S. universities and national laboratories (IU, NCAR, NCSA, ORNL, PSC, Purdue, SDSC, TACC, UC/ANL) with a dedicated network infrastructure. Data management and transfer methods used among TeraGrid systems have evolved over time, as available technologies have improved and the needs of users in the national science community have driven development for more efficient solutions. Data transfer performance has improved with better strategies in the deployment and use of grid data transfer services such as Globus GridFTP and HPN-scp. TeraGrid sites participate actively in the development of emerging network filesystem technologies (e.g., GPFS, Lustre), data streaming methods and tools (e.g., PDIO), queued parallel data transfer (e.g., DMOVER), and data collections management solutions (e.g., SRB). With large, data-intensive scientific instrument deployments and petascale HPC systems visible on the horizon, Teragrid will continue to drive data management and transfer solutions to meet the needs of the national science community. By Derek Simmel (PSC).

Files in Document:

• DataHandlingWorkshop-dsimmel.ppt (4.4 MB)

Topics:

• Communications:Outreach
• Software

Authors:

• Outside Unknown

Associated with Events:

Workshop on Data Handling in Production Grids ( w/ HPDC 07) held on 25 Jun 2007 in Monterey Bay, California