UC-VO-ILDG-storage

From EGI Knowledge Base

Jump to: navigation, search

Use Case title: EGEE compliant storage elements at HPC centres

Short description: Members of the VO ILDG produce vast amounts of data on supercomputers installed at national (and in future: European) supercomputer centres.

Actors involved:

  • LQCD ‘researcher’ that uses supercomputing resources and wants to: (i) upload generated data to a local grid-enabled storage element; (ii) download data from a grid-enabled storage element for further processing.
  • Supercomputing centres providing both compute and storage resources for LQCD applications.

Steps: (i)

  1. Generate data on supercomputer
  2. After job completion upload data to local grid-enabled storage lement

Steps: (ii)

  1. Pre-stage data on local grid-enabled storage element.
  2. Once job execution has completed, download data to local disk and process data.

Middleware involved:

  • Storage element software, e.g. dCache
  • Data management client tools, e.g. srmcp

Applications involved: Non-standard applications are not used during access of grid resource.

Notable items: At the time of writing, only a subset of regional grids have provide access to the local storage resources via EGEE-compliant interfaces (in particular, SRM).

Personal tools
hidden pages