HDF5: Difference between revisions

From RCSWiki
Jump to navigation Jump to search
Line 12: Line 12:
and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files,  
and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files,  
together with metadata necessary for efficient data sharing, processing, visualization, and archiving.
together with metadata necessary for efficient data sharing, processing, visualization, and archiving.
= Parallel HDF5 =
Unfortunately, '''parallel''' version of HDF5 is '''not supported''' on ARC,
due to specifics of the hardware systems which are used to provide storage for the cluster.
= Modules on ARC =
To see HDF5 modules for installed versions of the library:
<pre>
$ module avail lib/hdf5
---------------- /global/software/Modules/4.6.0/modulefiles -------------
lib/hdf5/1.10.0.1 
lib/hdf5/1.10.0.1-mpi 
lib/hdf5/1.10.5-gnu730_openmpi402gnu730 
lib/hdf5/1.10.5-gnu730_openmpi402opagnu730
</pre>

Revision as of 16:45, 21 April 2022

General

The HDF5 technology suite is designed to organize, store, discover, access, analyze, share, and preserve diverse, complex data in continuously evolving heterogeneous computing and storage environments.

HDF5 supports all types of data stored digitally, regardless of origin or size. Petabytes of remote sensing data collected by satellites, terabytes of computational results from nuclear testing models, and megabytes of high-resolution MRI brain scans are stored in HDF5 files, together with metadata necessary for efficient data sharing, processing, visualization, and archiving.

Parallel HDF5

Unfortunately, parallel version of HDF5 is not supported on ARC, due to specifics of the hardware systems which are used to provide storage for the cluster.

Modules on ARC

To see HDF5 modules for installed versions of the library:

$ module avail lib/hdf5

---------------- /global/software/Modules/4.6.0/modulefiles -------------
lib/hdf5/1.10.0.1  
lib/hdf5/1.10.0.1-mpi  
lib/hdf5/1.10.5-gnu730_openmpi402gnu730  
lib/hdf5/1.10.5-gnu730_openmpi402opagnu730