HDF5: Difference between revisions
| Line 12: | Line 12: | ||
and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files, | and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files, | ||
together with metadata necessary for efficient data sharing, processing, visualization, and archiving. | together with metadata necessary for efficient data sharing, processing, visualization, and archiving. | ||
= Parallel HDF5 = | |||
Unfortunately, '''parallel''' version of HDF5 is '''not supported''' on ARC, | |||
due to specifics of the hardware systems which are used to provide storage for the cluster. | |||
= Modules on ARC = | |||
To see HDF5 modules for installed versions of the library: | |||
<pre> | |||
$ module avail lib/hdf5 | |||
---------------- /global/software/Modules/4.6.0/modulefiles ------------- | |||
lib/hdf5/1.10.0.1 | |||
lib/hdf5/1.10.0.1-mpi | |||
lib/hdf5/1.10.5-gnu730_openmpi402gnu730 | |||
lib/hdf5/1.10.5-gnu730_openmpi402opagnu730 | |||
</pre> | |||
Revision as of 16:45, 21 April 2022
General
- The HDF Group: https://portal.hdfgroup.org/display/support
The HDF5 technology suite is designed to organize, store, discover, access, analyze, share, and preserve diverse, complex data in continuously evolving heterogeneous computing and storage environments.
HDF5 supports all types of data stored digitally, regardless of origin or size. Petabytes of remote sensing data collected by satellites, terabytes of computational results from nuclear testing models, and megabytes of high-resolution MRI brain scans are stored in HDF5 files, together with metadata necessary for efficient data sharing, processing, visualization, and archiving.
Parallel HDF5
Unfortunately, parallel version of HDF5 is not supported on ARC, due to specifics of the hardware systems which are used to provide storage for the cluster.
Modules on ARC
To see HDF5 modules for installed versions of the library:
$ module avail lib/hdf5 ---------------- /global/software/Modules/4.6.0/modulefiles ------------- lib/hdf5/1.10.0.1 lib/hdf5/1.10.0.1-mpi lib/hdf5/1.10.5-gnu730_openmpi402gnu730 lib/hdf5/1.10.5-gnu730_openmpi402opagnu730