HDF5: Difference between revisions

From RCSWiki
Jump to navigation Jump to search
(Replaced links with ARC navbox)
 
(4 intermediate revisions by 2 users not shown)
Line 12: Line 12:
and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files,  
and megabytes of high-resolution MRI brain scans are stored in '''HDF5''' files,  
together with metadata necessary for efficient data sharing, processing, visualization, and archiving.
together with metadata necessary for efficient data sharing, processing, visualization, and archiving.
= Parallel HDF5 =
Unfortunately, '''parallel''' version of HDF5 is '''not supported''' on ARC,
due to specifics of the hardware systems which are used to provide storage for the cluster.
= Modules on ARC =
To see HDF5 modules for installed versions of the library:
<pre>
$ module avail lib/hdf5
---------------- /global/software/Modules/4.6.0/modulefiles -------------
lib/hdf5/1.10.0.1 
lib/hdf5/1.10.0.1-mpi 
lib/hdf5/1.10.5-gnu730_openmpi402gnu730 
lib/hdf5/1.10.5-gnu730_openmpi402opagnu730
</pre>
[[Category:Software]]
[[Category:ARC]]
{{Navbox ARC}}

Latest revision as of 18:14, 21 September 2023

General

The HDF5 technology suite is designed to organize, store, discover, access, analyze, share, and preserve diverse, complex data in continuously evolving heterogeneous computing and storage environments.

HDF5 supports all types of data stored digitally, regardless of origin or size. Petabytes of remote sensing data collected by satellites, terabytes of computational results from nuclear testing models, and megabytes of high-resolution MRI brain scans are stored in HDF5 files, together with metadata necessary for efficient data sharing, processing, visualization, and archiving.

Parallel HDF5

Unfortunately, parallel version of HDF5 is not supported on ARC, due to specifics of the hardware systems which are used to provide storage for the cluster.

Modules on ARC

To see HDF5 modules for installed versions of the library:

$ module avail lib/hdf5

---------------- /global/software/Modules/4.6.0/modulefiles -------------
lib/hdf5/1.10.0.1  
lib/hdf5/1.10.0.1-mpi  
lib/hdf5/1.10.5-gnu730_openmpi402gnu730  
lib/hdf5/1.10.5-gnu730_openmpi402opagnu730