Blog

The HDF5 Subfiling Virtual File Driver (VFD) is an MPI-based File Driver that was introduced in the HDF5 1.14.0 release. This File Driver allows an HDF5 application to create HDF5 files which are distributed across a collection of ”subfiles” in equal-sized data segment ”stripes.” I/O to the logical HDF5 file is directed to the appropriate ”subfile” according to the Subfiling VFD configuration and a system of ”I/O Concentrators.” For more information on the general design of this VFD, refer to the Subfiling RFC. A user guide for the Subfiling Virtual File Driver was created in conjunction with the ExaIO team. The document gives a brief overview of the Subfiling VFD and details how to build and use the VFD, how to get the...

The HDF Group is excited to announce we're participating in the Exascale Computing Project (ECP) 2023 Community Birds-of-a-Feather (BOF) Days. Make sure to join the HDF5 session, HDF5: Pre-ECP, Present, and Future on February 14....

We are happy to announce the release of HDF5 1.14.0, which can now be obtained from the HDF5 Download page. More information about this release can be found on the HDF5 1.14.0 release page. For scheduled future releases, please refer to the release schedule....

If you’ve spent much time working with public repositories of HDF5 data, you’ll often see data organized as a large collection of files where the files are organized by time, geographic location or both. If you are using HSDS, there’s some good news in that you can use these collections as is and also have an aggregated view with HSDS....

On Wednesday, Nov 16, 2022 09:00 AM The HDF Group hosted a webinar on NeXpy. NeXpy is a GUI application designed to to facilitate creating, reading, visualizing, and manipulating data stored in HDF5 files. Although it was primarily designed to handle neutron and x-ray scattering stored using the NeXus format, most of its functionality is applicable to other types of scientific data stored in HDF5 files or even imported in a variety of formats....

NeXpy is a GUI application designed to to facilitate creating, reading, visualizing, and manipulating data stored in HDF5 files. Although it was primarily designed to handle neutron and x-ray scattering stored using the NeXus format, most of its functionality is applicable to other types of scientific data stored in HDF5 files or even imported in a variety of formats. Join us for a webinar on Wednesday, Nov 16, 2022 09:00 AM Central Time (US and Canada)....