By Francesc Alted. He is a freelance consultant and developing author of different open source libraries like PyTables, Blosc, bcolz and numexpr and an experienced programmer in Python and C. Francesc collaborates regularly with the The HDF Group in different projects. We explain our solution for handling big data streams using HDF5 (with a little help […]
The HDFView 2.14 and HDF Java 3.3.2 release is now available. This release supports HDF5-1.8 and 32-bit object identifiers and was tested with HDF5-1.8.19 and HDF 4.2.13. It can be obtained from: https://support.hdfgroup.org/downloads/index.html It can also be obtained directly from: https://support.hdfgroup.org/products/java/release/download.html More information on this release can be found on the HDF Java home page. This is
CONTENTS Release of HDF 4.2.13 Release of HDF 4.2.13 The HDF 4.2.13 release is now available. It can be obtained from the HDF4 home page: https://support.hdfgroup.org/products/hdf4/ HDF 4.2.13 is a minor release with a few changes, including: Support was added for macOS Sierra 10.12.5. Several memory leaks were fixed. The minimum CMake version supported is 3.2.2.
The HDF5 1.8.19 release is now available. It can be obtained from the HDF5 Download page: https://www.hdfgroup.org/downloads/hdf5/ It can also be obtained directly from: https://support.hdfgroup.org/HDF5/release/obtain518.html HDF5 1.8.19 is a minor release with a few new features and changes. Important changes include: Several H5PL (C) APIs were added to manipulate the entries of the plugin path
Tobias Weinzierl, Durham University, UK, Sven Köppel, FIAS, Germany, Michael Bader, TUM, Germany, HDF Guest Bloggers ExaHyPE develops a solver engine for hyperbolic differential equations solved on adaptive Cartesian meshes. It supports various HDF5 output formats. Exascale computing is expected to allow scientists and engineers to simulate, and ultimately understand, wave phenomena with unprecedented accuracy
Internal compression is one of several powerful HDF5 features that distinguish HDF5 from other binary formats and make it very attractive for storing and organizing data. Internal HDF5 compression saves storage space and I/O bandwidth and allows efficient partial access to data. Chunk storage must be used when HDF5 compression is enabled.
Scot Martin, Harvard University, HDF Guest Blogger HDF5 storage is really interesting. To me, its format has no fixed structure, but instead is based on introspection and discovery. Seems great to me; Mathematica has its origins first in artificial intelligence, so we ought to be able to do something here. Approaching twenty-two years with Mathematica
Christian Hoene, Symonics GmbH; and Piotr Majdak, Acoustics Research Institute; HDF Guest Bloggers Spatial audio – 3D sound. Back in the ‘70’s, “dummy head” microphones were used to create spatial audio recordings. With headphones, one was able to listen to those recordings and marvel at the impressive spatial distribution of sounds – just like in
The HDF Server allows producers of complex datasets to share their results with a wide audience base. We used it to develop the Global Fire Emissions Database (GFED) Analysis Tool, a website which guides the user through our dataset. A simple webmap interface allows users to select an area of interest and produce data visualization charts.
Mark Miller, Lawrence Livermore National Laboratory, Guest Blogger The HDF5 library has supported the I/O requirements of HPC codes at Lawrence Livermore National Labs (LLNL) since the late 90’s. In particular, HDF5 used in the Multiple Independent File (MIF) parallel I/O paradigm has supported LLNL code’s scalable I/O requirements and has recently been gainfully used
