loricooper, Author at The HDF Group - ensuring long-term access and usability of HDF data and supporting users of HDF technologies

C++ has come a long way and there’s plenty in it for users of HDF5

July 30, 2018

A few years ago, I was looking for a data format with low latency block and stream support. While protocol buffers offered streams, it was lacking indexed block access. Soon, I realized I was looking for a container with file system-like properties. When I examined HDF5, I found it was very close to what I needed to store massive financial engineering datasets….

Chicago Area Meetup: HDF5 ♥ C++: Why Nobody Believed Us and Why You Should Reconsider

July 24, 2018

Chicago area HDF5 friends: Please join us at this meetup on July 31st for a talk by Gerd Heber and Steven Varga.

HDF5 Or How I Learned To Love Data Compression And Partial I/O

June 15, 2018

David Ziganto is a senior data scientist and corporate trainer at Metis in Chicago, IL. This post was originally shared on his site at https://dziganto.github.io/, but we enjoyed it so much we wanted to share it with everyone.

Citations for HDF Data and Software

June 8, 2018

The topic of software citation has been discussed in many forums recently and several major discovery repositories (e.g. zenodo and DataCite) support metadata for software in addition to datasets and other resource types. HDF5 stradles the boundary between the dataset and software worlds. It is most commonly thought of and referred to as a data format, but, as in any case, data written in the HDF formats can not be read without HDF software. So, the answer to the question: is it a format or is it software? is clearly both.

Damaris: An Asynchronous Data Aggregator Middleware in Support of HDF5 Library

June 1, 2018

Damaris is a middleware that enriches existing HPC data format libraries (e.g. HDF5) with data aggregation and asynchronous data management capabilities. At the same time, it can be employed for in situ analysis and visualization purposes.

Why should I care about the HDF5 1.10.2 Release?

April 5, 2018

On March 30th, we announced the release of HDF5 version 1.10.2. With this release, we accomplished all the tasks planned for the major HDF5 1.10 series. It is time for applications to start migrating (or start their migration) from HDF5 1.8 to the new major release as we will be dropping support for HDF5 1.8 in Summer 2019. In this blog post , we will focus only on the major new features and bug fixes in HDF5 1.10.2. Hopefully, after reading about those, you will be convinced it is time to upgrade to HDF5 1.10.2.