Blog

In this webinar, join HDF Group senior architect John Readey for an introduction to the open source Highly Scalable Data Service (HSDS), REST-based software for reading and writing HDF5 data in the cloud. Developed to make large datasets accessible in a manner that’s both fast and cost-effective, HSDS stores HDF5 files as objects, but provides the functionality traditionally offered by the HDF5 library as accessible by any HTTP client. In this session we’ll cover the client SDKs intertwined with HSDS, the REST VOL and h5pyd, and give a demo of Kita Lab, one of The HDF Group’s commercial services centered around HSDS. Kita Lab is a managed JupyterLab environment with a command line interface, pre-loaded with HSDS, h5pyd, and sample notebooks...

The HDF Group is ready to announce a new major release, HDF5 1.12.0. This will be the first release that allows our users to access HDF5 data stored on non-POSIX storage, such as Cloud or Object Store. The release will also include performance enhancements to the parallel and sequential HDF5 libraries.Learn more about these new features in this upcoming webinar....

The HDF5 European workshop, co-organized with ESRF, and sponsored by OpenIO and Omnibond took place on September 17-18, 2019. This event covered the latest HDF5 developments, HDF5 use cases from science and industry, and HDF5 Applications and Tools. This post is an archive of the recorded presentations of this event. ...

Champaign, IL—Scot Breitenfeld, a 10-year employee of The HDF Group has been named co-chair of the CFD General Notation System (CGNS) Steering Committee. The CGNS provides a portable and extensible standard for the storage and retrieval of computational fluid dynamics (CFD) analysis data. The CGNS Steering Committee is responsible for the development, evolution, support, and promotion of the CGNS standard and its members include representatives from government and private industry. “The HDF Group prides itself in the domain-specific knowledge and expertise of its employees. Scot’s participation in the CGNS steering committee is a great example of the involvement of our employees in their respective fields,” said Elena Pourmal, Director of Technical Services and Operations. Scot started with The HDF Group in 2008 as...

Why do we use HDF5? We moved to HDF5 for our simulation data in 2016 from using our own proprietary file format. HDF5 had been on our radar for some time and we spent a couple of years investigating it and other file formats before deciding which we should switch to. HDF5 met all the criteria we had at the time. Amongst the criteria were: performance in speed and size, an accepted standard for scientific data, being open source, providing additional tools....