mobile-logo

Blog

Feb
21
2022

The purpose of this introduction is to highlight and celebrate a community contribution the impact of which we are just beginning to understand. Its principal author, Mr. Lucas C. Villa Real, calls it HDF5-UDF and describes it as "a mechanism to generate HDF5 dataset values on-the-fly using user-defined functions (UDFs)." This matter- of-fact characterization is quite accurate, but I would like to provide some context for what this means for us users of HDF5....

Feb
14
2022

The HDF Group's formal comment to a DOE request on stewardship for scientific and high-performance computing was published in the Federal Register. We had a joint position paper at January's ASCR Workshop on Visualization for Scientific Discovery, Decision-Making, & Communication. The paper is called Whither Visualization Logic and was written by Leigh Orf (University of Wisconsin), Lucas Villa Real (IBM Research), and Gerd Heber (The HDF Group). Thomas Caswell (active h5py contributor, Brookhaven National Laboratory) also has a position paper called Visualization of Structured Data. Additionally, we have two position papers at the ASCR Workshop on the Management and Storage of Scientific Data. The first was led by Jerome Soumagne (The HDF Group), The Twilight of I/O as a User Concept and is joint work with Andres Marquez from the PNNL....

Feb
01
2022

The group at BioSimulations.org has been doing some very interesting work using HSDS on Kubernetes to store biomodelling data and visualizing the results using Vega as described in the paper below. Biosimulations chose to use HSDS due to its support for very large data sets,  REST API (for use with web applications), and its ability to run on Google Cloud as well as on-premise installations. ...

Dec
07
2021

Hermes is a distributed I/O buffering system for deep distributed storage hierarchies, which are commonly found on modern HPC systems. On December 1st, 2021, members of the Hermes team gave a presentation to show Hermes in action, talk about the new release and plan for future development. Here are the materials from that session: Slide Deck - Part I - Intro, Overview, and FAQ Slide Deck - Part II - Demonstration https://youtu.be/zDmUdynklJs    ...

Dec
03
2021

We are excited to announce a new strategy of delivering HDF5 features: Experimental Releases. Experimental releases allow us to get major new features into the hands of our users so that they can test the features and provide feedback before we integrate them into a subsequent maintenance release. Our first experimental release, HDF5 version 1.13.0, is now available....