Department of Energy Awards Grant to The HDF Group and Collaborators for Fusion Energy Data Management Tools

The HDF Group has been selected to receive a Department of Energy grant to develop a platform where data from different fusion devices is managed according to Findable, Interoperable, Accessible, and Reusable (FAIR) standards and UNESCO’s Open Science recommendations. The data will also be adapted for use with machine learning (ML) tools. Led by researchers at MIT, this collaborative project also includes Auburn University, William & Mary, and the University of Wisconsin-Madison.

Welcome to our blog

Welcome, again, to the new HDF Blog. Let this be the beginning of a lively and informative dialogue.

America Runs on Excel and HDF5*

* With Python’s Help Gerd Heber, The HDF Group Before the recent release of our PyHexad Excel add-in for HDF5[1], the title might have sounded like the slogan of a global coffee and baked goods chain. That was then. Today, it is an expression of hope for the spreadsheet users who run this country and

HDF5 for the Web – HDF Server

HDF Group has just announced “HDF Server” – a freely available service that enables remote access to HDF5 content using a RESTful API. In our scenario, using HDF Server, we upload our Monopoly simulation results to the server and then interested parties can make requests for any desired content to the server – no file size issues, no downloading entire files…

The HDF Group appoints Dana Robinson as Director of Engineering

Dana Robinson has been appointed as the new Director of Engineering at The HDF Group. Dana started at The HDF Group in 2009 as a software engineer until stepping into the role of interim Director of Engineering in April 2022. As the Director of Engineering, Dana will lead the team of software engineers and shape the

Parallel and Large-scale Simulation Enhancements to CGNS

The current improvement of using collective I/O to reduce the number of independent processes accessing the file system helped to improve the metadata reads for cgp_open substantially, yielding 100-1000 times faster execution times over the previous implementation.

Whither HDF Java?

Joel Plutchak, The HDF Group The HDF Group’s support for and use of the Java Programming Language consists of Java wrappers for the HDF4 and HDF5 C libraries, an Object Model definition and implementation, and HDFView, a graphical file viewing application. In this article we’ll discuss what we’re doing now with Java, and look toward

HDF Cloud News – 11-28-22

News on the H5PYD v0.12.0 release and an install guide for running HSDS on Tencent Cloud.

Aggregation for Cloud Storage

If you’ve spent much time working with public repositories of HDF5 data, you’ll often see data organized as a large collection of files where the files are organized by time, geographic location or both. If you are using HSDS, there’s some good news in that you can use these collections as is and also have an aggregated view with HSDS.

Subfiling Virtual File Driver user guide is now available!

The HDF5 Subfiling Virtual File Driver (VFD) is an MPI-based File Driver that was introduced in the HDF5 1.14.0 release. A user guide for the Subfiling Virtual File Driver was created in conjunction with the ExaIO team.

Scroll to Top