Speed up cloud access using multiprocessing!

Accessing large data stores over the internet can be rather slow, but often you can speed things up using multiprocessing—i.e. running multiple processes that divvy up the work needed. Even if you run more processes than you have cores on your computer, since much of the time each process will be waiting on data, in many cases you’ll find things speed up nicely.

2022 HDF5 Release Schedule

Interim Engineering Director Dana Robinson talks about The HDF Group’s upcoming release schedule. As some of you may already have noticed, we now post the current HDF5 release schedule in the README.md document in the project’s root on GitHub. I’ll update this as circumstances change so it always reflects our current thinking.

HDF5 VOL Status Report – Exascale Computing Project

As part of our work with the Exascale Computing Project (ECP), Scot Breitenfeld, Hyo-Kyung Lee, and Larry Knox prepared this status report on the HDF5 VOL. This report provides an overview of the HDF5 VOL connectors created for the ECP.

Scroll to Top