mobile-logo

Blog

Sep
08
2021

We have scheduled a webinar for Friday, September 24 at 11:00 a.m. CDT covering the major new features of the HDF5 1.13.0 release. This will mainly cover pluggable virtual file drivers (VFDs) and changes to the virtual object layer (VOL). We'll also show how to build and use the async, pass-through, and cache VOL connectors. Registration is required....

Aug
05
2021

By John Readey Abstract HSDS (Highly Scalable Data Service) is a cloud-native data service designed to fully support the HDF5 data model and API while taking advantage of cloud-based features such as object storage and on-demand compute. HSDS is an open-source, Apache2 licensed product which has been used by many organizations to provide access to HDF data over the web. Originally designed with Amazon's AWS as the target platform, The HDF Group has worked with Microsoft Azure to enable HSDS to run equally well on Azure. Enhancements made to HSDS include: support for Azure Blob Storage, authentication with Azure Active Directory, deployment scripts for AKS (Azure Kubernetes Service), and an Azure Marketplace offer to simplify deployment. This article will discuss the design,...

Jul
09
2021

We are very pleased to announce the release of HDF5-1.12.1, which can now be obtained from the HDF5 Download page. Information about this release can be found on the Support Portal as follows: HDF5 documentation Software Changes from Release to Release HDF5-1.12.1 is a minor release with a few new features and changes: The new Mirror and Splitter VFDs were added, enabling "concurrent" file writes to two files, one of which could be on a remote system. The following vulnerability issues were addressed:CVE-2018-11206CVE-2018-14033 (same as CVE-2020-10811)CVE-2018-14460 Autotools and CMake options were added to enable or disable file locking. C functions and C++, Fortran and Java wrappers were also added for setting and getting the file locking parameters. In addition, file locking now works on Windows. Various improvements were...

May
21
2021

On Friday, May 14, 2021, we hosted JP Swinski as he presented the webinar, H5Coro: The HDF5 Cloud-Optimized Read-Only Library. NASA’s migration of science data products and services to AWS has sparked a debate on the best way to access science data stored in the cloud. Given that a large portion of NASA’s science data is in the HDF5 format or one of its derivatives, a growing number of efforts are looking at ways to efficiently access H5 files residing in S3. This presentation describes one of those efforts and argues for the creation of a standardized subset of the HDF5 specification targeting cloud environments. Slide deck https://youtu.be/RuBKDW4TNO4...

May
14
2021

May 28, 2021 11:00 a.m. CDT Register In this webinar, we continue our exploration of Hermes. We will pick up where we left from the first webinar in which we showcased the Hermes API basics & adapters and showed how applications could benefit by using Hermes. We will run the popular VPIC kernel with Hermes and highlight the performance improvements due to the hierarchical buffering system. We will also present an HDF5 Virtual File Driver (VFD) for Hermes. All demonstrations will be accompanied by detailed performance analysis, and there will be time for audience questions and answers. Resources: - Previous Webinar Recording: https://www.youtube.com/watch?v=KJdXMqfRmS4 - Hermes on GitHub: https://github.com/HDFGroup/hermes Register now!...

May
04
2021

On Friday, April 30, The HDF Group's Gerd Heber presented HDF5 Application Tuning: There is more than one way to skin a cat(fish), Part 2. Before returning to application tuning (in part 3), in this second part of the series, we take a closer look at HDF5 performance variability. We highlight the main variability sources, their impact on performance, and considerations for HDF5 container design. https://youtu.be/JEnYLWpBjso...