In this episode of “Call the Doctor,” Aleksandar Jelenak explores the HDF5 Extension Proposal HEP001. This proposal aims to modernize how we handle tabular data in HDF5 by introducing a columnar storage specification, moving beyond legacy row-based approaches to enable better interoperability, performance, and metadata flexibility. Relevant Links HDF Alliance GitHub Repository HEP001 Proposal Document […]
In this session of “Call the Doctor,” The HDF Group’s Scot Breitenfeld discusses a major modernization effort for HDF5: moving from opaque integer-based filter parameters to human-readable TOML strings. This update, targeted for the HDF5 2.2 release, simplifies the developer experience for plugin authors and users of high-level languages like Python, Java, and Fortran. Configuring
In this episode of Call the Doctor, Gerd Heber addresses a growing need in high-performance computing: verifiable data provenance. He demonstrates that HDF5 is capable of supporting tamper-evident blockchain patterns by interlinking datasets with SHA-256 hashes. The second half of the session introduces a suite of low-level tools from the HDF5 SHINES project. h5explain and
In this “Call the Doctor” session, Aleksandar Jelenak (Senior Informatics Architect) and a user engage in a live troubleshooting discussion. They dive into new h5diff features for cleaner regression testing and share critical benchmarks on why standard S3 mount points might be costing you more than you think. Relevant Links GitHub Issue #6364: Exclude attributes
In this session of “Call the Doctor,” Matt Larson provides a technical update on Agentic HDF5, a project designed to assist domain scientists in leveraging the power of HDF5 without needing to become experts in the library’s internal mechanics. The discussion focuses on a new telemetry system that proactively identifies performance bottlenecks and suggests optimizations
Learn how The HDF Group is streamlining cybersecurity as a new CVE Numbering Authority (CNA). PSIRT Lead Glenn Song explains the new Vulnerability Disclosure Policy for HDF5, HSDS, and HDF4.
What happens when you can’t use the HDF5 library to read a file? In this session of Call the Doctor, we dive into HDF5 Pickles—a new machine-readable specification that allows for low-level binary analysis and repair using GNU poke.
