by Scot Breitenfeld, Director of Engineering, The HDF Group Training and deploying large models requires transferring significant volumes of low-precision tensors, including weights, gradients, activations, and KV caches. bfloat16 maintains float32’s exponent range, ensuring numerical stability with reduced storage requirements. FP8 E4M3 and E5M2 are standard for H100-class hardware, while FP6 and FP4 enable the […]
In this session of “Call the Doctor,” Matt Larson provides a technical update on Agentic HDF5, a project designed to assist domain scientists in leveraging the power of HDF5 without needing to become experts in the library’s internal mechanics. The discussion focuses on a new telemetry system that proactively identifies performance bottlenecks and suggests optimizations
When working with a foundational library like HDF5, what happens behind the scenes matters. The build system—the collection of scripts that compile source code into libraries and tools—plays an essential role in your workflow. A reliable and consistent build system is key to a smooth experience. However, challenges can arise when a project supports two
The HDF5 1.14.6 release is now available from the HDF5 1.14.6 download page. This is a maintenance release with some minor new changes: Reverted a change to the library’s handling of UTF-8 file names. A change was made in the HDF5 1.14.4 release to address some issues with the library’s handling of code pages and
by John Readey “For Heaven’s sake, do not confound HDF5 with anything else!” —Friedrich Nietzsche, Ecce Homo Alan Turing devised the Turing test (he referred to it as the “Imitation Game”) in 1950 to determine whether a machine could think. He believed that if machines could give answers that were indistinguishable from human answers, then
The HDF5 1.14.5 release is now available from the HDF5 1.14.5 download page.
Several new HDF5 CVE issues have been filed in MITRE and these should be released to the public sometime in the next few weeks. They are all fixed in HDF5 1.14.4 (released April 15, 2024) and no MITRE CVE issues are unaddressed.
The HDF 1.14.4 release is now available from the HDF5 1.14.4 download page. This is a maintenance release with several nice improvements and additions.
The HDF5 Library and Tools 1.12.3 release is now available from the Download page. This is a maintenance release with a few updates: Brings the H5Dchunk_iter() API call from HDF5 1.14 Many CVE fixes as part of our continued effort to keep HDF5 CVE-free Please be aware that this will be the last release for
