Storing bfloat16 and FP8 tensors in HDF5 without a conversion tax

by Scot Breitenfeld, Director of Engineering, The HDF Group Training and deploying large models requires transferring significant volumes of low-precision tensors, including weights, gradients, activations, and KV caches. bfloat16 maintains float32’s exponent range, ensuring numerical stability with reduced storage requirements. FP8 E4M3 and E5M2 are standard for H100-class hardware, while FP6 and FP4 enable the […]

When an HDF5 file points outside itself

by Gerd Heber, Executive Director, The HDF Group When something goes wrong, someone is going to tell the story. You’ll be better off if it’s you. Otherwise, you create an opportunity for rumors, hearsay, and false information to spread. (Jason Fried & David Heinemeier Hansson, Rework) Reports on the July 2026 OpenAI agent intrusion have

Release of HDF5 2.2.0 and Two August Events (Newsletter #210)

HDF5 2.2.0 Now Available The HDF Group is pleased to announce the release of HDF5 2.2.0, delivering improved cloud performance, stronger security capabilities, enhanced build and deployment workflows, and numerous reliability and usability improvements across the HDF5 ecosystem. This release focuses on making HDF5 easier to deploy, more secure in production environments, and more efficient

Scroll to Top