The HDF Group welcomes Ann Johnson as Director of Engineering

The HDF Group is pleased to announce Ann Johnson has joined as the new Director of Engineering, reporting to David Pearah, CEO. Ann was most recently the Vice President of Engineering at Reservoir Labs, responsible for global engineering operations, personnel, and project management. Prior to Reservoir Labs, Ann held several executive management positions at SiCortex, […]

The HDF Group will launch their new website Tuesday, October 17th

Greetings! The HDF Group is pleased to launch our new website on the evening of Tuesday, October 17th. Our new site features a new design, a new logo, and other improvements—all based on feedback from our users. You’ll find improved and simplified navigation with a better layout focused on the needs of our customers and

Handling (and ingesting) data streams at 500K mess/s

By Francesc Alted. He is a freelance consultant and developing author of different open source libraries like PyTables, Blosc, bcolz and numexpr and an experienced programmer in Python and C. Francesc collaborates regularly with the The HDF Group in different projects. We explain our solution for handling big data streams using HDF5 (with a little help

ExaHyPE goes HDF5

Tobias Weinzierl, Durham University, UK, Sven Köppel, FIAS, Germany, Michael Bader, TUM, Germany, HDF Guest Bloggers ExaHyPE develops a solver engine for hyperbolic differential equations solved on adaptive Cartesian meshes. It supports various HDF5 output formats. Exascale computing is expected to allow scientists and engineers to simulate, and ultimately understand, wave phenomena with unprecedented accuracy

HDF5 Data Compression Demystified #2: Performance Tuning

Internal compression is one of several powerful HDF5 features that distinguish HDF5 from other binary formats and make it very attractive for storing and organizing data. Internal HDF5 compression saves storage space and I/O bandwidth and allows efficient partial access to data. Chunk storage must be used when HDF5 compression is enabled.

HDF5 Implementation in Mathematica

Scot Martin, Harvard University, HDF Guest Blogger HDF5 storage is really interesting. To me, its format has no fixed structure, but instead is based on introspection and discovery. Seems great to me; Mathematica has its origins first in artificial intelligence, so we ought to be able to do something here.  Approaching twenty-two years with Mathematica

HDF5 under the SOFA – A 3D audio case in HDF5 on embedded and mobile devices

Christian Hoene, Symonics GmbH; and Piotr Majdak, Acoustics Research Institute; HDF Guest Bloggers Spatial audio – 3D sound.  Back in the ‘70’s, “dummy head” microphones were used to create spatial audio recordings. With headphones, one was able to listen to those recordings and marvel at the impressive spatial distribution of sounds – just like in

Multiple Independent File (MIF, aka N:M) Parallel I/O With HDF5

Mark Miller, Lawrence Livermore National Laboratory, Guest Blogger The HDF5 library has supported the I/O requirements of HPC codes at Lawrence Livermore National Labs (LLNL) since the late 90’s. In particular, HDF5 used in the Multiple Independent File (MIF) parallel I/O paradigm has supported LLNL code’s scalable I/O requirements and has recently been gainfully used

User Forum – We Want to Hear from You!

David Pearah, The HDF Group Hello again, HDF User Community, As I mentioned in my last blog post — HDF: The Next 30 Years (Part 2) — we’re looking for ways to better engage our users, which includes providing better tools for you to get support from the HDF Community.  We are looking for your input on three things:

Scroll to Top