Blog

The HDF5-1.10.2 release is now available for download from: https://www.hdfgroup.org/downloads/hdf5/ The source code (only) can also be obtained from: https://portal.hdfgroup.org/display/support/HDF5+1.10.2 User documentation for HDF5-1.10 can be accessed here: https://portal.hdfgroup.org/display/HDF5/...

50TB of Wind Integration National Dataset (WIND) toolkit data is now available to anyone via HDF Cloud thanks to the work and collaboration between John Readey, Sr. Architect at The HDF Group and NREL (the National Renewable Energy Laboratory). Access the data now with a Jupyter Notebook or through the interactive web-based visualization tool. If you want to learn more, please click here to read the Amazon blog where John and his NREL collaborators discuss the technology and motivation behind this project....

We are pleased to announce the launch of HDF Group’s new Support Portal and the HDF Forum. The new Support Portal, is located at https://portal.hdfgroup.org is the new home of materials previously found at support.hdfgroup.org. The old support will remain online but will no longer be updated. The new HDF Forum can be found at https://forum.hdfgroup.org and will replace the old hdf-forum mailing list. The old mailing list will be shut down today, Thursday February 22nd. Please visit our quickstart guide now to get started on using the new forum. For questions or comments please use our contact form on our website. Thank you, The HDF Group  ...

CONTENTS Release of HDF5-1.8.20 Release of HDF5-1.8.20 The HDF5-1.8.20 release is now available. It can be obtained from The HDF Group Support Download page: https://support.hdfgroup.org/downloads/ It can also be obtained directly from: https://support.hdfgroup.org/HDF5/release/obtain518.html HDF5-1.8.20 is a minor release with a few new features and changes. Important changes include: An issue with H5Zfilter_avail was fixed where it was not finding available plugins. Improvements were made to the h5repack, h5ls, h5dump, h5diff, and h5import utilities.In particular, please be aware that the behavior of the h5repack utility changed. A parameter was added to the "UD=" option of h5repack to allow the user defined filter flag to be changed to either H5Z_FLAG_MANDATORY (0) or H5Z_FLAG_OPTIONAL (1).An example of the command with the new parameter is shown here: h5repack -f UD=307,0,1,9...

The HDF Group is pleased to announce Ann Johnson has joined as the new Director of Engineering, reporting to David Pearah, CEO. Ann was most recently the Vice President of Engineering at Reservoir Labs, responsible for global engineering operations, personnel, and project management. Prior to Reservoir Labs, Ann held several executive management positions at SiCortex, ClearSpeed Technology, and Silicon Graphics. In her new role as Director of Engineering, Ann will be part of The HDF Group’s senior management team—working with all facets of the organization while overseeing and managing software development, quality assurance, and dev ops teams. Her specialized skillsets and past experiences building and directing global technical teams will greatly support The HDF Group’s expansion into new product and service verticals. “We...

Greetings! The HDF Group is pleased to launch our new website on the evening of Tuesday, October 17th. Our new site features a new design, a new logo, and other improvements—all based on feedback from our users. You’ll find improved and simplified navigation with a better layout focused on the needs of our customers and users. The new site also clears the way for future updates: In the next year, we will also launch an updated support site, a new forum for user support, new products, and more. No big growth is complete without growing pains, but fortunately all you’ll experience is a brief period of site downtime from 5-7 p.m. CDT on Tuesday, October 17th. The URL will remain the same:...

Version 2.2.3 of the h4toh5 Conversion Library and Tools is now available from the HDF Downloads page: https://support.hdfgroup.org/downloads/index.html#h4h5 It can be obtained directly from: https://support.hdfgroup.org/products/hdf5_tools/h4toh5/download.html This release was tested with HDF 4.2.13, HDF5-1.8.19, and HDF5-1.10.1, and contains many changes, including:  Numerous improvements were made to the tools. For example: h4toh5 now follows the HDF5 dimension scale specification to handle HDF4 SDS dimensions "h4toh5 -eos" can now convert a 1D HDF-EOS2 swath to HDF5. Memory leaks in the library and tools were fixed. Please see the Release Notes for complete details on what is new with this release: https://support.hdfgroup.org/ftp/HDF5/h4toh5/src/h4h5tools-2.2.3-RELEASE.txt ...

By Francesc Alted. He is a freelance consultant and developing author of different open source libraries like PyTables, Blosc, bcolz and numexpr and an experienced programmer in Python and C. Francesc collaborates regularly with the The HDF Group in different projects. We explain our solution for handling big data streams using HDF5 (with a little help from other tools). In the ubiquitously connected world that we live in, there are good reasons to understand what data is transferred across a network and how to extract information out of it. Being able to capture and log the different network packets can be used for many tasks including: Protecting against cyber threats Enforcing policy Extracting and consolidating valuable information Debugging protocols/services Understanding how users use...