-
This paper was co-written with Mark Howison at Lawrence Berkeley National Laboratory, and describes useful performance improvements that are possible by tweaking HDF5.
-
This document describes experiments that were done to determine the usefulness of accessing HDF5 files with SSHFS.
-
Delivered at the "Digital Preservation Interoperability Framework (DPIF) Workshop", National Institute of Standards and Technology (NIST), Gaithersburg, Maryland, March 29-31, 2010, http://ddp.nist.gov/workshop.
Tuning HDF5 for Lustre File Systems
howison_hdf5_lustre_iasds2010.pdf
Accessing HDF5 Files via SSHFS (FUSE)
2010-11_FUSEPerformanceReport-final.pdf
HDF and Data Preservation
Balancing
Performance and Preservation -- Lessons Learned with HDF5 (paper), Folk and Pourmal
Balancing
Performance and Preservation -- Lessons Learned with HDF5 (presentation), Folk
-
This document describes The HDF Group's experience applying virtualization to the HDF Windows support effort.
HDF Virtualization Review
2009-06_hdf_virtualization_report.pdf
-
NCL, GrADS, PyHDF, GDL, and GDAL are five open source software packages that can manipulate either HDF4 or HDF5 data. This document provides a limited evaluation of HDF support for these packages from the user's point of view.
-
This document describes how to use NCL, GrADS, PyHDF, GDL, and GDAL to access HDF files.
-
This brief describes how the HDF5-OPeNDAP project facilitated the use of HDF-EOS data to track Beijing's air quality during the August 2008 Olympics.
-
NetCDF-4 is an I/O software package that retains the original netCDF4 APIs while using HDF5 to store the data. Sponsored by NASA ESTO, netCDF-4 is the result of a collaboration between Unidata and The HDF Group.
This report on the performance of netCDF-4 uses benchmarks and examples to:
- 1) Compare the performance of netCDF-3 and netCDF-4
- 2) Discuss performance tuning with netCDF-4
- 3) Discuss performance pitfalls with netCDF-4
Some of the performance tuning and pitfalls discussions may also be of interest to users of HDF5 who do not use netCDF-4.
Evaluation of HDF Support for NCL, GrADS, PyHDF, GDL and GDAL
Usage of NCL, GrADS, PyHDF, GDL and GDAL to Access HDF Files
Brief: HDF5-OPeNDAP Project used in tracking air quality for 2008 Olympics
2008-08_hdf5_opendap_brief.pdf
NetCDF-4 Performance Report: June, 2008
2008-06_netcdf4_perf_report.pdf
Older papers are available from http://www.hdfgroup.uiuc.edu/papers/papers/.
- - Last modified:May 16th 2011