mobile-logo

Archive

Why HDF Technologies? The ability of HDF5 to accommodate virtually every kind of data in a single file has been recognized by many researchers as providing the ideal container for sequencing data. Sequences, images, SNP matrices, and every other type of data and metadata associated with an experiment can be stored in a single HDF file that can be passed from module to module in the data processing workflow, greatly reducing the headaches associated with data management. Medical imagery instruments generate increasingly high resolution imagery at unprecedented rates. These images or parts of these images need to be searched and accessed quickly without the burden of having to uncompress large amounts of data or perform exhaustive searches. Traditional formats for storing this data,...

June 27, 2017

Why HDF Technologies? HDF5 is highly scalable and can handle data objects of any size and number. Because the HDF5 data model is so flexible, it is also well-suited for highly heterogeneous data, which occurs more and more often as applications need to integrate a variety of different kinds of data from different sources. And the fact that HDF5 runs on virtually every computing platform means that HDF based software can easily be ported across projects, departments, and agencies. The DOE labs maintain some of the world’s biggest and fastest computers, massively parallel machines that can generate a terabyte of data every minute. A critical need within the labs is to have data technologies that can accommodate the massive I/O speeds to...

June 27, 2017

Why HDF Technologies? HDF adopters in finance have very large datasets, very fast access requirements, or very complex datasets. They turn to HDF because it allows them to easily share data across a wide variety of computational platforms using applications written in different programming languages. Some use HDF to take advantage of the many open-source and commercial tools that understand HDF.   How HDF Technologies are Used Trading and risk analysis Customer portfolio analysis Historical market research Back testing Packet Capture Ingestion and Storage ...

June 27, 2017

Why HDF Technologies? Instrument builders need a way to collect data that can easily and efficiently represent the quantities collected, capture important metadata, and keep up with increasing accretion rates and data set sizes. It also helps if the data is in a form that common analysis tools and programming languages can easily understand and access. Ability to be used and expand in other software ecosystems that includes tools like MATLAB and programming environments such as .NET and Python   How HDF Technologies are Used Instrument data acquisition Processing Archiving ...

June 27, 2017

Why HDF Technologies? HDF5’s scalability, ability to handle every kind of engineering data, and strong support for HPC applications make it a good solution in addressing the challenges of working with enormous volumes of complex data. HDF5 can encode + enrich + compact all types of sensor data. In addition, many frameworks support HDF5. HDF5 is heavily used when it comes to collecting sensor data — regardless of whether for machine learning or autonomous driving. Raw sensors and camera frame data are formatted in HDF5 files for easy use in machine learning and controls software.   How HDF Technologies are Used Data archiving and vehicle testing Design and simulation for cars and trucks Engine design and optimization (combustion and alternative energy) Aerodynamic modeling for...

June 27, 2017

Why HDF Technologies? HDF5’s scalability, ability to handle every kind of engineering data, and strong support for HPC applications make it a good solution in addressing the challenges of working with enormous volumes of complex data. In addition, the ability of HDF5 to accommodate all this information in a single container make it ideal for both real-time analytics as well as and long-term archiving for backward-looking analytics.   How HDF Technologies are Used Standard for nondestructive testing software Aircraft engine design and computational fluid dynamics (CFD) Aerospace metals design Flight safety data and experimental research into “digital twins” of actual aircraft ...

June 27, 2017

Why HDF Technologies? HDF5 provides a ready-made solution for scientists who need to find a way to store and share their data and it runs on almost any computing platform. In addition, the HDF5 data model can accommodate extremely large, complex, high dimensional, and hetergenous data. Many common software tools used for academic research support HDF5, including Labview, MATLAB, Mathematica, ParaView, and Matplotlib. HDF5 also supports many programming languages including: Fortran, Python, R, .NET, Julia and many others.   How HDF Technologies are Used Standard format for managing scientific simulation data on high end computing platforms Standard for a large and wide ranging collection of scientific communities Research projects using HDF5 from B.S., MA, and PHD's have led to enduring applications that went...

June 27, 2017
« Previous Page
  • 2