HDFql
the easy way to manage HDF5 data
Join the many research organizations, data-driven corporations, and universities across the globe who use HDFql. It’s free.
FEATURES

Simple
Designed to be as simple as SQL. Hides complex operations and frees users from low-level details

Reliable
Unfailing robustness and reliability. HDFql is checked against hundreds of existing tests before new versions are released

Clean
Offers a clean interface requiring just a few intuitive statements even for complex operations. Gone are the days where HDF5 required endless lines of code

Writes
Unlike other tools, HDFql not only reads HDF5 but also allows you to write HDF5 data

Fast
Processes data using all nodes and cores available. This means much higher volumes of data are processed in the same amount of time

Portable
Portable across C, C++, Java, Python, C#, Fortran and R using one uniform high-level language

Intuitive
Based on models of human cognition and natural language. Fast learning curve

Platforms
Supports Windows, Linux, macOS
HDFql is the first high-level language to manage HDF5 data. Designed to be as simple and powerful as SQL, HDFql dramatically reduces the learning effort and time needed to handle HDF5. Built on intuitive syntax, the tool offers a clean interface which reads and writes HDF5 data across programming languages and platforms.
As an example, imagine that you need to create an HDF5 file named “my_file.h5” and, inside it, a group named “my_group” containing a one dimensional (size 3) dataset named “my_dataset” of data type integer. Additionally, the dataset is compressed using ZLIB and initialized with values 4, 8 and 6. In HDFql, this can easily be implemented as follows:
create file my_file.h5
use file my_file.h5
create dataset my_group/my_dataset as int(3) enable zlib values(4, 8, 6)
use file my_file.h5
create dataset my_group/my_dataset as int(3) enable zlib values(4, 8, 6)
In contrast, using the C API on the same example is quite cumbersome:
hid_t file;
hid_t group;
hid_t dataspace;
hid_t property;
hid_t dataset;
hsize_t dimension;
int value[3];
file = H5Fcreate(“my_file.h5”, H5F_ACC_EXCL, H5P_DEFAULT, H5P_DEFAULT);
group = H5Gcreate(file, “my_group”, H5P_DEFAULT, H5P_DEFAULT, H5P_DEFAULT);
dimension = 3;
dataspace = H5Screate_simple(1, &dimension, NULL);
property = H5Pcreate(H5P_DATASET_CREATE);
H5Pset_chunk(property, 1, &dimension);
H5Pset_deflate(property, 9);
dataset = H5Dcreate(group, “my_dataset”, H5T_NATIVE_INT, dataspace, H5P_DEFAULT, property, H5P_DEFAULT);
value[0] = 4;
value[1] = 8;
value[2] = 6;
H5Dwrite(dataset, H5T_NATIVE_INT, H5S_ALL, H5S_ALL, H5P_DEFAULT, &value);
hid_t group;
hid_t dataspace;
hid_t property;
hid_t dataset;
hsize_t dimension;
int value[3];
file = H5Fcreate(“my_file.h5”, H5F_ACC_EXCL, H5P_DEFAULT, H5P_DEFAULT);
group = H5Gcreate(file, “my_group”, H5P_DEFAULT, H5P_DEFAULT, H5P_DEFAULT);
dimension = 3;
dataspace = H5Screate_simple(1, &dimension, NULL);
property = H5Pcreate(H5P_DATASET_CREATE);
H5Pset_chunk(property, 1, &dimension);
H5Pset_deflate(property, 9);
dataset = H5Dcreate(group, “my_dataset”, H5T_NATIVE_INT, dataspace, H5P_DEFAULT, property, H5P_DEFAULT);
value[0] = 4;
value[1] = 8;
value[2] = 6;
H5Dwrite(dataset, H5T_NATIVE_INT, H5S_ALL, H5S_ALL, H5P_DEFAULT, &value);
USERS
ABOUT
HDFql was launched in 2016 by a team of interdisciplinary experts with vast experience from world leading research facilities (such as CERN), Fortune 50, and top universities in the United States and Europe. We believe (scientific) big data management should be simple, clean and fast, and we’re especially passionate about the promises of machine learning in cleantech, healthtech and science.
HDFql is currently being used to power electric vehicle strategies, to crunch data in renewable energy, and to deliver breakthroughs in science, biotechnology and engineering. Because we aspire to advance data-driven discoveries, HDFql is free.
DOCUMENTATION
QUICK START
REFERENCE MANUAL
LICENSE
RELEASE NOTES
NEWS
BLOG
DOWNLOAD
| Architecture | Compiler | MPI | File |
| 32 bit | Microsoft Visual Studio 2010 | N/A | HDFql-2.2.0_Windows32_VS-2010.zip |
| 32 bit | Microsoft Visual Studio 2013 | N/A | HDFql-2.2.0_Windows32_VS-2013.zip |
| 32 bit | Microsoft Visual Studio 2015 | N/A | HDFql-2.2.0_Windows32_VS-2015.zip |
| 64 bit | Microsoft Visual Studio 2010 | N/A | HDFql-2.2.0_Windows64_VS-2010.zip |
| 64 bit | Microsoft Visual Studio 2013 | N/A | HDFql-2.2.0_Windows64_VS-2013.zip |
| 64 bit | Microsoft Visual Studio 2015 | N/A | HDFql-2.2.0_Windows64_VS-2015.zip |
| Architecture | Compiler | MPI | File |
| 32 bit | Gnu Compiler Collection (GCC) | N/A | HDFql-2.2.0_Linux32_GCC-4.9.zip |
| 32 bit | Gnu Compiler Collection (GCC) | MPICH | HDFql-2.2.0_Linux32_GCC-4.9_MPICH-3.2.zip |
| 32 bit | Gnu Compiler Collection (GCC) | Open MPI | HDFql-2.2.0_Linux32_GCC-4.9_OpenMPI-2.1.zip |
| 64 bit | Gnu Compiler Collection (GCC) | N/A | HDFql-2.2.0_Linux64_GCC-4.9.zip |
| 64 bit | Gnu Compiler Collection (GCC) | MPICH | HDFql-2.2.0_Linux64_GCC-4.9_MPICH-3.2.zip |
| 64 bit | Gnu Compiler Collection (GCC) | Open MPI | HDFql-2.2.0_Linux64_GCC-4.9_OpenMPI-2.1.zip |
| Architecture | Compiler | MPI | File |
| 64 bit | Gnu Compiler Collection (GCC) | N/A | HDFql-2.2.0_Darwin64_GCC-4.9.zip |
| 64 bit | Gnu Compiler Collection (GCC) | MPICH | HDFql-2.2.0_Darwin64_GCC-4.9_MPICH-3.2.zip |
| 64 bit | Gnu Compiler Collection (GCC) | Open MPI | HDFql-2.2.0_Darwin64_GCC-4.9_OpenMPI-2.1.zip |
CONTACT
© 2020
© 2020