To better manipulate the data from simulations with billions of records it is crucial that the engineering and scientific community adopts big data tools. VELaSSCo will provide a simulation data analysis platform consisting of:
- A database structure, based on widely used technologies such as Hadoop-HBase, that can organise and store a diverse range of large-scale simulation data sets for collaborative use.
- An innovative approach, adopting big data best practices, to handle large scale simulation data sets that have to be stored on multiple servers.
- A framework equipped with advanced in-situ processing tools to analyse the output of parallel simulation solvers.
- An analysis platform to analyse and visualize large-scale data sets interactively. This builds on leading edge graphics hardware.