
CAPIO: Cross Application Programmable I/O¶
Inject streaming capabilities into file-based legacy workflows.
CAPIO (Cross-Application Programmable I/O) is a middleware aimed at injecting streaming capabilities into workflow steps without changing the application codebase. It has been proven to work with C/C++ binaries, Fortran binaries, Java, Python and Bash. CAPIO also improves workflow execution times by improving burst-write performance.
Easy install with SPACK¶
CAPIO can be installed with SPACK in two steps:
# 1. Add the HPIO SPACK repository to your local installation of SPACK
spack repo add https://github.com/High-Performance-IO/hpio-spack.git
# 2. Automatically download, build and install CAPIO and all its dependencies
spack install capio
Integrations¶
CAPIO integrates with several Workflow Management Systems (WFMs):
CAPIO has been integrated with DagOn. For more information, please visit the DagOn-CAPIO official website.
We are actively working to integrate CAPIO with StreamFlow. Please come back soon for more information!
We have successfully integrated CAPIO with the workflow management system Dispel4py. To see an example of how to use it, take a look at our GitHub repository.
Showcase¶
CAPIO has been involved in several applications, and more generally in a number of different European-funded projects.
-
The 1000 Genome workflow is involved in sequencing the human genome. CAPIO has shown that it is capable of enhancing execution times for the 1000 Genome workflow.
-
The ADMIRE (Adaptive Multi-tier Intelligent data manager for Exascale) project, funded by the EU, has used CAPIO to improve performance in the weather-forecast use case.
-
The EUPEX project aims at providing a software stack for the exascale European initiative. CAPIO has been inserted inside the storage architecture tool set.
-
The ACROSS project provides a software stack for (but not limited to) numerical simulations. CAPIO has been used together with the STAR-CCM simulator.
A joint project from¶
-
UniTO — University of Torino, alpha parallel group
-
UniPi — University of Pisa
Team¶
-

Designer & maintainer
-

Workflow expert & maintainer
-

Project Manager
-

Designer
-

Designer
-

Former designer & maintainer