JULEA

JULEA is a flexible storage framework that allows offering arbitrary client interfaces to applications. To be able to rapidly prototype new approaches, it offers object and key-value backends that can either be client-side or server-side; backends for popular storage technologies such as POSIX, LevelDB and MongoDB have already been implemented.

Additionally, JULEA allows dynamically adapting the I/O operations' semantics and can thus be adjusted to different use-cases. It runs completely in user space, which eases development and debugging. Its goal is to provide a solid foundation for storage research and teaching.

For more information, please refer to the documentation.

Quick Start

To use JULEA, first clone the Git repository and enter the directory.

$ git clone https://github.com/wr-hamburg/julea.git
$ cd julea

JULEA has two mandatory dependencies (GLib and libbson) and several optional ones that enable additional functionality. The dependencies can either be installed using your operating system's package manager or with JULEA's install-dependencies script that installs them into the dependencies subdirectory using Spack. By default, the script will install a useful subset of dependencies; if you want to install all of them, call it with the full argument.

$ ./scripts/install-dependencies.sh

After the dependencies have been installed, JULEA has to be configured and compiled using Waf; the different configuration and build options can be shown with ./waf --help. The waf.sh script is a wrapper around Waf that makes sure that the dependencies installed in the previous step are found.

$ ./waf.sh configure --debug --sanitize
$ ./waf.sh build

To allow JULEA's binaries and dependencies to be found, the environment has to be loaded.

$ . ./scripts/environment.sh

Finally, a JULEA configuration has to be created.

$ julea-config --user \
  --object-servers="$(hostname)" --kv-servers="$(hostname)" --db-servers="$(hostname)" \
  --object-backend=posix --object-component=server --object-path=/tmp/julea/posix \
  --kv-backend=lmdb --kv-component=server --kv-path=/tmp/julea/lmdb \
  --db-backend=sqlite --db-component=server --db-path=/tmp/julea/sqlite

You can check whether JULEA works by executing the integrated test suite.

$ ./scripts/test.sh

To get an idea about how to use JULEA from your own application, check out the example directory.

$ ./waf.sh install
$ cd example
$ make run

Citing JULEA

If you want to cite JULEA, please use the following paper:

• JULEA: A Flexible Storage Framework for HPC (Michael Kuhn), In High Performance Computing, Lecture Notes in Computer Science (10524), (Editors: Julian Kunkel, Rio Yokota, Michela Taufer, John Shalf), Springer International Publishing, ISC High Performance 2017, Frankfurt, Germany, ISBN: 978-3-319-67629-6, 2017-11