Near-Line Data Store - Client documentation

The Near-Line Data Store (NLDS) is a multi-tiered storage solution that uses Object Storage as a front end cache to a tape library. It catalogs the data as it is ingested and permits multiple versions of files. It has a microservice architecture using a message broker to communicate between the parts. Interaction with NLDS is via a HTTP API, with a Python library and command-line client provided to users for programmatic or interactive use.

Contents:

• Installation
• Configuration File
• Catalog Organisation
• Tutorial
• Step-by-Step guide to setting up the NLDS client on JASMIN
• Status Codes
• Command Line Reference
• NLDS License

Indices and tables

• Index

• Module Index

• Search Page

Acknowledgements

NLDS was developed at the Centre for Environmental Data Analysis with support from the ESiWACE2 project. The project ESiWACE2 has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 823988.

NLDS is Open-Source software with a BSD-2 Clause License. The license can be read here.