​​

​The Challenge

 

In a world driven by data, managing distributed, unstructured information across multiple storage systems is a monumental challenge. Scientific applications demand scalable, efficient, and flexible solutions to avoid vendor lock-in, reduce costs, and enhance collaboration. Enter LOBCDER—a groundbreaking approach to data storage federation.

​

The Vision

 

LOBCDER transforms how distributed data is accessed, managed, and utilized by offering:

• Seamless Integration: Combining diverse storage technologies like Openstack-Swift, iRODS, and GridFTP.

• File System Transparency: Users experience data access as if it were local, while LOBCDER handles complex backend operations.

 

Why LOBCDER?

​

With LOBCDER, distributed applications gain a global shared view of storage space, enabling effortless data collaboration. Scientists and researchers can now work seamlessly, leveraging a scalable, transparent, and efficient storage solution.

Learn More

​

Key Features

​

1. Access Transparency: Interact with files as if they are stored locally, regardless of their actual location.

2. Location Transparency: File names remain consistent, no matter where the files are stored.

3. Concurrency Transparency: Ensures all clients share the same view of the file system state.

4. Heterogeneity Support: Works seamlessly across different platforms and operating systems.

5. Replication and Migration Transparency: Files can be replicated or moved without disrupting the user experience.

 

How It Works

​

LOBCDER operates through a multi-layered architecture:

1. Frontend Layer:

   • Access control via WebDAV, supporting versioning, locking, and custom properties.

   • Interoperability and secure user authentication with REST interfaces.

2. Resource Layer:

   • Logical representation of physical storage with metadata management.

   • Automates replication and deletion of files for optimal storage efficiency.

3. Backend Layer:

   • Provides a unified interface for physical storage resources.

   • Ensures consistency and reliability with ACID-compliant database systems.

 

​

Unlocking New Possibilities

​

​

​

More details about this work can be found in:



[1] S. Koulouzis, D. Vasyunin, R.S. Cushing, A.S.Z. Belloum, Cloud Data Storage Federation for Scientific Applications, In Proceedings of the Euro-Par 2013: Parallel Processing Workshops, Lecture Notes in Computer Science, Aachen, Germany, Aug 2013.

 

[2] Cloud Federation for Sharing Scientific Data S. Koulouzis, R. Cushing, D. Vasunin, A.S.Z Belloum and M.T. Bubak 8th IEEE International Conference on eScience (eScience 2012) Chicago, Illinois, 8-12 October 2012. [poster]

​

[3]  LOBCDER GitHub repository 







​



​