Storage Resource Broker

Storage Resource Broker

Storage Resource Broker (SRB) is a Data Grid Management System (DGMS) operating in many U.S. and international computational science research projects. SRB is a logical distributed file system based on a client-server architecture which presents users with a single global logical namespace or file hierarchy.

Depending on the "flavor" of the configuration, use patterns, and policies, the SRB creates what is called a data grid, a digital library, persistent archive, and/or distributed file system.

SRB provides a uniform interface to heterogeneous data storage resources over a network. As part of this, it implements a logical namespace (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational database management system. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of Unix, Linux, and Microsoft Windows.

The SRB system is middleware in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational database management system, etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.

SRB is sometimes used in conjunction with computational grid computing systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) authentication system.

SRB can store and retrieve data in archival storage systems such as HPSS and SAM-FS, on disk file systems (Unix, Linux, or Windows), as Binary Large Objects or tabular data in relational database management systems, and on tape libraries.

The SRB has been used in production since 1997. Globally the SRB is estimated to be managing over two petabytes of data, as of 2008. That number is expected to grow at a rate of one petabyte a year. UCSD is currently managing over 1 petabyte of data in over 200 million files. Many other computer centers and consortia are independently managing additional SRB data collections.

While licensed, SRB source distributions are freely available to academic and non-profit organizations. Nirvana SRB, a commercial version of SRB, features capabilities specifically adapted to government and commercial use.

The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which is now the Data Intensive Cyber Environments (DICE) group), and now largely replaces the use SDSC SRB in research and academic communities. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable Rule Engine at its core and is fully open source.

Read more about Storage Resource Broker:  History

Famous quotes containing the words storage and/or resource:

    Many of our houses, both public and private, with their almost innumerable apartments, their huge halls and their cellars for the storage of wines and other munitions of peace, appear to me extravagantly large for their inhabitants. They are so vast and magnificent that the latter seem to be only vermin which infest them.
    Henry David Thoreau (1817–1862)

    Helping children at a level of genuine intellectual inquiry takes imagination on the part of the adult. Even more, it takes the courage to become a resource in unfamiliar areas of knowledge and in ones for which one has no taste. But parents, no less than teachers, must respect a child’s mind and not exploit it for their own vanity or ambition, or to soothe their own anxiety.
    Dorothy H. Cohen (20th century)