A framework for distributed digital object services

Abstract

The following paper was written by the authors over a period of approximately 16 months during the period November 1993 to May 1995 in an attempt to explore a set of open research issues and to integrate them with certain ideas of a small group of researchers who had been briefed on the notions inherent in the Digital Object Architecture that one of the authors (Kahn) had been developing at the Corporation for National Research Initiatives (CNRI). This research group had been organized by CNRI as part of its "Computer Science Technical Reports" (CSTR) project that was funded by the Defense Advanced Research Projects Agency (DARPA). The CSTR project had several objectives, of which one was to digitize existing collections of technical reports from five leading computer science departments at universities in the U.S and make the reports available on the Internet. A second objective was to fund research at these institutions on digital libraries, especially research that made good use of their local collections. A third objective was to link heterogeneous electronic libraries, such as were being developed in the program. The difficulties inherent in this third objective ultimately led to this paper. In particular, the motivation arose from a set of concerns first expressed by these researchers at a meeting at CNRI on October 25, 1993 when the Digital Object Architecture was first presented to the research group by Kahn. In the discussion that resulted, many issues emerged, some of which we ultimately decided must be resolved in any architecture, and some of which-perhaps just as crucially-could be deferred for the time being. For example, questions arose about the role of semantics in identifiers; we decided to address them early on. Another issue that proved controversial was how to deal with situations in which the digital objects were actually mobile programs in the network. Since a digital object could contain other digital objects, this led directly to the notion of a mobile repository. The basic question was how best to describe this kind of situation and explain how to access information that was not at a known specific location or IP address on the net. We decided not to cover this aspect of the architecture in the interest of getting closure on the paper. A critical part of this effort was dealing with various intellectual property issues; and the architecture was designed to take this important aspect into account. We were fortunate to have the help of Ms. Patrice Lyons, an experienced intellectual property lawyer, in the formulation of certain key elements of the architecture dealing with terms and conditions for access to information, and in the drafting of the paper. Although her name does not appear on the paper, her insights and contributions played an important role in the preparation of the paper. One key component of the architecture is a general-purpose resolution system, known as the Handle System®, an implementation of which has been operational on the Internet since 1994. At present, close to 50 million identifiers are assigned to digital objects and resolvable by the system, which has been available 7x24 for many years. It is anticipated that the number of resolvable identifiers in the system will grow rapidly and could easily exceed a billion in the not too distant future.