Open Archives Initiative Protocol For Metadata Harvesting Research Articles

Metadata harvesting for digital library integration in Ukraine: a comparative study of the OAI-PMH protocol and VuFind’s efficacy

Purpose This paper aims to the problem of building an environment to support scientific research in connection with the development of Open Science in Ukraine. Design/methodology/approach An overview of modern portals for aggregating scientific data was conducted. Analysis of available tools and identifying problems that arise when collecting data from digital libraries and journals was conducted. The validity of choosing VuFind as a tool that allows building an extraction–transformation–loading (ETL) approach for data aggregation and bringing the format and values of metadata fields to one view was experimentally verified. Findings During the experimental verification, problems related to the fact that the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) protocol does not have strict requirements for the data structure, which lead to the complexity of integration, despite the fact that this protocol occupied a leading position, were noted. To simplify these problems, an ETL approach that allowed for the use of ontological methods (e.g. data mapping, linked data and dictionaries to improve the semantics of data for integration processes) was considered. A review of the possibilities of modern tools for OAI-PMH integration, which were actively supported and developed, was conducted. Originality/value This paper was an attempt to outline the problems that arose in integrating resources, with the aim of developing future integration protocols that would have simple means of semantic data validation and built-in ETL mechanism.

Global status of dataset repositories at a glance: study based on OpenDOAR

PurposeThe study aims to shed light on the current state of “Dataset repositories” indexed in Directory of Open Access Repositories (OpenDOAR).Design/methodology/approachFrom each repository/record information, the Open-Access Policies, Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH), year of creation and the number of data sets archived in the repositories were manually searched, documented and analyzed.FindingsDeveloped countries like the United Kingdom and the USA are primarily involved in the development of institutional open-access repositories comprising significant components of OpenDOAR. The most extensively used software is DSpace. Most data set archives are OAI-PMH compliant but do not follow open-access rules. The study also highlights the sites’ embrace of Web 2.0 capabilities and discovers really simple syndication feeds and Atom integration. The use of social media has made its presence known. Furthermore, the study concludes that the number of data sets kept in repositories is insufficient, although the expansion of such repositories has been consistent over the years.Practical implicationsThe work has the potential to benefit both researchers in general and policymakers in particular. Scholars interested in research data, data sharing and data reuse can learn about the present state of repositories that preserve data sets in OpenDOAR. At the same time, policymakers can develop recommendations and policies to assist in the construction and maintenance of repositories for data sets.Originality/valueAccording to the literature, there have been numerous studies on open-access repositories and OpenDOAR internationally, but no research has focused on repositories preserving content-type data sets. As a result, the study attempts to uncover various characteristics of OpenDOAR Data set repositories.

A comparative study of India and Australia open access repositories in open DOAR

An open access repository or open archive is a digital platform that holds research output and provides free, immediate and permanent access to research results for anyone to use, download and distribute. To facilitate open access such repositories must be interoperable according to the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH). Search engines harvest the content of open access repositories, constructing a database of worldwide, free of charge available research. OpenDOAR is the quality-assured, global Directory of Open Access Repositories. Its repositories provide free, open access to academic outputs and resources. This paper deals with Comparative analysis of India and Australia repositories listed in OpenDOAR in terms of their growth, type, operational status, content type, software, subject coverage, language and policies regarding content, submission, and preservation. Keywords: Digital Repositories, Institutional Repositories, Open Access, OpenDOAR.

Developed DICOM standard schema with DSpace

PurposeThis paper aims to present a novel DSpace-based medical image repository system planned explicitly for storing and retrieving clinical images using digital imaging and communication in medicine (DICOM) metadata standards. DSpace institutional repository software is widely used in an academic environment for accessing and mainly storing text-related files. DICOM images are particular types of images embedded with much system-generated metadata and organised using DICOM metadata standards.Design/methodology/approachThe present paper talks about institutional repository software (DSpace) in archiving DICOM images. In the current study, the authors have tried to integrate the DICOM metadata standard with DSpace, which was compatible with Dublin Core (DC) and open archives initiative – protocol for metadata harvesting (OAI-PMH). After combining the DICOM standard with DSpace and the repository tested with a sample of 5,000 images, the retrieval results using various DICOM tags was very satisfactory. This study paves for the use of open source software (OSS) in storing and retrieving medical images.FindingsThe author has provided the DSpace software to recognised DICOM (.dcm) files in the first stage. In the second stage, a patch was developed to identify the DICOM metadata standard in Dspace, which has inbuilt DC metadata standards. Finally, in the third stage, retrieval efficiency was tested with a 5,000 .dcm image using the DICOM tag and the results were very fruitful.Research limitations/implicationsA major limitation of this study was the size of the data (5,000 DICOM images) with which the authors have tested the system. The system scalability has to be tested on various fronts like on cloud and local servers with different configurations, for which a separate study has to be done.Practical implicationsOnce this system is in place, DICOM users can stock, retrieve and access the image from the Web platform. Furthermore, this proposed repository will be the warehouse of various DICOM images with reasonable storage costs.Originality/valueIn addition to exploring the opportunities of free open source software (FOSS) implementation in medical science, this study includes issues related to the performance of an open-source repository for retrieving and preserving medical images. It created and developed Open Source DICOM Medical Image Library with DICOM metadata standard with the help of DSpace. Thus, the study will generate value for library professionals and medical professionals and FOSS vendors to understand the medical market in the context of FOSS.

Index development with the keyword in context method in the online library catalog

Academic libraries have an essential role in the academic community. As a reference center, libraries provide access to online reference sources or book collections. One of the facilities provided is the library automation which facilitate users to access library resources. With an online catalog that is easy to operate, it will be easier for users to get information. However, libraries generally only provide interface search facilities which make it difficult for users to find information. This study aims to produce an index on the online library catalog using the KWIC (KeyWord in Context) method. The data was collected from the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH) on the Library server. In the data harvesting process, around 50,000 data were found to be processed. The finding in this study indicates that the library’s online catalog metadata index makes it easier for users to retrieve information.

DATA CURATION DAN RESEARCH DATA MANAGEMENT UNTUK TERWUJUDNYA INTEGRASI DATA RISET DI INDONESIA

Indonesia is actively supporting the research process that is conducted in their research institutions, by providing research funds for them. Many research institutions in Indonesia work in the similar field and their funding could also come from the same source. Based on that reason, there is a need to evaluate the data curation and research data management processes at Indonesian research institutions. The purposes of this research are to evaluate the existing research data conditions at several research institutions, issues associated with research data management, standards and tools to support the implementation of research data management, also finding a way to achieve research data integration for research institutions in Indonesia. Interviews were used as the method to gain data from several research institutions in Indonesia then it was analysed with the qualitative data analysis. Ultimately, the result shows that data access problem, data collection and awareness of researcher are the main complexities of the research data management process. While policies and regulations on research data management are considered important by research institutions to guide them along the process. The result also shows that integration between research institutions could be achieved by using supporting tools and protocols such as OAI-PMH (The Open Archives Initiative Protocol for Metadata Harvesting) and API (Application Programming Interface), integrated system and standard data format.

Development of Web Services: A Practical Approach for Libraries

Integrated library system is a part of institutional digital repository in modern library environment. Some popular open source software has been used in this regard. Development of an integrated institutional digital repository system is possible on the basis of global recommendations and local requirements of all libraries. OAI-PMH in Koha can be displayed in two ways such as sets and metadata with multilingual documents. The benefits of this study is harvest the records from the other library and it can make the union catalogue for anybody can be accessed from this integrated OAI-PMH harvesting framework available in Koha OPAC. This is the web 2.0 concept to achieve the multiple tasks of different library resources such as books, journals, magazines, reference books etc. for the better management and retrieval of resources among the library users. Digital resources are increasing in this modern age due to exponential growth of technological impact and its peripherals. IDRs will additionally include digital materials that subsist outside the physical and administrative bounds of any one digital library. IDRs will include all the processes and accommodations that are the backbone and nervous system of libraries. The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) is a very high performance mechanism for client server architecture in repository interoperability. Broadly it can be classified in two ways such as data provider and service provider. Data Provider can access the structured standards global metadata by using OAI-PMH tool. Development of web services through Koha can be achieved in four ways such as OAI-PMH, ILS-DI, Z39.50, and OPAC tag cloud. On the other hand service providers then easily harvest the metadata through a set of six verbs of OAI-PMH based URL. Requests for data can be based on a timestamp range, and can be restricted to named sets defined by the provider. Data providers can only manage the XML based Dublin Core metadata format. It is possible to design and develop an integrated institutional digital repository in different ways. In this research paper highlights and displays the important interface such as OAI-PMH, ILS-DI, Z39.50, and tag cloud and all the interfaces have been displayed in Koha OPAC. The whole tasks have been developed and performed in Ubuntu operating system for easy installation, configuration, and retrieving of library resources among the users.

STUDI BANDING PERANGKAT LUNAK APLIKASI GANESHA DIGITAL LIBRARY (GDL) SEBAGAI REPOSITORY INSTITUSI BERBASIS OPEN SOURCE

The purpose of the research is to analyze the technical features of the Ganesha Digital Library (GDL) application with DSpace and Eprints, so that it will be proved technically whether the GDL application can meet the standards and criteria as the application software repository institution ?. Using experimental approach research methods by installing GDL, DSpace and Eprints application to further analyze and compare the technical features of the three applications. The results show that GDL application meet standards and criteria as institutional repository application, since they have most of the technical features of institutional repositories including the features of the OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting); has a dublincore metadata standard; and has been licensed to open source (General Public License) GPL that is needed for the utilization, use and development of institutional repository applications according to the needs of a college institution.

The Observation of Bahasa Indonesia Official Computer Terms Implementation in Scientific Publication

The government of the Republic of Indonesia had issued a regulation to substitute computer terms in foreign language that have been used earlier into official computer terms in Bahasa Indonesia. This regulation was stipulated in Presidential Decree No. 2 of 2001 concerning the introduction of official computer terms in Bahasa Indonesia (known as Senarai Padanan Istilah/SPI). After sixteen years, people of Indonesia, particularly for academics, should have implemented the official computer terms in their official publications. This observation is conducted to discover the implementation of official computer terms usage in scientific publications which are written in Bahasa Indonesia. The data source used in this observation are the publications by the academics, particularly in computer science field. The method used in the observation is divided into four stages. The first stage is metadata harvesting by using Open Archive Initiative - Protocol for Metadata Harvesting (OAI-PMH). Second, converting the harvested document (in pdf format) to plain text. The third stage is text-preprocessing as the preparation of string matching. Then the final stage is searching the official computer terms based on 629 SPI terms by using Boyer-Moore algorithm. We observed that there are 240,781 foreign computer terms in 1,156 scientific publications from six universities. This result shows that the foreign computer terms are still widely used by the academics.

Discovery Products and the Open Archives Initiative Protocol for Metadata Harvesting

ABSTRACTDiscovery products promise to offer library patrons one-stop shopping for library resources. In order to accomplish this, they harvest metadata from various library databases and repositories such as integrated library systems, institutional repositories, and digital libraries. Discovery products then index this metadata along with the metadata for resources from the discovery service into a single product for search. The most common method used to harvest local metadata is the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH). This column first looks at discovery, then it describes OAI-PMH and some of the issues involved with effectively harvesting library metadata.

EXPLORAÇÃO DO ACERVO DA RAE-REVISTA DE ADMINISTRAÇÃO DE EMPRESAS (DE 1961 A 2016) À LUZ DA BIBLIOMETRIA, TEXT MINING, REDE SOCIAL E GEOANÁLISE

RESUMO Este artigo analisou mais de cinco décadas do acervo da Revista de Administração de Empresas (RAE), entre 1961 e 2016, pelo acesso aos documentos disponibilizados via internet no repositório eletrônico de periódicos e revistas da Biblioteca Digital da Fundação Getulio Vargas - Escola de Administração de Empresas de São Paulo, o qual segue o protocolo aberto Open Archives Initiative - Protocol for Metadata Harvesting (OAI-PMH) de interoperabilidade entre repositórios digitais. Um total de 2.381 documentos publicados no periódico (1.422 artigos, 217 editoriais, 62 pensatas e 680 resenhas) foi coletado de modo automatizado e posteriormente analisado com a utilização de técnicas de bibliometria, text mining, rede social e geoanálise. Este estudo permite compreender a trajetória da existência do periódico RAE em seus 22 diferentes períodos de gestão, o incremento da autoria nas publicações do periódico em 14 intervalos de tempo, os termos e palavras-chave com mais frequência e importância nos documentos publicados, bem como a formação das redes de coautoria dos pesquisadores que contribuíram para o desenvolvimento da ciência da Administração no País.

Gestión de fondos de archivos con datos enlazados y consultas federadas

In this paper the major technologies of the Semantic Web which may be useful for archives management are summarized. Several local and international projects that generate ontologies from standardized descriptions based on ISAD-G are examined. It is also discussed LIAM (Linked Archival Metadata), that facilitates the transformation of archive records into RFD (Resource Description Framework) format. Furthermore, we analyze how Linked Data enables interoperability between information systems and faceted search of OWL (Ontology Web Language), SKOS (Simple Knowledge Organization System) and Dublin Core records. The authors propose the use of a CMS (Content Management System) compatible with SIOC (Semantically-Interlinked Online Communities) and OAI-PMH (Open Archives Initiative - Protocol for Metadata Harvesting) for archive records to improve the exchange and retrieval of information. We specifically describe the technologies used for developing CoroArchivo, system assessed by an experiment that automatically generates ontologies from ISAD-G records stored in DSpace. The evaluation tool lets users perform federated queries based on the OWL vocabulary disjointness and equivalent classes.

Analytical study of open access health and medical repositories

Purpose This study aims to assess open access (OA) repositories in the field of the health and medicine (H&M) available in the Directory of the Open Access Repositories (OpenDOAR) by analysing their various facets like geographical distribution, language diversity, collection size, content types, operational status, interoperability, updating policy and software used for content management. Design/methodology/approach To achieve the objectives of the study, the OpenDOAR was selected as a source for identifying the H&M repositories. The required data were manually collected from 1 to 30 April 2014 and analysed using various quantitative techniques to reveal the findings. Findings The results reveal that the OpenDOAR lists 254 repositories in the field of the H&M contributed by the 62 countries of the world, topped by the USA (15.4 per cent), followed by Japan (7.9 per cent) and the UK (7.5 per cent). The majority of the repositories are institutional (187, 73.6 per cent) in nature, having less than 5,000 items (161, 63.4 per cent) in the collection and mostly consisting of articles (76.0 per cent), theses (49.6 per cent), unpublished documents (33.1 per cent) and books (31.9 per cent). The linguistic assessment shows that the majority of the H&M repositories accept content written in English language (71.3 per cent), followed by Spanish (16.1 per cent) and Japanese (7.5 per cent). The updating policy of these repositories is not up to the mark, as only 67.0 per cent of the H&M repositories have been updated from 2008-2012, but the majority are still operational (91.7 per cent) and are compatible (67.3 per cent) with the Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH). About 30 software brands, both commercial and open source, have been used by administrators for creating these repositories and managing their content. DSpace is the most popular software used by 88 (34.7 per cent) repositories, followed by EPrints (43, 16.9 per cent) and Digital Commons (18, 7.1 per cent). Research limitations/implications The scope of this study is limited to the health and medical repositories listed in OpenDOAR, and hence the generalisation is to be cautioned. Practical implications This study is useful for library and information professionals and health and medical professionals across the globe. Originality/value This study is the first attempt to analyse the health and medical repositories in OA sites.

OAI-PMH Harvested Collections and User Engagement

ABSTRACTDiscovery tools are used in libraries to bring together books, articles, and other resources. Research has focused on user and librarian evaluation of these tools, but there are few evaluations of non-book and non-article sources. Discovery tools can also include metadata for local collections harvested through the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH). Creating these harvests can be time consuming for staff, so it is important for libraries to understand if and how patrons use these records. The University of Nebraska-Lincoln Libraries (UNL Libraries) harvests metadata from local collections into the Encore discovery tool. A study was conducted to analyze patron use of OAI-harvested records. This study analyzed usage data for harvested collections obtained from different discovery sources and referrals through Encore. Google Analytics was used to evaluate searcher behavior differences between content referred through Encore and other referrals. Although discovery through Encore did not result in high numbers of traffic, there is evidence that patrons who discover records through Encore take more time looking through records than patrons using other discovery methods. This increase in time is a measure of engagement and may be reason enough for libraries to consider adding OAI-harvested collections to their discovery tool.

An analysis of file format control in institutional repositories

Purpose– The purpose of this paper is to analyze the file formats of the digital objects stored in two of the largest open-access repositories in Spain, DDUB and TDX, and determines the implications of these formats for long-term preservation, focussing in particular on the different versions of PDF.Design/methodology/approach– To be able to study the two repositories, the authors harvested all the files corresponding to every digital object and some of their associated metadata using the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) and Open Archives Initiative Object Reuse and Exchange (OAI-ORE) protocols. The file formats were analyzed with DROID software and some additional tools.Findings– The results show that there is no alignment between the preservation policies declared by institutions, the technical tools available, and the actual stored files.Originality/value– The results show that file controls currently applied to institutional repositories do not suffice to grant their stated mission of long-term preservation of scientific literature.

Augmenting OAI-Based Service Providers with Non-OAI Metadata Sources

Discovery tools for scholarly information have largely depended upon free-text search engines until the arrival of Open Archive Initiative Protocol for Metadata Harvesting (OAI-PMH)–based services. OAI-based service providers are meant to provide a metadata-based unified search for widely distributed scholarly resources. While the proliferation of OAI-PMH–compliant repositories is a welcome development, its overall adoption in these primary resources has been slow. Compared to the vast number of active peer-reviewed journals available today, very few of them expose their metadata through the OAI interface. The publishers have been promoting their publications through various web-based media including email alerts, RSS feeds, and an online table of contents. This paper describes an experiment that exploits these non-OAI Web-based sources for extracting metadata, which can be used in enhancing an OAI-based service provider.

Enhanced OAI-PMH services for metadata sharing in heterogeneous environments

Purpose– This paper aims to propose a toolset that enables individual digital collections owners to satisfy the requirements of aggregators even in cases where their IT and software infrastructure is limited and does not support them inherently. Managers of repositories/digital collections face the challenge of exposing their data via Open Archives Initiative – Protocol for Metadata Harvesting (OAI-PMH) to multiple aggregators and conforming to their possibly differing requirements, for example on output metadata schemas and selective harvesting.Design/methodology/approach– The authors developed a software server that is able to wrap existing systems or even metadata records in plain files as OAI-PMH sources. They analysed the functionality of OAI-PMH data providers in a flow of discrete steps and used a software library to modularise the software for these steps so that the whole process can be easily customised to the needs of each pair of OAI-PMH data provider and service provider. The developed server includes a mechanism for the implementation of schema mappings using an XML specification that can be defined by non-IT personnel, for example metadata experts. The server has been applied in various real-life use cases, in particular for providing content to Europeana.Findings– It has been concluded through real-life use cases that it is indeed possible and feasible in practice to expose metadata records of digital collections via OAI-PMH even when the data sources do not support the required protocols and standards. Even advanced OAI-PMH features like selective harvesting can be supported. Mappings between input and output schemas in many practical cases can be implemented entirely or to a large extent as XML specifications by metadata experts instead of software developers.Practical implications– Exposing data via OAI-PMH to aggregators like Europeana is made feasible/easier for digital collections owners, even when their software infrastructure does not inherently support the required protocols and standards.Originality/value– The approach is original and applicable in practice to diverse technology environments, effectively addressing the indisputable fact of the heterogeneity of software and systems used to implement digital repositories and collections worldwide.

Interweaving OAI-PMH data sources with the linked data cloud

The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) has found widespread adoption for exchanging bibliographic metadata. In parallel, the W3C's Linking Open Data Initiative exposes and interlinks structured data from a variety of data sources on the web. Since many of these data sources contain valuable information for institutional repositories (e.g., shared concept definitions, thesauri, etc.), we believe that institutions that currently expose their data via OAI-PMH can benefit if they integrate their metadata with the data available in the Linked Data cloud. To achieve such an integration, we must bridge the OAI-PMH-specific protocol characteristics that currently prevent OAI-PMH metadata from being interoperable with the Linked Data approach of exposing data. As first contribution of this paper, we describe a possible solution for exposing OAI-PMH metadata on the web as part of the Linked Data cloud. As a second contribution, we present a rule-based mechanism for linking these metadata with other relevant data sources together with a case study that describes possible linking scenarios for three representative OAI-PMH data providers. Finally, we discuss certain quality criteria that OAI-PMH metadata must meet to benefit from data exposed by other Linked Data sources.

Metadata for Special Collections in CONTENTdm: How to Improve Interoperability of Unique Fields Through OAI-PMH

Collection curators develop locally defined unique fields to support local requirements. As per the guidelines of the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH), Simple Dublin Core is the minimum requirement for exposing metadata to aggregators. Oftentimes the level of specificity of unique local fields is not translated well to Dublin Core, which may hinder the interoperability of the item metadata record. This paper researched 21 digital collections that were hosted in CONTENTdm. The objective was to explore the use and issues of unique fields in local context and recommend best practices that will increase the interoperability of metadata for special collections.

Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use

Abstract Many cultural heritage organizations responsible for providing access to large online collections recognize the potential value that social tagging systems can add to their collections. Projects such as Steve.Museum aim to give online users a voice in describing the content of publicly-held collections of digital heritage, through online social tagging and annotation tools. However, there are a number of unresolved challenges associated with re-using community tags, aggregating them within the museum's authoritative metadata stores and incorporating them within museum “metasearch” services. Although social tagging sites provide simple, user-relevant tags, there are issues associated with the quality of the metadata, the scalability compared with conventional indexing systems and a lack of interoperability across social tagging and annotation systems. In this paper, we propose an integrated system that overcomes many of the limitations of social tagging systems and maximizes their potential value-add within the context of museum collections. The Harvesting and Aggregating Networked Annotations (HarvANA) system firstly enables communities to attach tags/annotations to digitized 3D museum artefacts through web-based annotation services. The annotations/tags are represented using a standardized but extensible Resource Description Framework (RDF) model and an ontology-directed folksonomy. This approach facilitates interoperability between tags/annotations. Secondly, the system uses the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) API to automatically harvest the annotations/tags from distributed community servers. The harvested annotations are aggregated with the authoritative museum metadata in a centralized metadata store. The HarvANA system provides a streamlined, interoperable, scalable approach that enables cultural organizations to leverage community enthusiasm for tagging and annotation, augment their institutional metadata with community tags and enhance their discovery and browse services over 3D models.