Abstract

The research is an outcome of the joint research program by Academia Sinica and the Council of Indigenous Affairs in 2013-2017. The aims of this paper are threefold: (1) to demonstrate the methods of data science in constructing the Taiwan Indigenous Peoples (TIPs) Open Research Data database (TIPD, see http://TIPD.sinica.edu.tw, and https://osf.io/e4rvz/, identifiers: DOI 10.17605/OSF.IO/E4RVZ, ARK c7605/osf.io/e4rvz) based on Taiwan Household Registration (THR) administrative data; (2) to illustrate automated and semi-automated data processing as methods for constructing effective open data; and (3) to demonstrate appropriate utilization of “old-school” data formats such as multi-dimensional tables as an effective means to overcome legal and ethical issues. The research extracts valuable information embedded in micro data of THR and enriches the extracted information through the processes of cleaning, cleansing, crunching, reorganizing, and reshaping the source data. The data enrichment processes produce a number of data sets that contain no individual information but retain most of the source data information. The enriched data sets thus can be open to the public as open data. The open data are systematically constructed mainly in an automated and partly in a semi-automated way through the integration of optimized hardware, compiler & script programming languages, computing software, and system script languages. Major outputs of TIPD amount to 31,000 files in number, totaling around 79 GB in size. TIPD consists of three categories of open research data: (1) categorical data, (2) household structure and characteristics data, and (3) population dynamics data. The potential contributions of TIPD are moves from “closed” to “open” , from “the elite” to “the ordinary”, from “local” to “global”, and from “macro and static” to “micro and dynamic” research. Keywords: big data, data science, open data, open science, TIPD, TIPs

Full Text

Published Version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.