A Generic Continuous Technical Reporting System Using Open-Source Technology

Abstract

While data has become more available over time, transforming raw data into insight remains a bottleneck in the knowledge generation process. Recurrent analytical reports require a series of repetitive steps including data gathering, validation, processing, quality checks, and finally, a report with the interpretation of observed trends and other analytical summaries. Conventional continuous reporting solutions often require sacrificing either scalability or flexibility. This paper describes a framework for the continuous production of technical reports based in R, Jenkins and Git open-source technologies. The proposed framework provides an interactive analytical environment suitable for data exploration in constantly evolving projects, while allowing implementing robust software when reaching acceptable long-term analytical solutions.