Statistical Test Coverage for Linux-Based Next-Generation Autonomous Safety-Related Systems

Imanol Allende,Nicholas Mc Guire,Lisandro G Monsalve,Jens Petersohn,Jon Perez-Cerrolaza,Roman Obermaisser

doi:10.1109/access.2021.3100125

Abstract

Autonomous systems represent a significant leap forward in the ongoing technological evolution of dependable and safety-related systems, integrating features such as artificial intelligence, high-performance computing devices, General Purpose Operating Systems (GPOS) (e.g., GNU/Linux) and security requirements. Nonetheless, traditionally employed safety techniques and measures were not defined for safety-related systems with such features. Consequently, the need to research new methods and measures emerges in order to be able to achieve appropriate safety assurance. In this manuscript, we explore the limitations of traditional test coverage techniques, and we provide two complementary methods to pave the way towards the testing of Linux-based complex safety-related systems. The methods, which are based on statistical analyses, are presented and applied to a Linux-based Autonomous Emergency Braking (AEB) case study, specifically focusing on the kernel execution path test coverage.

Highlights

Next-generation autonomous systems represent a breakthrough for different industrial sectors and technological domains
Autonomous systems are currently even being deployed in use-cases with functional safety requirements [1], where a system failure can lead to a catastrophe, entailing a significant shift for dependable and safety-related domains
To pave the way towards the safety assurance of these complex systems, we focus our efforts on analyzing the test coverage of these systems, of the Operating System (OS)

Summary

INTRODUCTION

Next-generation autonomous systems represent a breakthrough for different industrial sectors and technological domains These state-of-the-art systems incorporate groundbreaking technologies that create novel use-cases and incorporate a higher level of autonomy to the existent ones. I. Allende et al.: Statistical Test Coverage for Linux-Based Next-Generation Autonomous Safety-Related Systems and (iii) have adequate evidence to justify the assumptions. Linux is the leading OS in different domains [5] and provides much of the features required by the next-generation safety-related systems (e.g., computing performance, concurrent computing, security, updating capabilities) [6]. We can state that Linux is already increasingly relied upon for mission-critical systems This manuscript extends previous research works [19], [20] that describe preliminary statistical test coverage analysis methods for Linux-based safety-related systems, with a simple but reproducible case study.

PROBLEM STATEMENT

METHOD 1

METHOD 2

Findings

DATA SET VALIDATION