Formel Yaklaşımlar ile Sürüm Değerlendirme

Abstract

In this paper, a formal method-based release evaluation method was developed. During the release evaluation process, two versions of a server are run under similar (or the same) configurations and the system logs are compared. This comparison can be based on graphical analysis, applying fixed rules over logs or regression analysis. This paper presents a novel release evaluation approach based on formal methods. The proposed method consists of three main steps. The first step is the collection of data from both versions of the server. The second step is the synthesis of Signal Temporal Logic (STL) formulas for each dataset. The final step is the generation of the release evaluation result by comparing the formulas that have the same structure and that can represent both datasets with high accuracy. Thus, the proposed approach represents the release evaluation rules as STL formulas and generates such formulas from system logs in an automated way. Due to the resemblance of temporal logics to natural language, the resulting formulas explain the evaluation result. The proposed method automates the release evaluation process. The findings of the paper are shown over sample datasets.