Multi-Criteria Evaluation and Benchmarking for Active Queue Management Methods: Open Issues, Challenges and Recommended Pathway Solutions

Abstract

The evaluation and benchmarking processes of active queue management (AQM) methods are complicated and challenging. Several evaluation criteria/metrics must be considered before an AQM method can yield satisfactory performance using specific metric(s). Further investigations are required to highlight the limitations of how criteria/metrics are determined and how their procedures accord with the evaluation and benchmarking processes of AQM. In this paper, we presented comprehensive insights into the multi-criteria evaluation and benchmarking of AQM methods based on two critical directions. First, current AQM evaluation criteria are collected, analyzed and categorized. Second, these AQM evaluation criteria highlight conflicting issues and benchmarking techniques to identify weak points, and possible solutions are discussed. The findings of this study are as follows: (1) The limitations and problems of existing AQM evaluation and benchmarking methods, such as multi-evaluation criteria, criteria trade-off, benchmarking and criteria significance, are presented and emphasized. (2) Multi-criteria decision-making using multiple criteria, such as performance, processing overhead and configuration, can be used to benchmark numerous AQM methods to determine solutions for future directions.