Abstract

The high heterogeneity of 5G use cases requires the extension of the traditional per-component testing procedures provided by certification organizations, in order to devise and incorporate methodologies that cover the testing requirements from vertical applications and services. In this paper, we introduce an experimentation methodology that is defined in the context of the 5GENESIS project, which aims at enabling both the testing of network components and validation of E2E KPIs. The most important contributions of this methodology are its modularity and flexibility, as well as the open-source software that was developed for its application, which enable lightweight adoption of the methodology in any 5G testbed. We also demonstrate how the methodology can be used, by executing and analyzing different experiments in a 5G Non-Standalone (NSA) deployment at the University of Malaga. The key findings of the paper are an initial 5G performance assessment and KPI analysis and the detection of under-performance issues at the application level. Those findings highlight the need for reliable testing and validation procedures towards a fair benchmarking of generic 5G services and applications.

Highlights

  • The 5th Generation of mobile networks (5G) enables innovative use cases and services that provide the over the top service providers (a.k.a, verticals) with unprecedented performance capabilities

  • These Key Performance Indicators (KPIs) are based on internal counters of the network, which are only accessible to the network operators; in our methodology, in order to provide direct information on the achievable performance under different 5G use cases, the definitions of KPI privilege instead the end-user perspective, in terms of Quality of Service (QoS) and Quality of Experience (QoE)

  • The proposed methodology has been composed in order to specify the actions that are needed for the execution of an experiment on 5G infrastructures; and, to structure the information flow required from the design and set of an experiment to the collection of the results

Read more

Summary

Introduction

The 5th Generation of mobile networks (5G) enables innovative use cases and services that provide the over the top service providers (a.k.a, verticals) with unprecedented performance capabilities. Sensors 2020, 20, 6652 to incorporate E2E aspects, far beyond the conventional component-oriented testing (which, so far, is mainly focused the radio access network [4]) In this context, huge efforts are being made worldwide by 5G standardization, research, and stakeholder communities towards the implementation of experimental testbeds, where 5G technologies and KPIs can be reliably measured and validated in heterogeneous scenarios. E2E methodology for testing and validation of 5G technologies and KPIs. More precisely, the 5GENESIS testing methodology follows a modular approach and it includes three logical components, referring to three configuration/input information classes required for running an experiment, namely, the test cases, the scenarios, and the slices.

Background and Related Work
Standardization on 5G KPI Testing and Validation
Research on 5G KPI Testing and Validation
Overview of 5GENESIS Approach to KPI Testing and Validation
Formalization of the Experimentation Methodology
Test Case
Scenario
Background traffic
Experiment Descriptor
Experiment Execution
Experimental Setup
Test Case Definition
Scenario Definition
Slice Definition
ED Definition
KPI Nalidation across Different Scenarios
KPI Validation across Different Configurations
KPI Validation across Different Technologies
Conclusions

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.