Abstract
Network traffic optimisation is difficult as the load is by nature dynamic and seemingly unpredictable. However, the increased usage of file transfer services may help the detection of future loads and the prediction of their expected duration. The NOTED project seeks to do exactly this and to dynamically adapt network topology to deliver improved bandwidth for users of such services. This article introduces, and explains the features of, the two main components of NOTED, the Transfer Broker and the Network Intelligence component. The Transfer Broker analyses all queued and on-going FTS transfers, producing a traffic report which can be used by network controllers. Based on this report and its knowledge of the network topology and routing, the Network Intelligence (NI) component makes decisions as to when a network reconfiguration could be beneficial. Any Software Defined Network controller can then apply these decision to the network, so optimising transfer execution time and reducing operating costs.
Highlights
The goal of the NOTED (Network Optimized Transfer of Experimental Data) project is to predict the arrival and duration of large data transfers and, if and where relevant, to suggest appropriate changes to optimise the network configuration and so reduce transfer duration
Software Defined Network Controllers (SDNC) that are responsible for re-configuring the networks they control, guided by triggers from the Network Intelligence (NI), and so delivering better performance and reducing the duration of file transfers
The NOTED project has demonstrated that exploiting data from transfer services such as FTS can enable the successful prediction of network loads
Summary
The goal of the NOTED (Network Optimized Transfer of Experimental Data) project is to predict the arrival and duration of large data transfers and, if and where relevant, to suggest appropriate changes to optimise the network configuration and so reduce transfer duration. Detection of network congestion alone cannot lead to a proposal for an appropriate network optimisation Such proposals require knowledge of at least the source and the destination of a transfer and its predicted duration—there is no point proposing an optimisation for a transfer that will complete before the suggestion can be implemented. For this reason it is desirable to be able to predict when a large transfer will start so that the network configuration can be prepared in advance. To more precisely identify the source and destination of a data transfer, NOTED enriches the FTS transfer information with network addresses extracted from the CRIC (Computing Resource Information Catalog [3]) database used by the LHC experiments
Sign-in/Register to view highlights & summary 
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call