Large File Transfers Research Articles

GI-FI Technology using UWB Modulation

Abstract: Gi-Fi or Gigabit Wireless refers to wireless with data transfer rates in excess of a billion bits (Gigabit) per second. Ten times faster than other technologies. Its chip offers multi-gigabit transfer rates in a local environment up to 5 Gbit/s at a distance of 10 meters. It is the world's first transmitter integrated on a single CMOS chip and operates in the currently largely unused 60 GHz frequency band. It uses a 5mm square chip with a 1mm antenna that uses less than times to transmit data at high speed over short distances, just like Bluetooth. The exciting features and\advantages of this new technology can influence the most anticipated technologies in the huge global market\to transform large file transfers\in seconds. It should be the key wireless technology enabling the digital economy of the future. Gi-Fi speeds up wireless communication.

VIDEO SENSOR OVER ULTRA-LOW POWER RELAY WIRELESS NETWORKS

Ultra-low-power wireless networks have a vast array of potential applications, which are becoming increasingly achievable as technology gets smaller. Before these systems can be used to their full potential, however, efficient methods of data transfer are imperative in order to keep power consumption low while allowing the devices to cooperate as one unit or group. The transfer of large files, such as image data, presents a particular challenge because of the size limits imposed by the 802.15.4 MAC protocol. Operating sensory nodes at larger distances than normal also results in significant data loss. This paper presents a solution to this issue using a modified sensor network that includes nodes dedicated to listening for packet recovery. A set of algorithms is devised in order to allow nodes to detect missing data from a source as well as offer the ability to request that missing data from one of the dedicated relay nodes. The methods described were tested with the iMote2 device and found to almost double the distance at which two nodes can be placed from each other while still maintaining reliable data transfer. It was also concluded that the Linux driver in charge of passing values from the 802.15.4 chip to the MAC layer does not properly pass the Cyclical Redundancy Check (CRC) result into the MAC frame. As a result, it is not possible to filter out corrupt data at the application layer.

Appraisal Method for Similarity of Large File Transfer Software

Appraisal Method for Similarity of Large File Transfer Software

Fuzzy Logic Based Secured Routing In Vanets

Vehicular Adhoc Network (VANET) is becoming a fundamental important component of Intelligent Transport System (ITS). VANET is one of the evolutionary network for providing safety related services, management of traffic and other user related services. VANET communication involves either Vehicle to Infrastructure (V2I) or Vehicle to Vehicle (V2V). In the current scenario, Multi-hop Authenticated Proxy Mobile IP (MA-PMIP) scheme is used in VANET where only 3G networks is considered and the scheme is unable to support transmission of substantial massive data while maintaining the security. The performance of MAPMIP drastically degrades during transmission of huge volume of data which leads to huge power dissipation. To overcome these problems a novel Fuzzy logic Based Secured Routing (FBSR) mechanism is proposed. The FBSR prevents Sink hole attack and Sybil attack. In order to avoid collision during large file transfer, TDMA and multi-threading concepts are introduced in FBSR. Furthermore, the performance of FBSR is compared with contemporary routing protocols OLSR and AODV.

On the performance of OFDM and single carrier communication over wideband HF channel: theory and practice

Using wideband High Frequency (WBHF) communication has not been a luxury now due to the urgent need for the transfer of large files over long distances without the need for sophisticated infrastructure. The channel model helps in evaluating the performance of communications systems without the need for a real transmission. The existing HF ITU-R(International Telecommunication Union Radio) channel models are valid only for narrowband channels of bandwidth 3KHz and are valid up to 12KHz. Another channel model for WBHF with bandwidth up to 1MHz was given by Vogler yet, the model was mathematically intractable and allow no further analysis to take place. Noting that, WBHF demands channel bandwidth greater than 12KHz (e.g:24KHz). In this paper, we present a WBHF channel model that is both accurate and mathematically tractable laying the foundation for an informative comparison between different communication systems. The accuracy of the proposed model is first to cross verified against Vogler’s wideband model in terms of the channel impulse response, frequency response and channel scattering characteristics. This comparison leaves our model qualified to evaluate a newly developed standard of HF wideband Waveforms presented to support high data rates and link reliability requirements. Further, we establish a detailed comparison between OFDM and single carrier signaling schemes over the considered WBHF proposed ionospheric channel, under many parameters that affect the performance of both systems. We investigate the justification of using both systems under different channel conditions, we also derive the necessary rate formulas for each signaling scheme and provide simulation environment of both systems on selected samples of the ITU-R channel models for the HF ionospheric channel representing most of the channel conditions. It is coming up that in quiet channel conditions the OFDM outperforms SCCP, while in disturbed conditions SCCP shows more robustness against channel conditions than OFDM. Simulation results are shown that support our analytical results. In addition, we present a Software Defined Radio Hardware implementation of an OFDM wideband HF Transceiver. The developed implementation has been evaluated using an equivalent baseband channel model based on the ITU-R HF channel model.

Joint Bandwidth Assignment and Routing for Power Saving on Large File Transfer with Time Constraints

The increase in network traffic in recent years has led to increased power consumption. Accordingly, many studies have tried to reduce the energy consumption of network devices. Various types of data have become available in large quantities via large high-speed computer networks. Time-constrained file transfer is receiving much attention as an advanced service. In this model, a request must be completed within a user-specified deadline or rejected if the requested deadline cannot be met. Some bandwidth assignment and routing methods to accept more requests have been proposed. However, these existing methods do not consider energy consumption. Herein, we propose a joint bandwidth assignment and routing method that reduces energy consumption for time-constrained large file transfer. The bandwidth assignment method reduces the power consumption of mediate node, typically router, by waiting for requests and transferring several requests at the same time. The routing method reduces the power consumption by selecting the path with the least predicted energy consumption. Finally, we evaluate the proposed method through simulation experiments.

Tree Lab: Portable genomics for Early Detection of Plant Viruses and Pests in Sub-Saharan Africa.

In this case study we successfully teamed the PDQeX DNA purification technology developed by MicroGEM, New Zealand, with the MinION and MinIT mobile sequencing devices developed by Oxford Nanopore Technologies to produce an effective point-of-need field diagnostic system. The PDQeX extracts DNA using a cocktail of thermophilic proteinases and cell wall-degrading enzymes, thermo-responsive extractor cartridges and a temperature control unit. This closed system delivers purified DNA with no cross-contamination. The MinIT is a newly released data processing unit that converts MinION raw signal output into nucleotide base called data locally in real-time, removing the need for high-specification computers and large file transfers from the field. All three devices are battery powered with an exceptionally small footprint that facilitates transport and setup. To evaluate and validate capability of the system for unbiased pathogen identification by real-time sequencing in a farmer’s field setting, we analysed samples collected from cassava plants grown by subsistence farmers in three sub-Sahara African countries (Tanzania, Uganda and Kenya). A range of viral pathogens, all with similar symptoms, greatly reduce yield or destroy cassava crops. Eight hundred (800) million people worldwide depend on cassava for food and yearly income, and viral diseases are a significant constraint to its production. Early pathogen detection at a molecular level has great potential to rescue crops within a single growing season by providing results that inform decisions on disease management, use of appropriate virus-resistant or replacement planting. This case study presented conditions of working in-field with limited or no access to mains power, laboratory infrastructure, Internet connectivity and highly variable ambient temperature. An additional challenge is that, generally, plant material contains inhibitors of downstream molecular processes making effective DNA purification critical. We successfully undertook real-time on-farm genome sequencing of samples collected from cassava plants on three farms, one in each country. Cassava mosaic begomoviruses were detected by sequencing leaf, stem, tuber and insect samples. The entire process, from arrival on farm to diagnosis, including sample collection, processing and provisional sequencing results was complete in under 3 h. The need for accurate, rapid and on-site diagnosis grows as globalized human activity accelerates. This technical breakthrough has applications that are relevant to human and animal health, environmental management and conservation.

一种基于BlueSolei + FTP的蓝牙大文件传输方法

一种基于BlueSolei + FTP的蓝牙大文件传输方法

Scheduling for Time-Constrained Big-File Transfer Over Multiple Paths in Cloud Computing

Enormous increase in the scale of big-file generated by cloud computing has brought many challenges to both computational and transfer infrastructures. For large file transfer in cloud computing, the scheduling with intelligent routing is indispensable to improve the efficiency of network resource, especially when file transfer over multiple paths is allowed. However, it is a non-trivial task to efficiently select a set of feasible paths for file transfer under a tight delay constraint. In this paper, we consider two kinds of file transfer scheduling problems: single-file transfer scheduling (SFTS) and multi-file transfer scheduling (MFTS), both of which require the file transfer to be conducted under a delay constraint. To address the SFTS problem, a heuristic algorithm together with an exact algorithm SFTS-A is proposed. Comparing with the exact algorithm, the heuristic algorithm takes less running time and is able to address the SFTS problem efficiently although the solution may not be optimal, which is adequately illustrated by simulation results. For the MFTS problem, we propose a heuristic algorithm MFTS-H with dynamic reconfiguration scheme for addressing the transfer scheduling problem for multiple concurrent files. The corresponding simulation results demonstrate that the proposed algorithm can efficiently support multiple file transfer over multiple paths in terms of delay and bandwidth utilization.

Joint Bandwidth Scheduling and Routing Method for Large File Transfer with Time Constraint and Its Implementation

In recent years, the number of requests to transfer large files via large high-speed computer networks has been increasing rapidly. Typically, these requests are handled in the “best effort” manner which results in unpredictable completion times. In this paper, we consider a model where a transfer request either must be completed by a user-specified deadline or must be rejected if its deadline cannot be satisfied. We propose a bandwidth scheduling method and a routing method for reducing the call-blocking probability in a bandwidth-guaranteed network. Finally, we show their excellent performance by simulation experiments.

P194 A comprehensive data management solution for next generation sequencing (NGS)

Aim Introducing NGS technology to the laboratory creates a need for additional IT infrastructure in comparison to previously introduced technologies. After a comprehensive evaluation, the Immucor Mia Fora NGS Flex kits were selected to be introduced into the Melbourne and Sydney laboratories running on the Illumina NGS platforms. Methods We immediately engaged with our IT department to detail a plan for roll out. The initial focus of the roll out required a decision on the software platform and server; Immucor offered both a Linux and a windows software application and provision of the application server. As NGS generates a significant volume of data, the plan required evaluation of the ability of the network to support transfer of large data files across the LAN and WAN and provision for centralised storage of the data. The requirements for system support, data backup/retrieval and provision of a test environment also needed to be determined. At the Blood Service all laboratory supported software applications are classified as requiring a particular IT service level based on the nature of the clinical service. We assessed the NGS solution as ‘Gold’ service level, requiring that our IT department could return the application to service within 24 h, with zero data loss; hence a robust backup design including disaster recovery was required. Results The Windows application and software were selected and the IT department determined that the best solution was to provide a local server compatible with existing application servers to be centrally located in Melbourne. The detailed rollout plan included a solution architect design to meet the above requirements including the installation and operational qualifications. Conclusions Early engagement with our IT department ensured a comprehensive data management solution for roll out of the NGS technology.

Named Data Networking in Climate Research and HEP Applications

The Computing Models of the LHC experiments continue to evolve from the simple hierarchical MONARC[2] model towards more agile models where data is exchanged among many Tier2 and Tier3 sites, relying on both large scale file transfers with strategic data placement, and an increased use of remote access to object collections with caching through CMS's AAA, ATLAS' FAX and ALICE's AliEn projects, for example. The challenges presented by expanding needs for CPU, storage and network capacity as well as rapid handling of large datasets of file and object collections have pointed the way towards future more agile pervasive models that make best use of highly distributed heterogeneous resources. In this paper, we explore the use of Named Data Networking (NDN), a new Internet architecture focusing on content rather than the location of the data collections. As NDN has shown considerable promise in another data intensive field, Climate Science, we discuss the similarities and differences between the Climate and HEP use cases, along with specific issues HEP faces and will face during LHC Run2 and beyond, which NDN could address.

Improving ISO 11783 file transfers into mobile farm equipments using on-the-fly data compression

It is considered the bandwidth bottleneck problem arising in ISO 11783 networks of mobile farm equipments when large file transfers are performed. To overcome this problem, a compression protocol called ISOBUSComp allowing the implementation of dynamic (“on the fly”) data compression services for general ISO11783 file transfers is proposed. As a result, transmitting Electronic Control Units are free to choose any data compression technique they wish and receiving Electronic Control Units need not to be aware of such decisions, but just be able to process a suitable Universal Decompression Virtual Machine. Comprehensive simulation studies show that dynamic data compression services built upon the proposed protocol help to reduce bus utilization of ISO 11783 networks between a 28% and a 63%, thus speeding up the time for large file transfers.

MAGI: a Node.js web service for fast microRNA-Seq analysis in a GPU infrastructure.

Summary: MAGI is a web service for fast MicroRNA-Seq data analysis in a graphics processing unit (GPU) infrastructure. Using just a browser, users have access to results as web reports in just a few hours—>600% end-to-end performance improvement over state of the art. MAGI’s salient features are (i) transfer of large input files in native FASTA with Qualities (FASTQ) format through drag-and-drop operations, (ii) rapid prediction of microRNA target genes leveraging parallel computing with GPU devices, (iii) all-in-one analytics with novel feature extraction, statistical test for differential expression and diagnostic plot generation for quality control and (iv) interactive visualization and exploration of results in web reports that are readily available for publication.Availability and implementation: MAGI relies on the Node.js JavaScript framework, along with NVIDIA CUDA C, PHP: Hypertext Preprocessor (PHP), Perl and R. It is freely available at http://magi.ucsd.edu.Contact: j5kim@ucsd.eduSupplementary information: Supplementary data are available at Bioinformatics online.

The performance improvements of highly-concurrent grid-based server

Server performance is one of the critical activities in the data grid environment. A large number of applications require access to huge volumes of data from grid servers. In this case, efficient, scalable and robust grid server which can deal with large file transfer concurrent is needed. In this paper, we analyze the bottleneck of our grid servers and introduce user-space I/O scheduling, zero copy and event-driven architecture in our grid server to improve the servers’ performance. The user-space I/O scheduling can save almost 50% I/O time in a huge number of small files transfer. Grid servers can elimination CPU consumptions between kernel and user space by zero copy and cut 63% times for context switches. Event-driven architecture will save 30% CPU usage to reach the best performance by thread-driven architecture. Optimization method combination of these three above are used in our grid servers, the full-load throughput of our system is 30% more than traditional solutions and only 60% CPU consumed compared with traditional solutions.

Wifi on steroids: 802.11AC and 802.11AD

The advent of bandwidth-hungry wireless applications such as large file transfer, high definition video streaming, wireless display, and cellular data offload highlight the impending need for larger bandwidth and super speed WiFi links exceeding 1 Gb/s. This article introduces two emerging standards likely to shake the wireless world, namely IEEE 802.11ac and IEEE 802.11ad, and identifies the challenges in the path of multi-gigabit WiFi. We study the suitability of these standards for the new usage models enlisted in this article.

UltraFlow Access Testbed: Experimental Exploration of Dual-Mode Access Networks

Electrical packet switching is well known as a flexible solution for small data transfers, whereas optical flow switching (OFS) might be an effective solution for large Internet file transfers. The UltraFlow project, a joint effort of three universities, Stanford, Massachusetts Institute of Technology, and University of Texas-Dallas, aims at providing an efficient dual-mode solution (i.e., IP and OFS) to the current network. In this paper, we propose and experimentally demonstrate UltraFlow Access, a novel optical access network that enables dual-mode service to the end users: IP and OFS. The new architecture cooperates with legacy passive optical networks (PONs) to provide both IP and novel OFS services. The latter is facilitated by a novel optical flow network unit (OFNU) that we have proposed, designed, and experimentally demonstrated. Different colored and colorless OFNU designs are presented, and their impact on the network performance is explored. Our testbed experiments demonstrate concurrent bidirectional 1.25 Gbps IP and 10 Gbps per-wavelength Flow error-free communication delivered over the same infrastructure. The support of intra-PON OFS communication, that is, between two OFNUs in the same PON, is also explored and experimentally demonstrated.

Rapid, parallel CFD grid generation using octrees

AbstractAs Large Eddy Simulation is increasingly applied to flows containing complex geometry, grid generation becomes difficult and time consuming when using software originally developed for RANS flow solvers. The traditional ‘pipeline’ approach of grid generation → solve → visualise entails the time consuming transfer of large files and conversion of file formats. This work demonstrates a grid generation methodology developed specifically to be integrated with parallel LES. The current approach is to use a Cartesian grid with adaptive refinement based upon geometry intersection, surface detail and surface curvature. The grid is defined by an octree data structure with the geometry defined by triangular facets using the STL file format. The result is a set of ‘cubical’ subdomains, each with identical numbers of cells and uniform distributions within the cube. Some subdomains will be entirely fluid and can be solved using straightforward CFD techniques, whilst some cubes will be cut by the surfaces. Individual cells are then tagged as ‘solid’, ‘fluid’ or ‘cut’ with the solver expected to use an immersed boundary approach to model the surface. A key feature is the design of the algorithm to be parallelisable on both shared and distributed memory systems. The distributed memory parallel dynamically partitions the grid as it is being generated, so that the partitioning is suitable for a subsequent flow solver. Grid generation testing has been carried out on a variety of input CAD files ranging up to 350,000 facets. A landing gear case shows how the grid generator correctly finds the fluid inside of the tire and other cavities within the hub. In scalar mode, a grid with 4,916 cubes and 468 million cells is generated in less than 100 seconds, whilst in parallel on 32 processor cores this can be achieved in 4·6 seconds.

ACM Springer Mobile Networks and Applications (MONET) Journal Special Issue on Cooperatively Networked Femtocells

Editorial: The proliferation of new applications, e.g., mobile TV, Internet gaming, large file transfer, and the development of user terminals, e.g., smart phones and notebooks, has dramatically increased user traffic and network load. Moreover, with the number of wireless subscribers expected to triple over the next 5 years, it is obvious that current networks will not be able to satisfy customer demands in the near future. In order to meet this traffic growth and provide service to their users, vendors and operators are working on the development of new technologies and cellular standards. Within them, heterogeneity in network deployment has been heralded as the most promising way of increasing both coverage and capacity of future wireless systems. Thus, it is expected that new elements such as remote radio heads, picocells, femtocells, and relay nodes will be deployed overlying macrocells. In this way, networks will be closer to users, and system capacity will be enhanced through a better spatial spectrum reuse. However, although heterogeneous networks are envisioned to support the increasing data traffic demand and meet the requirements imposed for the fourth generation of mobile networks, they also lead to new technical challenges never faced before. For example, due to the larger number of cells and thus of cell boundaries, the management of interference becomes an intricate problem. Since centralized network planning and optimization cannot deal with the individualistic nature of user-deployed cells, e.g., femtocells, a key to the success of heterogeneous networks is the cooperation between nodes in a decentralized and distributed manner. Such cooperation is the only way to ensure a proper network operation. However, cooperation is not easy to achieve due to different issues and threats imposed by the network itself, e.g., limited back-haul capabilities, dynamics of traffic and radio channel, energy consumption, operational costs, etc. This special issue features six selected papers with high quality:

A case for a coordinated internet video control plane

Video traffic already represents a significant fraction of today's traffic and is projected to exceed 90% in the next five years. In parallel, user expectations for a high quality viewing experience (e.g., low startup delays, low buffering, and high bitrates) are continuously increasing. Unlike traditional workloads that either require low latency (e.g., short web transfers) or high average throughput (e.g., large file transfers), a high quality video viewing experience requires sustained performance over extended periods of time (e.g., tens of minutes). This imposes fundamentally different demands on content delivery infrastructures than those envisioned for traditional traffic patterns. Our large-scale measurements over 200 million video sessions show that today's delivery infrastructure fails to meet these requirements: more than 20% of sessions have a rebuffering ratio ≥ 10% and more than 14% of sessions have a video startup delay ≥ 10s. Using measurement-driven insights, we make a case for a video control plane that can use a global view of client and network conditions to dynamically optimize the video delivery in order to provide a high quality viewing experience despite an unreliable delivery infrastructure. Our analysis shows that such a control plane can potentially improve the rebuffering ratio by up to 2× in the average case and by more than one order of magnitude under stress.