Data Processing Speed Research Articles

Streamlining Patient Data Processing for Payer Compliance with Scalable Big Data Automation

In the fast-changing environment of value-based healthcare, providers must prepare and submit diagnosis files for patients to payers with ever-changing requirements from CMS for contracts. Changing specifications from payers repeatedly requires a flexible system to automatically process items with little reliance on human intervention. It provides a scalable data engineering framework that makes use of PySpark and Apache Airflow to automate and streamline the generation of patient diagnosis files. Its design allows it to be dynamically adapted to changes in specifications, which enhances both operational efficiency and compliance with the automation of complex data transformation processes and large-scale data processing. This framework not only optimizes the reimbursement process but also strengthens the foundations of value-based care by supporting improved patient outcomes and ensuring financial alignment with payer requirements through improving accuracy, timeliness, and reducing manual coding efforts. The proposed framework significantly enhances data processing speed, achieving a 50% reduction in processing time compared to the traditional ETL approach. It offers scalability improvements, allowing data handling from 1 TB to 5 TB—an increase of four times the previous limit—while minimizing manual effort through automation with Airflow, resulting in a 70% reduction in manual intervention.

Research on Autonomous Navigation of Unmanned Aerial Vehicles Based on Correlation-Based Image Comparison Methods

Relevance. Autonomous navigation of unmanned aerial vehicles (UAVs) is one of the key challenges in the modern aerospace industry. Specifically, for small UAVs, the task of autonomous navigation becomes even more complex due to limitations in computational resources and sensor capabilities. Optimizing navigation methods under such conditions is a pressing issue that requires solutions capable of providing high performance with minimal resource consumption.Objective. Improving the efficiency of autonomous navigation for small UAVs by using correlation methods for image comparison. Achieving this objective is linked to the development and evaluation of algorithms that provide high-speed and accurate navigation with limited computational resources. The work uses methods such as the autocorrelation function, Pearson correlation, the structural similarity index, and a simple neural network for image comparison.Solution. The research showed that the autocorrelation-based approach demonstrates the best performance under low computational resources. It ensures high-speed processing of the entire image and shows optimal detection accuracy. Compared to other methods presented in the study, the autocorrelation approach is capable of working not only with noise in the "reference" map but also of using alternative areas with altered patterns as detected regions.The scientific novelty of the study is determined by the systematic comparison of various methods applied to the task of image comparison for small UAVs with limited computational resources. Unlike well-known works in the field of correlation-extreme systems, this research focuses on the use of a "reference map" and a search area, representing two different images of the same terrain taken from different sources. This is a key difference, as most methods are not highly efficient in processing such images where patterns may differ significantly.The practical significance of the developed algorithm lies in the fact that the proposed autocorrelation-based method can be used by developers of autonomous small UAV control systems to reduce computational load and increase data processing speed.

Developing remote patient monitoring infrastructure using commercially available cloud platforms

Wearable sensor devices for continuous patient monitoring produce a large volume of data, necessitating scalable infrastructures for efficient data processing, management and security, especially concerning Patient Health Information (PHI). Adherence to the Health Insurance Portability and Accountability Act (HIPAA), a legislation that mandates developers and healthcare providers to uphold a set of standards for safeguarding patients’ health information and privacy, further complicates the development of remote patient monitoring within healthcare ecosystems. This paper presents an Internet of Things (IoT) architecture designed for the healthcare sector, utilizing commercial cloud platforms like Microsoft Azure and Amazon Web Services (AWS) to develop HIPAA-compliant health monitoring systems. By leveraging cloud functionalities such as scalability, security, and load balancing, the architecture simplifies the creation of infrastructures adhering to HIPAA standards. The study includes a cost analysis of Azure and AWS infrastructures and evaluates data processing speeds and database query latencies, offering insights into their performance for healthcare applications.

Enhancing Real-Time Emotion Recognition in Classroom Environments Using Convolutional Neural Networks: A Step Towards Optical Neural Networks for Advanced Data Processing

In contemporary academic settings, end-of-semester student feedback on a lecturer’s teaching abilities often fails to provide a comprehensive, real-time evaluation of their proficiency, and becomes less relevant with each new cohort of students. To address these limitations, an innovative feedback method has been proposed, utilizing image processing algorithms to dynamically assess the emotional states of students during lectures by analyzing their facial expressions. This real-time approach enables lecturers to promptly adapt and enhance their teaching techniques. Recognizing and engaging with emotionally positive students has been shown to foster better learning outcomes, as their enthusiasm actively stimulates cognitive engagement and information analysis. The purpose of this work is to identify emotions based on facial expressions using a deep learning model based on a convolutional neural network (CNN), where facial recognition is performed using the Viola–Jones algorithm on a group of students in a learning environment. The algorithm encompasses four key steps: image acquisition, preprocessing, emotion detection, and emotion recognition. The technological advancement of this research lies in the proposal to implement photonic hardware and create an optical neural network which offers unparalleled speed and efficiency in data processing. This approach demonstrates significant advancements over traditional electronic systems in handling computational tasks. An experimental validation was conducted in a classroom with 45 students, demonstrating that the level of understanding in the class as predicted was 43–62.94%, and the proposed CNN algorithm (facial expressions detection) achieved an impressive 83% accuracy in understanding students’ emotional states. The correlation between the CNN deep learning model and the students’ feedback was 91.7%. This novel approach opens avenues for the real-time assessment of students’ engagement levels and the effectiveness of the learning environment, providing valuable insights for ongoing improvements in teaching practices.

Scalable Synaptic Transistor Memory from Solution-Processed Carbon Nanotubes for High-Speed Neuromorphic Data Processing.

Neural networks as a core information processing technology in machine learning and artificial intelligence demand substantial computational resources to deal with the extensive multiply-accumulate operations. Neuromorphic computing is an emergent solution to address this problem, allowing the computation performed in memory arrays in parallel with high efficiencies conforming to the neural networks. Here, scalable synaptic transistor memories are developed from solution-sorted carbon nanotubes. The transistors exhibit a large switching ratio of over 105, a significant memory window of ≈12V arising from charge trapping, and low response delays down to tens of nanoseconds. These device characteristics endow highly stabilized reconfigurable conductance states, successful emulation of synaptic functions, and a high data processing speed. Importantly, the devices exhibit uniform characteristic metrics, e.g., with a 1.8% variation in the memory window, suggesting an industrial-scale manufacturing capability of the fabrication. Using the memories, a hardware convolution kernel is designed and parallel image processing is demonstrated at a speed of 1M bit per second per input channel. Given the efficacy of the convolution kernel, a promising prospect of the memories in implementing neuromorphic computing is envisaged. To explore the potential, large-scale convolution kernels are simulated and high-speed video processing is realized for autonomous driving.

Growing Semiconductor Industry in India

This paper delves into the growing semiconductor industry in India, and its importance in every aspect of present and future high data processing speed. Semiconductors are crucial electronic components for quantum computing, artificial intelligence (AI), medical devices, aerospace and defence systems, etc. Thus, the use of semiconductors for these most important and future ease concepts, this paper is an understanding approach to the growing importance of semiconductors in India

Experience in applying large language models to analyse sociological data obtained as a result of interviews on students’ perception of entrepreneurial activity

Modern society is experiencing a digital transformation of various spheres associated with the development of artificial intelligence and big data. The introduction of large language models (hereinafter referred to as LLM) into scientific research opens new opportunities, but also raises a number of questions, which makes it relevant to study the peculiarities of their application for qualitative data analysis in sociology. The purpose of this article is to explore how LLM can influence the methodology and practice of sociological research, and to identify the advantages and disadvantages of their application. The authors rely on the use of the Calude-3 LLM to qualitatively analyse empirical data from a sociological study of students’ perception of ­entrepreneurship. The possibilities of LLM in the analysis of qualitative data are revealed: analysis of sentiment, construction of logical conclusions, classification, clustering, and formation of typologies. The advantages of using LLM are shown: increased data processing speed, saving time and resources. The application of LLM becomes a tool to optimise the research process in sociology, allowing to deepen the analysis of qualitative data, but it also has a number of limitations: social and political bias, difficulties with hallucinations. It is necessary to increase the transparency of models, improve their interpretability and explainability and reduce their social and political bias as well as ethical and legal regulation of the use of LLM models.

Enhancing the data processing speed of a deep-learning-based three-dimensional single molecule localization algorithm (FD-DeepLoc) with a combination of feature compression and pipeline programming

Three-dimensional (3D) single molecule localization microscopy (SMLM) plays an important role in biomedical applications, but its data processing is very complicated. Deep learning is a potential tool to solve this problem. As the state of art 3D super-resolution localization algorithm based on deep learning, FD-DeepLoc algorithm reported recently still has a gap with the expected goal of online image processing, even though it has greatly improved the data processing throughput. In this paper, a new algorithm Lite-FD-DeepLoc is developed on the basis of FD-DeepLoc algorithm to meet the online image processing requirements of 3D SMLM. This new algorithm uses the feature compression method to reduce the parameters of the model, and combines it with pipeline programming to accelerate the inference process of the deep learning model. The simulated data processing results show that the image processing speed of Lite-FD-DeepLoc is about twice as fast as that of FD-DeepLoc with a slight decrease in localization accuracy, which can realize real-time processing of [Formula: see text] pixels size images. The results of biological experimental data processing imply that Lite-FD-DeepLoc can successfully analyze the data based on astigmatism and saddle point engineering, and the global resolution of the reconstructed image is equivalent to or even better than FD-DeepLoc algorithm.

The Role of Edge Computing in Driving Real-time Personalized Marketing: a Data-driven Business Perspective

The fast pace of marketing innovation in the digital age has sparked a growing need for instant, personalized conversations with customers. This study investigates the vital significance of edge computing in elevating real-time personalized marketing by reducing latency, improving speed of data processing, and allowing companies to quickly, data-driven decisions. Through a rigorous investigation, the research reports on the ways edge computing solves problems linked to cloud solutions, like bandwidth issues and privacy matters, providing a more effective framework for localized data management. Conducting a mixed-methods study using case studies and quantitative performance metrics, this research showcases important enhancements in consumer engagement and conversion rates amongst enterprises that have implemented edge computing for their personalized marketing efforts. Findings indicate a reduction of 30% in data transfer latency and a 25% higher level of interactions with customers in real time as a result of marketing activities made possible by the edge. The paper wraps up with a look at the innovation of this method in the face of technological innovations and presents recommendations for firms attempting to raise consumer engagement via personalized marketing approaches facilitated by edge computing.

Топологические изоляторы в электронных и спинтронных устройствах

Background: Topological insulators (TIs) are materials with distinctive features, including insulating interiors and conducting surface states protected by time-reversal symmetry. These features make TIs extremely promising for electrical and spintronic device applications, where manipulating electron spin without charge transfer is advantageous. Objective: This study aims to investigate of TIs to improve the performance and efficiency of electrical and spintronic devices. We look at the special qualities of TIs that may be used to improve device functionality, such as reduced power consumption and higher operational speed. Methods: To investigate electron transport behaviour on the surfaces of different TIs, we used a mix of quantum mechanical models and experimental settings. Devices based on bismuth telluride (Bi2Te3) and thallium arsenide (TlAs) were built to test their performance in real-world applications. Results: TI devices showed considerable gains in spin transport efficiency and thermal stability compared to conventional materials. Spintronic devices based on TIs demonstrated a 50% reduction in energy usage and a 30% improvement in data processing speed. Conclusion: Including topological insulators in electrical and spintronic devices offers a promising path to more efficient and speedier technologies. Future research should concentrate on the scalable integration of TIs into commercial devices and the discovery of novel materials with topological insulating characteristic.

Research on Citrus Fruit Freshness Detection Based on Near-Infrared Spectroscopy

The study developed a novel method for evaluating the freshness of citrus fruits by integrating near-infrared spectroscopy with the non-linear data processing capabilities of a BP neural network. This approach utilizes specific wavelength analysis to distinguish between fresh and non-fresh fruits effectively. Advanced pre-processing techniques are employed to remove spectral anomalies, enhancing the network’s ability to accurately identify crucial quality indicators like sugar content. Concurrently, an experiment utilizing a mathematical computing software -based BP neural network optimized the number of hidden layer nodes, identifying 61 as optimal. This configuration achieves impressive indicators, including a mean square error of 0.0025665 and a root mean square error of 49.8214. More than 1000 training iterations were performed on 100 citrus samples, and the learning rate was 80%. The model demonstrated a high accuracy rate of 97.6275%, confirming its precision and reliability in assessing citrus freshness. This synergy between advanced neural network processing and spectroscopic techniques marks a significant advancement in agricultural quality assessment, setting new standards for speed and efficiency in data processing.

An optimized heterogeneous multi-access edge computing framework based on transfer learning and artificial internet of things

In most practical applications, the feature space of the training datasets and the target domain datasets are inconsistent, or the data distribution between them is inconsistent, which leads to the problem of data starvation and makes it difficult for terminal devices to obtain high accurate results. Aiming at the problems of limited terminal device resources, low accuracy of data processing results, and unsatisfactory processing speed, a Heterogeneous Multi-access Edge Computing (MEC) Framework based on Transfer Learning (TL) is proposed, abbreviated as HMECF-TL. This framework adopts a cloud-edge-end three-layer architecture. It uses model transfer to optimize the Convolutional Neural Networks (CNN) model at each layer to achieve the goal of improving data processing speed and accuracy. Furthermore, a multi-agent Deep Reinforcement Learning Algorithm having Attention Mechanism (DRLAAM) is designed to further increase the timeliness performance of computation-intensive applications. The performance of HMECSF-TL framework is verified by simulation experiments, which not only reduces the delay by more than 24.66 %, but also improves the accuracy by more than 8.34 %. The framework not only increase the computing capacity to solve the shortage of terminal device resources, but also improve the quality of data processing to solve the problem of data starvation.

Monitoring of Glacier Area Changes in the Ili River Basin during 1992–2020 Based on Google Earth Engine

The Ili River Basin, a crucial transboundary river in the arid region of Central Asia, plays a significant role in the region’s ecology and water resources. However, current methods for monitoring glacier area changes in this region face challenges in automation and accuracy due to the complex terrain and climatic conditions. This study aims to evaluate the effectiveness of the Google Earth Engine (GEE) platform for monitoring glacier area changes in the Ili River Basin from 1992 to 2020, with a focus on improving data accuracy and processing efficiency. Utilizing the Landsat data series, we employed the random forest (RF) classification algorithm within the GEE platform to extract glacier areas, optimizing a multidimensional feature set using the Jeffries–Matusita (JM) distance method, and applied visual interpretation for data refinement. Our results demonstrated that the GEE platform, combined with the RF algorithm, provided high accuracy in glacier monitoring, achieving an overall accuracy of 89% and a kappa coefficient of 0.85. During the study period, the glacier area in the Ili River Basin decreased by 184.76 km2, with an average annual retreat rate of 6.84 km2, most notably between 3800 and 4400 m in elevation. The analysis revealed that temperature changes had a more pronounced impact on glacier dynamics than precipitation. This approach significantly enhances image utilization efficiency and data processing speed, offering a reliable tool for monitoring glacier dynamics. Future research should focus on integrating additional environmental variables and extending the temporal scope to further refine glacier dynamics modeling and predictions.

Розвиток систем обліково-аналітичного забезпечення в умовах цифрової трансформації інформаційної індустрії

The article analyzes the current state and development of accounting and analytical systems in the context of the digital transformation of the information industry, a critical issue for enterprises in this sector. The study examines the main trends and challenges companies face due to the active implementation of digital technologies in accounting and analytical activities. It characterizes the critical aspects of how digital transformation impacts the processes of data collection, processing, and analysis within the modern information industry. The article proposes new approaches to organizing accounting and analytical systems that meet the digital economy’s demands. It explores the potential of modern information technologies to enhance the effectiveness of management decisions based on the analysis of large data sets, which contributes to increasing enterprises’ competitiveness in the digital environment. Additionally, the article highlights the necessity of integrating advanced technologies into financial control and management processes. The research identifies prospects for developing accounting and analytical systems, considering global digital trends. Recommendations are developed to improve the adaptability of information industry enterprises to the rapidly changing digital environment. Through a comprehensive analysis, the article underscores the importance of adapting to and leveraging digital transformation to enhance operational efficiency and maintain a competitive edge. The findings suggest that the ongoing digital revolution in accounting and analytics presents opportunities and challenges, requiring businesses to innovate and continuously adapt their systems and processes. This will ensure they remain resilient and competitive in an increasingly digitized global market. In the future, research in this field should focus on integrating the latest digital technologies, such as artificial intelligence and blockchain, which can significantly improve the accuracy and speed of data processing. Also, an important direction is the development of new analytical forecasting models based on big data, which will help to make management decisions more effectively. Keywords: Digital transformation, accounting systems, analytical systems, information industry, big data, competitiveness, financial control, management efficiency, modern information technologies, digital economy.

Research on Cloud-Edge-Device Collaborative Intelligent Monitoring System of Grinding Wheel Wear State for High-Speed Cylindrical Grinding of Bearing Rings

Aiming at the problems of grinding wheel wear during high-speed cylindrical grinding, communication delays, and slow response during data acquisition, processing, and system operation, an intelligent online monitoring technology frame for CNC manufacturing units is proposed, incorporating a real-time-perception grinding mechanism and a cloud-edge device. Based on the grinding data and grinding wheel wear mechanism, a monitoring model using multi-sensor information fusion is constructed to assess the grinding wheel wear state. In addition, edge data acquisition and online monitoring software have been developed to improve the speed of data transmission and processing. Finally, based on the proposed framework, a cloud-edge device collaborative intelligent monitoring system for assessing grinding wheel wear during high-speed cylindrical grinding of bearing rings is constructed. It improves the grinding quality and efficiency, reduces the grinding cost, and incorporates remote control functionality.

Computer Network Design and Applications for West Java Legislative Elections

Legislative elections or Pileg are an annual schedule that is routinely held in Indonesia for five years. The concept of technology 4.0 has a huge opportunity to be applied in the legislative election process in this modern era. Legislative elections that use digital devices connected in such a way have more advantages than legislative elections that use conventional methods. The application of technology 4.0 in legislative elections has advantages in terms of effectiveness, data processing speed, and costs. The design of the legislative election system is made using a network where each polling station will be provided with one server to accommodate votes at the polling station. Then the server synchronizes the data to a central server to calculate the final results obtained. The server is built using the text-based Ubuntu Linux operating system. The application used is web-based, with the programming languages used being HTML, PHP, CSS, and Javascript. The test data shows that the time required for the system to complete each stage of the legislative election process is relatively faster than conventional legislative elections. So it can be concluded that the design of the legislative election system has met the requirements to accelerate the legislative election process. This research uses an SDLC system with a prototype model. Tests are carried out using BlackBox testing to test the suitability of the application with application access.

A distributed software system for integrating data-intensive imaging methods in a hard X-ray nanoprobe beamline at the SSRF.

The development of hard X-ray nanoprobe techniques has given rise to a number of experimental methods, like nano-XAS, nano-XRD, nano-XRF, ptychography and tomography. Each method has its own unique data processing algorithms. With the increase in data acquisition rate, the large amount of generated data is now a big challenge to these algorithms. In this work, an intuitive, user-friendly software system is introduced to integrate and manage these algorithms; by taking advantage of the loosely coupled, component-based design approach of the system, the data processing speed of the imaging algorithm is enhanced through optimization of the parallelism efficiency. This study provides meaningful solutions to tackle complexity challenges faced in synchrotron data processing.

Construction of integrated network order system of main distribution network based on power grid operation control platform

This study presents a major advance in grid management: the development and deployment of an integrated network command system for the main distribution network. The system integrates cutting-edge information technology, including modules such as command issuance, intelligent routing, security assurance and in-depth data analysis, opening a new era of refined and intelligent power grid management. The research focuses on the application of core technologies such as information communication technology, distributed control system, artificial intelligence and big data analysis, and strengthens the system operation foundation. The chapter on system architecture details the innovative integration of DDQN algorithm and attention mechanism, and carefully constructs intelligent scheduling engine and status monitoring and early warning system, which significantly improves real-time response, decision optimization and active security defense capabilities. Simulation experiments and actual case analysis verify the effectiveness of the system, specifically, the response time is reduced by 75.7%(from 2.1 s to 0.51 s in the traditional system), the data processing speed is still maintained at a high level under high load (100,000 data processing rate is 300/s), and the system stability is as high as 99.97%. The new system also achieved a high degree of automation, reducing annual operation and maintenance costs by 20%, and increasing user satisfaction to 90%, an increase of 28.6% over the previous period. These improvements not only optimize power quality and grid efficiency, but also further confirm that the fault response time is reduced by 30% and the user outage time is reduced by 25%. Therefore, this study not only highlights the innovation of the proposed system, but also demonstrates its significant contribution to accelerating the modernization of power grid management and ensuring safe operation with empirical data.

Hardware-accelerated integrated optoelectronic platform towards real-time high-resolution hyperspectral video understanding

Recent advancements in artificial intelligence have significantly expanded capabilities in processing language and images. However, the challenge of comprehensively understanding video content still needs to be solved. The main problem is the requirement to process real-time multidimensional video information at data rates exceeding 1 Tb/s, a demand that current hardware technologies cannot meet. This work introduces a hardware-accelerated integrated optoelectronic platform specifically designed for the real-time analysis of multidimensional video. By leveraging optical information processing within artificial intelligence hardware and combining it with advanced machine vision networks, the platform achieves data processing speeds of 1.2 Tb/s. This capability supports the analysis of hundreds of frequency bands with megapixel spatial resolution at video frame rates, significantly outperforming existing technologies in speed by three to four orders of magnitude. The platform demonstrates effectiveness for AI-driven tasks, such as video semantic segmentation and object understanding, across indoor and aerial scenarios. By overcoming the current data processing speed limitations, the platform shows promise in real-time AI video understanding, with potential implications for enhancing human-machine interactions and advancing cognitive processing technologies.

MODELS OF REMOTE IDENTIFICATION OF PARAMETERS OF DYNAMIC OBJECTS USING DETECTION TRANSFORMERS AND OPTICAL FLOW

The tasks of remote identification of parameters of dynamic objects are important for various fields, including computer vision, robotics, autonomous vehicles, video surveillance systems, and many others. Traditional methods of solving these problems face the problems of insufficient accuracy and efficiency of determining dynamic parameters in conditions of rapidly changing environments and complex dynamic scenarios. Modern methods of identifying parameters of dynamic objects using technologies of detection transformers and optical flow are considered. Transformer detection is one of the newest approaches in computer vision that uses transformer architecture for object detection tasks. This transformer integrates the object detection and boundary detection processes into a single end-to-end model, which greatly improves the accuracy and speed of processing. The use of transformers allows the model to effectively process information from the entire image at the same time, which contributes to better recognition of objects even in difficult conditions. Optical flow is a motion analysis method that determines the speed and direction of pixel movement between successive video frames. This method allows obtaining detailed information about the dynamics of the scene, which is critical for accurate tracking and identification of parameters of moving objects. The integration of detection transformers and optical flow is proposed to increase the accuracy of identification of parameters of dynamic objects. The combination of these two methods allows you to use the advantages of both approaches: high accuracy of object detection and detailed information about their movement. The conducted experiments show that the proposed model significantly outperforms traditional methods both in the accuracy of determining the parameters of objects and in the speed of data processing. The key results of the study indicate that the integration of detection transformers and optical flow provides reliable and fast determination of parameters of moving objects in real time, which can be applied in various practical scenarios. The conducted research also showed the potential for further improvement of data processing methods and their application in complex dynamic environments. The obtained results open new perspectives for the development of intelligent monitoring and control systems capable of adapting to rapidly changing environmental conditions, increasing the efficiency and safety of their work.