Machine Learning Theory Research Articles

Machine Learning and Fama-French Three-Factor Model Applications for Analyzing Stock Price in Technology Enterprises

This study endeavors to forecast the stock prices of the leading U.S. technology entities - Google, Microsoft, Amazon, Meta, and Apple - through the application of diverse machine learning models, complemented by the traditional Fama-French three-factor model. The employed models encompass Convolutional Neural Networks (CNN), Long Short-Term Memory Networks (LSTM), Support Vector Machines (SVM), and Decision Tree models. Initially, historical stock price data is utilized to train these machine learning models, enabling the identification of potential price trends. Subsequently, the integration of the Fama-French three-factor model enhances the analysis by scrutinizing the impacts of market risk, company size, and book-to-market value on stock prices. The outcomes illuminate both the effectiveness and limitations of various models in stock price prediction, highlighting the advantages of machine learning methodologies over traditional financial theories. This research provides financial market analysts and investors with a fresh perspective on the amalgamation of machine learning and traditional financial theories for enhanced stock price prediction.

Intelligent robotic control system based on computer vision technology

Computer vision is a kind of simulation of biological vision using computers and related equipment. It is an important part of the field of artificial intelligence. Its research goal is to make computers have the ability to recognize three-dimensional environmental information through two-dimensional images. Computer vision is based on image processing technology, signal processing technology, probability statistical analysis, computational geometry, neural network, machine learning theory and computer information processing technology, through computer analysis and processing of visual information.The article explores the intersection of computer vision technology and robotic control, highlighting its importance in various fields such as industrial automation, healthcare, and environmental protection. Computer vision technology, which simulates human visual observation, plays a crucial role in enabling robots to perceive and understand their surroundings, leading to advancements in tasks like autonomous navigation, object recognition, and waste management. By integrating computer vision with robot control, robots gain the ability to interact intelligently with their environment, improving efficiency, quality, and environmental sustainability. The article also discusses methodologies for developing intelligent garbage sorting robots, emphasizing the application of computer vision image recognition, feature extraction, and reinforcement learning techniques. Overall, the integration of computer vision technology with robot control holds promise for enhancing human-computer interaction, intelligent manufacturing, and environmental protection efforts.

Machine Learning and Information Theory Concepts towards an AI Mathematician

The current state of the art in artificial intelligence is impressive, especially in terms of mastery of language, but not so much in terms of mathematical reasoning. What could be missing? Can we learn something useful about that gap from how the brains of mathematicians go about their craft? This essay builds on the idea that current deep learning mostly succeeds at system 1 abilities—which correspond to our intuition and habitual behaviors—but still lacks something important regarding system 2 abilities—which include reasoning and robust uncertainty estimation. It takes an information-theoretical posture to ask questions about what constitutes an interesting mathematical statement, which could guide future work in crafting an AI mathematician. The focus is not on proving a given theorem but on discovering new and interesting conjectures. The central hypothesis is that a desirable body of theorems better summarizes the set of all provable statements, for example, by having a small description length while at the same time being close (in terms of number of derivation steps) to many provable statements.

Combined Machine Learning and High-Throughput Calculations Predict Heyd-Scuseria-Ernzerhof Band Gap of 2D Materials and Potential MoSi2N4 Heterostructures.

We present a novel target-driven methodology devised to predict the Heyd-Scuseria-Ernzerhof (HSE) band gap of two-dimensional (2D) materials leveraging the comprehensive C2DB database. This innovative approach integrates machine learning and density functional theory (DFT) calculations to predict the HSE band gap, conduction band minimum (CBM), and valence band maximum (VBM) of 2176 types of 2D materials. Subsequently, we collected a comprehensive data set comprising 3539 types of 2D materials, each characterized by its HSE band gaps, CBM, and VBM. Considering the lattice disparities between MoSi2N4 (MSN) and 2D materials, our analysis predicted 766 potential MSN/2D heterostructures. These heterostructures are further categorized into four distinct types based on the relative positions of their CBM and VBM: Type I encompasses 230 variants, Type II comprises 244 configurations, Type III consists of 284 permutations, and 0 band gap comprises 8 types.

Prediction of impact sensitivity and electrostatic spark sensitivity for energetic compounds by machine learning and density functional theory

Prediction of impact sensitivity and electrostatic spark sensitivity for energetic compounds by machine learning and density functional theory

Human-inspired similarity control system: Enhancing line-following robot perception

Human-Inspired Control (HIC) holds promise for endowing machines with human-like cognition, decision-making, and adaptability. In this study, we employ a fusion of cognitive modeling, machine learning, and control theory as the foundational architecture and empirically validate its suitability for robot control within the realm of HIC. Fuzzy logic stands out as a viable approach for HIC control, wherein control rules can be devised drawing from human intuitive inspiration. Specifically, this study explores similarity inference control systems in robotics, with the objective of enhancing line-following control as an alternative to fuzzy systems. The experimental optimization results provide insights into the advantages and limitations of the similarity inference control system. Despite achieving performance comparable to that of traditional two-stage fuzzy control systems, careful consideration of noise sensitivity is paramount. While the similarity inference approach streamlines implementation and obviates the necessity for expert-designed fuzzy rules, its susceptibility to noise can compromise performance, particularly in noisy environments. These considerations are pivotal for the development of control systems aimed at mitigating noise sensitivity, enhancing task-specific performance, and ensuring the adaptability and robustness of line-following robots. To tackle this challenge, we both discuss and experimentally evaluate potential solutions and their applicability in this paper.

Exploring Antiviral Drugs on Monolayer Black Phosphorene: Atomistic Theory and Explainable Machine Learning-Assisted Platform.

Favipiravir (FP) and ebselen (EB) belong to a diverse class of antiviral drugs known for their significant efficacy in treating various viral infections. Utilizing molecular dynamics (MD) simulations, machine learning, and van der Waals density functional theory, we accurately elucidate the binding properties of these antiviral drugs on a phosphorene single-layer. To further investigate these characteristics, this study employs four distinct machine learning models-Random Forest, Gradient Boosting, XGBoost, and CatBoost. The Hamiltonian of antiviral molecules within a monolayer of phosphorene is appropriately trained. The key aspect of utilizing machine learning (ML) in drug design revolves around training models that are efficient and precise in approximating density functional theory (DFT). Furthermore, the study employs SHAP (SHapley Additive exPlanations) to elucidate model predictions, providing insights into the contribution of each feature. To explore the interaction characteristics and thermodynamic properties of the hybrid drug, we employ molecular dynamics and DFT calculations in a vacuum interface. Our findings suggest that this functionalized 2D complex exhibits robust thermostability, indicating its potential as an effective and enabled entity. The observed variations in free energy at different surface charges and temperatures suggest the adsorption potential of FP and EB molecules from the surrounding environment.

An Improved Network Intrusion Detection Method Based On CNN-LSTM-SA

Network intrusion detection is an essential component of contemporary cybersecurity strategies, and the development of efficient techniques to accurately identify malicious activities has become a priority. This study investigates the performance of various conventional machine learning algorithms, including decision trees, naive Bayes, naive Bayes trees, random forest, random trees, MLP, and SVM, in detecting network intrusions using binary and multi-classification approaches. Furthermore, the study proposes a deep learning method, CNN-LSTM-SA, which consistently outperforms conventional machine learning techniques in terms of precision, recall, F1 score, and overall accuracy for network intrusion detection. Specifically, the proposed method combines CNN and LSTM with SA in machine learning theory to extract more optimized, strongly correlated features. The proposed method is evaluated using the benchmark NSL-KDD database. The results indicate that the CNN-LSTM-SA method holds great potential in enhancing the efficacy of network intrusion detection systems.

Immediate traceability of ash based on laser-induced breakdown spectroscopy and machine learning

This article reports on an advanced level physical laboratory experiment designed for college level undergraduate education and for scholars who need specialized training on using and interpreting Laser-Induced Breakdown Spectroscopy. The technical principle, experimental operation and sample preparation of Laser-Induced Breakdown Spectroscopy are introduced in detail. A presentation and discussion of the use of Laser-Induced Breakdown Spectroscopy in the traceability of four common samples is emphasized. Combining Laser-Induced Breakdown Spectroscopy with Machine Learning, two distinct datasets are constructed through the extraction of spectral features. Dimensionality reduction of spectral data is performed using Linear Discriminant Analysis, while the Random Forest model is employed for provenance classification. Finally, the interpretability of the Random Forest model is leveraged to explore the contributions of different spectral elements to provenance tracing. Results demonstrated the system’s effectiveness in not only accurately identifying ash types but also in elucidating the influential chemical components, offering significant implications for material analysis and environmental monitoring. On an educational standpoint, this paper will allow any reader, in particular, undergraduate and graduate students, to gain a better understanding of the theory and practice of Laser-Induced Breakdown Spectroscopy and machine learning.

Analysis of interactive impact and student behavior of teaching online courses based on gamified learning

The potential of gamified learning as an emerging force for educational change has been widely recognized, to address the design deficiencies in the automatic recognition methods in traditional gamified learning models and the low accuracy of learning behavior recognition. Based on the improved gamified learning model, this paper jointly proposes an optimal design and recognition model of learning mode based on a deformable convolutional type network. Based on the gamified machine learning theory and interactive feedback theory, it comprehensively analyzes the procedural improvement of the gamified interactive intelligence model to provide a theoretical and practical basis for carrying out the analysis of the interactive impact and student behavior of teaching online courses based on gamified learning. The research results show that: (1) with the increase of the number of gamified learning samples, the value of iterative loss function decreases, the accuracy of recognition improves, and gradually converges and tends to be stable when the number of training times is 500; the 800 training samples setting can fully meet the network training requirements. (2) The deformable convolutional neural learning network constructed with the proposed joint algorithm reduces the network error during the training process and introduces the radical change function to improve the data processing capability. This improved gamified learning model is not only superior in recognition accuracy but also shows great advantages in recognition time.

Machine Learning in Quasi-Newton Methods

In this article, we consider the correction of metric matrices in quasi-Newton methods (QNM) from the perspective of machine learning theory. Based on training information for estimating the matrix of the second derivatives of a function, we formulate a quality functional and minimize it by using gradient machine learning algorithms. We demonstrate that this approach leads us to the well-known ways of updating metric matrices used in QNM. The learning algorithm for finding metric matrices performs minimization along a system of directions, the orthogonality of which determines the convergence rate of the learning process. The degree of learning vectors’ orthogonality can be increased both by choosing a QNM and by using additional orthogonalization methods. It has been shown theoretically that the orthogonality degree of learning vectors in the Broyden–Fletcher–Goldfarb–Shanno (BFGS) method is higher than in the Davidon–Fletcher–Powell (DFP) method, which determines the advantage of the BFGS method. In our paper, we discuss some orthogonalization techniques. One of them is to include iterations with orthogonalization or an exact one-dimensional descent. As a result, it is theoretically possible to detect the cumulative effect of reducing the optimization space on quadratic functions. Another way to increase the orthogonality degree of learning vectors at the initial stages of the QNM is a special choice of initial metric matrices. Our computational experiments on problems with a high degree of conditionality have confirmed the stated theoretical assumptions.

Collaboration on Machine-Learned Potentials with IPSuite: A Modular Framework for Learning-on-the-Fly.

The field of machine learning potentials has experienced a rapid surge in progress, thanks to advances in machine learning theory, algorithms, and hardware capabilities. While the underlying methods are continuously evolving, the infrastructure for their deployment has lagged. The community, due to these rapid developments, frequently finds itself split into groups built around different implementations of machine-learned potentials. In this work, we introduce IPSuite, a Python-driven software package designed to connect different methods and algorithms from the comprehensive field of machine-learned potentials into a single platform while also providing a collaborative infrastructure, helping ensure reproducibility. Furthermore, the data management infrastructure of the IPSuite code enables simple model sharing and deployment in simulations. Currently, IPSuite supports six state-of-the-art machine learning approaches for the fitting of interatomic potentials as well as a variety of methods for the selection of training data, running of ab initio calculations, learning-on-the-fly strategies, model evaluation, and simulation deployment.

Theoretical perspectives on predictive analytics in it service management: Enhancing service quality

This paper explores the theoretical perspectives underpinning the application of predictive analytics in IT service management (ITSM) to enhance service quality. It begins with an introduction to predictive analytics in the context of ITSM and the significance of improving service quality in IT operations. Theoretical frameworks such as Systems Theory, Information Theory, Decision Theory, and Machine Learning Theory are discussed to provide a comprehensive understanding of the underlying principles guiding predictive analytics in ITSM. The paper examines the practical applications, challenges, and benefits of predictive analytics in ITSM, emphasizing its role in anticipatory problem resolution, proactive service improvements, and predictive maintenance. Case studies and examples of successful implementations are presented to illustrate real-world applications and best practices. Additionally, future directions and emerging trends in predictive analytics technology are explored, along with their potential impact on ITSM practices and ethical considerations. Overall, this paper contributes to the theoretical foundation and practical insights for leveraging predictive analytics to enhance service quality in ITSM.

A review of previous researches about machine learning theory in production management: Focusing on reinforcement learning

A review of previous researches about machine learning theory in production management: Focusing on reinforcement learning

Synergy of machine learning and density functional theory calculations for predicting experimental Lewis base affinity and Lewis polybase binding atoms.

Investigation of Lewis acid-base interactions has been conducted by ab initio calculations and machine learning (ML) models. This study aims to resolve two critical tasks that have not been quantitatively investigated. First, ML models developed from density functional theory (DFT) calculations predict experimental BF3 affinity with Pearson correlation coefficients around 0.9 and mean absolute errors around 10 kJ mol-1. The ML models are trained by DFT-calculated BF3 affinity of more than 3000 adducts, with input features readily obtained by rdkit. Second, the ML models have the capability of predicting the relative strength of Lewis base binding atoms in Lewis polybases, which is either an extremely challenging task to conduct experimentally or a computationally expensive task for ab initio methods. The study demonstrates and solidifies the potential of combining DFT calculations and ML models to predict experimental properties, especially those that are scarce and impractical to empirically acquire.

Heterojunction of MXenes and MN4–graphene: Machine learning to accelerate the design of bifunctional oxygen electrocatalysts

Oxygen reduction reaction (ORR) and oxygen evolution reaction (OER) are essential for the development of excellent bifunctional electrocatalysts, which are key functions in clean energy production. The emphasis of this study lies in the rapid design and investigation of 153 MN4–graphene (Gra)/ MXene (M2NO) electrocatalysts for ORR/OER catalytic activity using machine learning (ML) and density functional theory (DFT). The DFT results indicated that CoN4–Gra/Ti2NO had both good ORR (0.37 V) and OER (0.30 V) overpotentials, while TiN4–Gra/M2NO and MN4–Gra/Cr2NO had high overpotentials. Our research further indicated orbital spin polarization and d-band centers far from the Fermi energy level, affecting the adsorption energy of oxygen-containing intermediates and thus reducing the catalytic activity. The ML results showed that the gradient boosting regression (GBR) model successfully predicted the overpotentials of the monofunctional catalysts RhN4–Gra/Ti2NO (ORR, 0.39 V) and RuN4–Gra/W2NO (OER, 0.45 V) as well as the overpotentials of the bifunctional catalyst RuN4–Gra/W2NO (ORR, 0.39 V; OER, 0.45 V). The symbolic regression (SR) algorithm was used to construct the overpotential descriptors without environmental variable features to accelerate the catalyst screening and shorten the trial-and-error costs from the source, providing a reliable theoretical basis for the experimental synthesis of MXene heterostructures.

Deep model predictive control of gene expression in thousands of single cells

Gene expression is inherently dynamic, due to complex regulation and stochastic biochemical events. However, the effects of these dynamics on cell phenotypes can be difficult to determine. Researchers have historically been limited to passive observations of natural dynamics, which can preclude studies of elusive and noisy cellular events where large amounts of data are required to reveal statistically significant effects. Here, using recent advances in the fields of machine learning and control theory, we train a deep neural network to accurately predict the response of an optogenetic system in Escherichia coli cells. We then use the network in a deep model predictive control framework to impose arbitrary and cell-specific gene expression dynamics on thousands of single cells in real time, applying the framework to generate complex time-varying patterns. We also showcase the framework’s ability to link expression patterns to dynamic functional outcomes by controlling expression of the tetA antibiotic resistance gene. This study highlights how deep learning-enabled feedback control can be used to tailor distributions of gene expression dynamics with high accuracy and throughput without expert knowledge of the biological system.

Optimal scheduling method of low-carbon energy supply chain based on machine learning and game theory

Aiming at the quality and stability of a low-carbon new energy supply chain, this paper puts forward an optimal scheduling method for a low-carbon energy supply chain based on machine learning and game theory. By establishing an index and preprocessing keywords, the similarity between the index and the data in the platform database is calculated, and the data-sharing result of the low-carbon energy supply chain is obtained. This paper analyzes the game benefits of each subject in the optimization of the low-carbon energy supply chain, obtains the game matrix, and realizes the optimal scheduling of the low-carbon energy supply chain. The experimental results show that the scheduling convergence error of the low-carbon energy supply chain is low, the accuracy is high, and the load supply equipment can run stably.

A General Materials Data Science Framework for Quantitative 2D Analysis of Particle Growth from Image Sequences

Phase transformations are a challenging problem in materials science, which lead to changes in properties and may impact performance of material systems in various applications. We introduce a general framework for the analysis of particle growth kinetics by utilizing concepts from machine learning and graph theory. As a model system, we use image sequences of atomic force microscopy showing the crystallization of an amorphous fluoroelastomer film. To identify crystalline particles in an amorphous matrix and track the temporal evolution of the particle dispersion, we have developed quantitative methods of 2D analysis. 700 image sequences were analyzed using a neural network architecture, achieving 0.97 pixel-wise classification accuracy as a measure of the correctly classified pixels. The growth kinetics of isolated and impinged particles were tracked throughout time using these image sequences. The relationship between image sequences and spatiotemporal graph representations was explored to identify the proximity of crystallites from each other. The framework enables the analysis of all image sequences without the requirement of sampling for specific particles or timesteps for various materials systems.

Density of compressible types and some consequences

We study compressible types in the context of (local and global) NIP. By extending a result in machine learning theory (the existence of a bound on the recursive teaching dimension), we prove density of compressible types. Using this, we obtain explicit uniform honest definitions for NIP formulas (answering a question of Eshel and the second author), and build compressible models in countable NIP theories.