Inertial Measurement Unit Data Research Articles

Optimization of activity-driven event detection for long-term ambulatory urodynamics.

Lower urinary tract dysfunction (LUTD) is a debilitating condition that affects millions of individuals worldwide, greatly diminishing their quality of life. The use of wireless, catheter-free implantable devices for long-term ambulatory bladder monitoring, combined with a single-sensor system capable of detecting various bladder events, has the potential to significantly enhance the diagnosis and treatment of LUTD. However, these systems produce large amounts of bladder data that may contain physiological noise in the pressure signals caused by motion artifacts and sudden movements, such as coughing or laughing, potentially leading to false positives during bladder event classification and inaccurate diagnosis/treatment. Integration of activity recognition (AR) can improve classification accuracy, provide context regarding patient activity, and detect motion artifacts by identifying contractions that may result from patient movement. This work investigates the utility of including data from inertial measurement units (IMUs) in the classification pipeline, and considers various digital signal processing (DSP) and machine learning (ML) techniques for optimization and activity classification. In a case study, we analyze simultaneous bladder pressure and IMU data collected from an ambulating female Yucatan minipig. We identified 10 important, yet relatively inexpensive to compute signal features, with which we achieve an average 91.5% activity classification accuracy. Moreover, when classified activities are included in the bladder event analysis pipeline, we observe an improvement in classification accuracy, from 81% to 89.0%. These results suggest that certain IMU features can improve bladder event classification accuracy with low computational overhead.Clinical Relevance: This work establishes that activity recognition may be used in conjunction with single-channel bladder event detection systems to distinguish between contractions and motion artifacts for reducing the incorrect classification of bladder events. This is relevant for emerging sensors that measure intravesical pressure alone or for data analysis of bladder pressure in ambulatory subjects that contain significant abdominal pressure artifacts.

Predicting Knee Joint Contact Force Peaks During Gait Using a Video Camera or Wearable Sensors.

Estimating loading of the knee joint may be helpful in managing degenerative joint diseases. Contemporary methods to estimate loading involve calculating knee joint contact forces using musculoskeletal modeling and simulation from motion capture (MOCAP) data, which must be collected in a specialized environment and analyzed by a trained expert. To make the estimation of knee joint loading more accessible, simple input predictors should be used for predicting knee joint loading using artificial neural networks. We trained feedforward artificial neural networks (ANNs) to predict knee joint loading peaks from the mass, height, age, sex, walking speed, and knee flexion angle (KFA) of subjects using their existing MOCAP data. We also collected an independent MOCAP dataset while recording walking with a video camera (VC) and inertial measurement units (IMUs). We quantified the prediction accuracy of the ANNs using walking speed and KFA estimates from (1) MOCAP data, (2) VC data, and (3) IMU data separately (i.e., we quantified three sets of prediction accuracy metrics). Using portable modalities, we achieved prediction accuracies between 0.13 and 0.37 root mean square error normalized to the mean of the musculoskeletal analysis-based reference values. The correlation between the predicted and reference loading peaks varied between 0.65 and 0.91. This was comparable to the prediction accuracies obtained when obtaining predictors from motion capture data. The prediction results show that both VCs and IMUs can be used to estimate predictors that can be used in estimating knee joint loading outside the motion laboratory. Future studies should investigate the usability of the methods in an out-of-laboratory setting.

Validation of IMU against optical reference and development of open-source pipeline: proof of concept case report in a participant with transfemoral amputation fitted with a Percutaneous Osseointegrated Implant

BackgroundSystems that capture motion under laboratory conditions limit validity in real-world environments. Mobile motion capture solutions such as Inertial Measurement Units (IMUs) can progress our understanding of "real" human movement. IMU data must be validated in each application to interpret with clinical applicability; this is particularly true for diverse populations. Our IMU analysis method builds on the OpenSim IMU Inverse Kinematics toolkit integrating the Versatile Quaternion-based Filter and incorporates realistic constraints to the underlying biomechanical model. We validate our processing method against the reference standard optical motion capture in a case report with participants with transfemoral amputation fitted with a Percutaneous Osseointegrated Implant (POI) and without amputation walking over level ground. We hypothesis that by using this novel pipeline, we can validate IMU motion capture data, to a clinically acceptable degree.ResultsAverage RMSE (across all joints) between the two systems from the participant with a unilateral transfemoral amputation (TFA) on the amputated and the intact sides were 2.35° (IQR = 1.45°) and 3.59° (IQR = 2.00°) respectively. Equivalent results in the non-amputated participant were 2.26° (IQR = 1.08°). Joint level average RMSE between the two systems from the TFA ranged from 1.66° to 3.82° and from 1.21° to 5.46° in the non-amputated participant. In plane average RMSE between the two systems from the TFA ranged from 2.17° (coronal) to 3.91° (sagittal) and from 1.96° (transverse) to 2.32° (sagittal) in the non-amputated participant. Coefficients of Multiple Correlation (CMC) results between the two systems in the TFA ranged from 0.74 to > 0.99 and from 0.72 to > 0.99 in the non-amputated participant and resulted in ‘excellent’ similarity in each data set average, in every plane and at all joint levels. Normalized RMSE between the two systems from the TFA ranged from 3.40% (knee level) to 54.54% (pelvis level) and from 2.18% to 36.01% in the non-amputated participant.ConclusionsWe offer a modular processing pipeline that enables the addition of extra layers, facilitates changes to the underlying biomechanical model, and can accept raw IMU data from any vendor. We successfully validate the pipeline using data, for the first time, from a TFA participant using a POI and have proved our hypothesis.

Behavioral response of megafauna to boat collision measured via animal-borne camera and IMU

Overlap between marine megafauna and maritime activities is a topic of global concern. Basking sharks (Cetorhinus maximus; CM) are listed as Globally Endangered under the IUCN, though reported sightings appear to be increasing in Ireland. While such trends in the region are welcome, increasing spatiotemporal overlap between CM and numerous water users poses an increased risk of boat strikes to the animals. To demonstrate the risk and impact of boat strikes on marine megafauna, we present camera-enabled animal-borne inertial measurement unit (IMU) data from a non-lethal boat strike on a CM within a proposed National Marine Park in Ireland. We tagged a ~7-m female CM in County Kerry, Ireland, which was struck by a boat ~6 h after tag deployment. Comparison of pre-strike data with 4 h of video and ~7.5 h of IMU data following the boat strike provides critical insight into the animal’s response. While the CM reacted momentarily with an increase in activity and swam to the seafloor, it quickly reduced its overall activity (i.e., overall dynamic body acceleration, tailbeat cycles, tailbeat amplitude, and vertical velocity) for the remainder of the deployment. Notably, the animal also ceased feeding for the duration of the video and headed towards deep offshore waters, which is in stark contrast to the pre-strike period where the animal was consistently observed feeding along the surface in shallow coastal water. This work provides insight into a CM’s response to acute injury and highlights the need for appropriate protections to mitigate risks for marine megafauna.

Real-time IMU-Based Kinematics in the Presence of Wireless Data Drop.

Wireless inertial motion capture holds promise for real-time human-machine interfaces and home-based rehabilitation applications. However, wireless data drop can cause significant estimation errors deteriorating performance or even making the system unusable. It is currently unclear how to estimate non-periodic kinematics with wearable inertial measurement units (IMUs) in the presence of wireless data drop (packet loss). We thus propose a novel inference encoder-decoder network model for real-time kinematics during dynamic movement. Twenty-four healthy subjects performed yoga, golf, swimming, dance, and badminton movement activities while wearing IMUs and 10-90% of each IMU's data were randomly removed to determine the effects of data drop on estimation accuracy with and without the proposed model. Results demonstrated a reduction in RMSE of 45.2% to 51.5% in the upper limb kinematic estimation of the proposed model compared to the No Prediction strategy, and a reduction of 19.1% to 31.3% of the proposed model compared with an baseline LSTM model. In addition, the proposed model has significantly less error (p<0.05) than the No Prediction strategy and the baseline LSTM model for 10%, 20%, 30%, 40%, 50%, 60%, 70%, and 80% data drop. These results could enable wearable, wireless IMU dynamic motion analysis and assessment with reduced kinematic estimation error in the presence of varying amounts of wireless data drop and thus could further facilitate human-machine interaction and home-based medical assessment and treatment.

Automated Detection of In-Home Activities with Ultra-Wideband Sensors.

As Canada's population of older adults rises, the need for aging-in-place solutions is growing due to the declining quality of long-term-care homes and long wait times. While the current standards include questionnaire-based assessments for monitoring activities of daily living (ADLs), there is an urgent need for advanced indoor localization technologies that ensure privacy. This study explores the use of Ultra-Wideband (UWB) technology for activity recognition in a mock condo in the Glenrose Rehabilitation Hospital. UWB systems with built-in Inertial Measurement Unit (IMU) sensors were tested, using anchors set up across the condo and a tag worn by patients. We tested various UWB setups, changed the number of anchors, and varied the tag placement (on the wrist or chest). Wrist-worn tags consistently outperformed chest-worn tags, and the nine-anchor configuration yielded the highest accuracy. Machine learning models were developed to classify activities based on UWB and IMU data. Models that included positional data significantly outperformed those that did not. The Random Forest model with a 4 s data window achieved an accuracy of 94%, compared to 79.2% when positional data were excluded. These findings demonstrate that incorporating positional data with IMU sensors is a promising method for effective remote patient monitoring.

Automatic Detection and Assessment of Freezing of Gait Manifestations.

Freezing of gait (FOG) is an episodic and highly disabling symptom of Parkinson's disease (PD). Although described as a single phenomenon, FOG is heterogeneous and can express as different manifestations, such as trembling in place or complete akinesia. We aimed to analyze the efficacy of deep learning (DL) trained on inertial measurement unit data to classify FOG into both manifestations. We adapted and compared four state-of-the-art FOG detection algorithms for this task and investigated the advantages of incorporating a refinement model to address oversegmentation errors. We evaluated the model's performance in distinguishing between trembling and akinesia, as well as other forms of movement cessation (e.g., stopping and sitting), against gold-standard video annotations. Experiments were conducted on a dataset of eighteen PD patients completing a FOG-provoking protocol in a gait laboratory. Results showed our model achieved an F1 score of 0.78 and segment F1@50 of 0.75 in detecting FOG manifestations. Assessment of FOG severity was strong for trembling (ICC=0.86, [0.66,0.95]) and moderately strong for akinesia (ICC=0.78, [0.51,0.91]). Importantly, our model successfully differentiated FOG from other forms of movement cessation during 360-degree turning-in-place tasks. In conclusion, our study demonstrates that DL can accurately assess different types of FOG manifestations, warranting further investigation in larger and more diverse verification cohorts.

A hybrid information fusion method for SINS/GNSS integrated navigation system utilizing GRU-aided AKF during GNSS outages

Abstract To enhance the performance of integrated inertial navigation system (INS) and global navigation satellite system (GNSS) during GNSS outages, this paper proposed a fusion positioning method based on predictive observation information and adaptive filter parameter. Combined with an adaptive Kalman filter (AKF) and a Gated Recurrent Unit neural network (NN) that directly relates the inertial measurement unit (IMU) output sequence to the error estimation, the hybrid information fusion system can provide effective corrections to compensate for horizontal position errors under the constraints of complex and dynamic vehicle movement data during GNSS outages. Meanwhile, the designed adaptive parameter of the integrated navigation filter can adjust the credibility of the state prediction section when the GNSS is reconnected, ensuring the system can switch rapidly between the INS/GNSS and INS/NN integrated modes. The performance of the proposed information fusion method has been experimentally validated using IMU and GNSS data collected in a vehicle navigation test conducted on a stretch of expressway. The comparison results indicate that the proposed algorithm has error suppression capabilities under various experimental constraints and demonstrates a degree of extendibility and reusability.

Novel Wearable System to Recognize Sign Language in Real Time.

The aim of this study is to develop a practical software solution for real-time recognition of sign language words using two arms. This will facilitate communication between hearing-impaired individuals and those who can hear. We are aware of several sign language recognition systems developed using different technologies, including cameras, armbands, and gloves. However, the system we propose in this study stands out for its practicality, utilizing surface electromyography (muscle activity) and inertial measurement unit (motion dynamics) data from both arms. We address the drawbacks of other methods, such as high costs, low accuracy due to ambient light and obstacles, and complex hardware requirements, which have limited their practical application. Our software can run on different operating systems using digital signal processing and machine learning methods specific to this study. For the test, we created a dataset of 80 words based on their frequency of use in daily life and performed a thorough feature extraction process. We tested the recognition performance using various classifiers and parameters and compared the results. The random forest algorithm emerged as the most successful, achieving a remarkable 99.875% accuracy, while the naïve Bayes algorithm had the lowest success rate with 87.625% accuracy. The new system promises to significantly improve communication for people with hearing disabilities and ensures seamless integration into daily life without compromising user comfort or lifestyle quality.

Adaptive Cubature Kalman Filter for Inertial/Geomagnetic Integrated Navigation System Based on Long Short-Term Memory Network

Inertial navigation systems experience error accumulation over time, leading to the use of integrated navigation as a classical solution to mitigate inertial drift. This provides a novel approach to navigation and positioning by using the combined advantages of inertial and geomagnetic navigation systems. However, inertial/geomagnetic navigation is affected by significant magnetic interference in practical scenarios, resulting in reduced navigation accuracy. This research introduces a new neural network-assisted integrated inertial–geomagnetic navigation method (IM-NN), and utilizes the adaptive cubature Kalman filter to integrate attitude information from geomagnetism and inertial sensors. A model was created utilizing a Long Short-Term Memory Network (LSTM) to represent the relationship between specific force, angular velocity, and integrated navigation attitude information. The dynamics were estimated based on current and previous Inertial Measurement Unit (IMU) data using IM-NN. This study demonstrated that the method effectively corrected inertial accumulation errors and mitigated geomagnetic disruption, resulting in a more accurate and dependable navigation solution in environments with geomagnetic rejection compared to conventional single inertial navigation methods.

Adaptive Cubature Kalman Filter for Inertial/Geomagnetic Integrated Navigation System Based on Long Short-Term Memory Network

Inertial navigation systems experience error accumulation over time, leading to the use of integrated navigation as a classical solution to mitigate inertial drift. This provides a novel approach to navigation and positioning by using the combined advantages of inertial and geomagnetic navigation systems. However, inertial/geomagnetic navigation is affected by significant magnetic interference in practical scenarios, resulting in reduced navigation accuracy. This research introduces a new neural network-assisted integrated inertial–geomagnetic navigation method (IM-NN), and utilizes the adaptive cubature Kalman filter to integrate attitude information from geomagnetism and inertial sensors. A model was created utilizing a Long Short-Term Memory Network (LSTM) to represent the relationship between specific force, angular velocity, and integrated navigation attitude information. The dynamics were estimated based on current and previous Inertial Measurement Unit (IMU) data using IM-NN. This study demonstrated that the method effectively corrected inertial accumulation errors and mitigated geomagnetic disruption, resulting in a more accurate and dependable navigation solution in environments with geomagnetic rejection compared to conventional single inertial navigation methods.

A Residual Deep Learning Method for Accurate and Efficient Recognition of Gym Exercise Activities Using Electromyography and IMU Sensors

The accurate and efficient recognition of gym workout activities using wearable sensors holds significant implications for assessing fitness levels, tailoring personalized training regimens, and overseeing rehabilitation progress. This study introduces CNN-ResBiGRU, a novel deep learning architecture that amalgamates residual and hybrid methodologies, aiming to precisely categorize gym exercises based on multimodal sensor data. The primary goal of this model is to effectively identify various gym workouts by integrating convolutional neural networks, residual connections, and bidirectional gated recurrent units. Raw electromyography and inertial measurement unit data collected from wearable sensors worn by individuals during strength training and gym sessions serve as inputs for the CNN-ResBiGRU model. Initially, convolutional neural network layers are employed to extract unique features in both temporal and spatial dimensions, capturing localized patterns within the sensor outputs. Subsequently, the extracted features are fed into the ResBiGRU component, leveraging residual connections and bidirectional processing to capture the exercise activities’ long-term temporal dependencies and contextual information. The performance of the proposed model is evaluated using the Myogym dataset, comprising data from 10 participants engaged in 30 distinct gym activities. The model achieves a classification accuracy of 97.29% and an F1-score of 92.68%. Ablation studies confirm the effectiveness of the convolutional neural network and ResBiGRU components. The proposed hybrid model uses wearable multimodal sensor data to accurately and efficiently recognize gym exercise activity.

Strategy analysis of badminton players using deep learning from IMU and UWB wearables

Badminton is a fast-paced sport that requires a high level of skill and coordination. To improve their skills, players can use activity trackers to monitor different shots and activities. These trackers utilize inertial measurement units (IMUs), which measures acceleration and angular velocity on the rackets, and the ultra-wideband (UWB) sensors, which measure the location of the player. This study first analyzes the use of UWB localization for tracking badminton players on the court and analyzes the location where shots are played. Furthermore, this study focuses on using both IMU at the racket and wrist and UWB sensors to recognize strategies utilized in badminton matches, employing convolutional neural network (CNN) and Long-Short-Term Memory (LSTM) models. The goal is to classify thirteen badminton shots, as well as an extra class that contains non-shot activities. The output of this shot classifier is provided to the strategy recognition model, which can identify four main strategies, with eleven variations in total, alongside an additional class designated for non-strategy instances such as movement or rest intervals. We trained and tested the models on data from six skilled badminton players. The best results were achieved by using both IMU and UWB data. The proposed 2D-CNN achieved a shot classification accuracy of 90.9%, while the proposed LSTM achieved a strategy recognition accuracy of 80%. The results of this study suggest that neural networks can be used to effectively classify badminton shots and strategies to improve the training of badminton players, as well as to analyze match data.

IMU Data-Driven and PCA-Based Approach to Establish Quantifiable and Practically Applicable Measures for V2 Technique Elements in Cross-Country Skiing.

Quantifying movement coordination in cross-country (XC) skiing, specifically the technique with its elemental forms, is challenging. Particularly, this applies when trying to establish a bidirectional transfer between scientific theory and practical experts' knowledge as expressed, for example, in ski instruction curricula. The objective of this study was to translate 14 curricula-informed distinct elements of the V2 ski-skating technique (horizontal and vertical posture, lateral tilt, head position, upper body rotation, arm swing, shoulder abduction, elbow flexion, hand and leg distance, plantar flexion, ski set-down, leg push-off, and gliding phase) into plausible, valid and applicable measures to make the technique training process more quantifiable and scientifically grounded. Inertial measurement unit (IMU) data of 10 highly experienced XC skiers who demonstrated the technique elements by two extreme forms each (e.g., anterior versus posterior positioning for the horizontal posture) were recorded. Element-specific principal component analyses (PCAs)-driven by the variance produced by the technique extremes-resulted in movement components that express quantifiable measures of the underlying technique elements. Ten measures were found to be sensitive in distinguishing between the inputted extreme variations using statistical parametric mapping (SPM), whereas for four elements the SPM did not detect differences (lateral tilt, plantar flexion, ski set-down, and leg push-off). Applicability of the established technique measures was determined based on quantifying individual techniques through them. The study introduces a novel approach to quantitatively assess V2 ski-skating technique, which might help to enhance technique feedback and bridge the communication gap that often exists between practitioners and scientists.

Tai Chi Movement Recognition and Precise Intervention for the Elderly Based on Inertial Measurement Units and Temporal Convolutional Neural Networks.

(1) Background: The objective of this study was to recognize tai chi movements using inertial measurement units (IMUs) and temporal convolutional neural networks (TCNs) and to provide precise interventions for elderly people. (2) Methods: This study consisted of two parts: firstly, 70 skilled tai chi practitioners were used for movement recognition; secondly, 60 elderly males were used for an intervention study. IMU data were collected from skilled tai chi practitioners performing Bafa Wubu, and TCN models were constructed and trained to classify these movements. Elderly participants were divided into a precision intervention group and a standard intervention group, with the former receiving weekly real-time IMU feedback. Outcomes measured included balance, grip strength, quality of life, and depression. (3) Results: The TCN model demonstrated high accuracy in identifying tai chi movements, with percentages ranging from 82.6% to 94.4%. After eight weeks of intervention, both groups showed significant improvements in grip strength, quality of life, and depression. However, only the precision intervention group showed a significant increase in balance and higher post-intervention scores compared to the standard intervention group. (4) Conclusions: This study successfully employed IMU and TCN to identify Tai Chi movements and provide targeted feedback to older participants. Real-time IMU feedback can enhance health outcome indicators in elderly males.

Inertial Measurement Unit and Heart Rate Monitoring to Assess Cardiovascular Fitness of Manual Wheelchair Users during the Six-Minute Push Test.

Manual wheelchair users (MWUs) are prone to a sedentary life that can negatively affect their physical and cardiovascular health, making regular assessment important to identify appropriate interventions and lifestyle modifications. One mean of assessing MWUs' physical health is the 6 min push test (6MPT), where the user propels themselves as far as they can in six minutes. However, reliance on observer input introduces subjectivity, while limited quantitative data inhibit comprehensive assessment. Incorporating sensors into the 6MPT can address these limitations. Here, ten MWUs performed the 6MPT with additional sensors: two inertial measurement units (IMUs)-one on the wheelchair and one on the wrist together with a heart rate wristwatch. The conventional measurements of distance and laps were recorded by the observer, and the IMU data were used to calculate laps, distance, speed, and cadence. The results demonstrated that the IMU can provide the metrics of the traditional 6MPT with strong significant correlations between calculated laps and observer lap counts (r = 0.947, p < 0.001) and distances (r = 0.970, p < 0.001). Moreover, heart rate during the final minute was significantly correlated with calculated distance (r = 0.762, p = 0.017). Enhanced 6MPT assessment can provide objective, quantitative, and comprehensive data for clinicians to effectively inform interventions in rehabilitation.

Data-Driven Machine Fault Diagnosis of Multisensor Vibration Data Using Synchrosqueezed Transform and Time-Frequency Image Recognition with Convolutional Neural Network

Accurate vibration classification using inertial measurement unit (IMU) data is critical for various applications such as condition monitoring and fault diagnosis. This study proposes a novel convolutional neural network (CNN) based approach, the IMU6DoF-SST-CNN in six variants, for robust vibration classification. The method utilizes Fourier synchrosqueezed transform (FSST) and wavelet synchrosqueezed transform (WSST) for time-frequency analysis, effectively capturing the temporal and spectral characteristics of the vibration data. Additionally, was used the IMU6DoF-SST-CNN to explore three different fusion strategies for sensor data to combine information from the IMU’s multiple axes, allowing the CNN to learn from complementary information across various axes. The efficacy of the proposed method was validated using three datasets. The first dataset consisted of constant fan velocity data (three classes: idle, normal operation, and fault) at 200 Hz. The second dataset contained variable fan velocity data (also with three classes: normal operation, fault 1, and fault 2) at 2000 Hz. Finally, a third dataset of Case Western Reserve University (CWRU) comprised bearing fault data with thirteen classes, sampled at 12 kHz. The proposed method achieved a perfect validation accuracy for the investigated vibration classification task. While all variants of the method achieved high accuracy, a trade-off between training speed and image generation efficiency was observed. Furthermore, FSST demonstrated superior localization capabilities compared to traditional methods like continuous wavelet transform (CWT) and short-time Fourier transform (STFT), as confirmed by image representations and interpretability analysis. This improved localization allows the CNN to effectively capture transient features associated with faults, leading to more accurate vibration classification. Overall, this study presents a promising and efficient approach for vibration classification using IMU data with the proposed IMU6DoF-SST-CNN method. The best result was obtained for IMU6DoF-SST-CNN with FSST and sensor-type fusion.

Slope estimation based on multi-source information fusion

Abstract This study presents a novel methodology for slope estimation, addressing limitations in current unidirectional estimation research. A comprehensive vehicle kinematics and dynamics model is developed using Inertial Measurement Unit (IMU) data, enabling a thorough assessment of vehicle slope. The proposal advocates employing the Interactive Multiple Model Unscented Kalman Filter algorithm to enhance algorithmic stability and prevent divergence from singular model errors. This approach ensures precise computation of dynamic slopes. The algorithm’s efficacy is demonstrated through collaborative simulations on the CarSim/Simulink platform. Introducing innovative concepts and methods for slope estimation, this research has significant practical and theoretical implications.

Camera-IMU extrinsic calibration method based on intermittent sampling and RANSAC optimization

Accurately calibrate the extrinsic parameters between a camera and an Inertial Measurement Unit (IMU) is a prerequisite for achieving sensor data fusion in visual-inertial navigation systems. Due to delays introduced by triggering, transmission, and other factors, the sampled times of the camera and IMU do not align with the system timestamps, leading to a decrease in the accuracy of extrinsic calibration. Existing calibration methods are unable to avoid the temporal misalignment between the camera and IMU. This paper introduces a novel intermittent calibration sampling method to address temporal misalignment challenges. The approach entails detecting motion-stillness transition points in the IMU data as keyframe segmentation criteria, thereby decoupling data acquisition from system timestamps and aligning it with the sensor’s motion process. Subsequently, the robot hand-eye calibration method is applied to the extrinsic calibration of the Camera-IMU, combining the Random Sample Consensus algorithm to filter the poses of the camera and IMU. This process achieves precise calibration of extrinsic parameters. Experimental validation shows that the algorithm proposed in this paper enhances calibration accuracy when compared to the widely used Kalibr Camera-IMU calibration toolbox. The rotational extrinsic parameter accuracy increased by 181.25%, and the translational extrinsic parameter accuracy improved by 168.33%. These findings provide effective technical means for precise measurement of Camera-IMU extrinsic parameters.

Research on a Low-Cost High-Precision Positioning System for Orchard Mowers

To regulate the energy flow in orchard ecosystems and maintain the environment, weeding has become a necessary measure for fruit farmers, and the use of automated mowers can help reduce labor costs and improve the economic efficiency of orchards. However, due to the complexity of the geographic and spatial environment of the orchard, in particular, the loose and undulating road surface, the interference of satellite signals by large trees, etc., which decreases the positioning accuracy and stability of the positioning system of the mower, and the high cost of the sensor also affect the popularization of intelligent mowers for these applications. To address the above problems, this paper constructs a positioning system through a low-cost global navigation satellite system (GNSS), inertial measurement unit (IMU), and odometry, and utilizes the Kalman filter algorithm based on the error state for a combined GNSS/IMU positioning so that the inertial navigation system can maintain a more accurate positioning when the GNSS signals are poor. Considering the side-slip and error accumulation problems of the odometry of the traction mower, the combined GNSS/IMU positioning information is used to optimize the odometry model and improve the navigation and positioning accuracy. To reduce the measurement error of the IMU and the problem of error accumulation, this paper utilizes the nonholonomic constraint (NHC) of a lawn mower to suppress the dispersion of IMU measurement errors and constructs periodic and nonperiodic zero-velocity updating (ZUPT) strategies in combination with the travel paths of lawn mower navigation operations in the region to update the IMU data to improve the positioning accuracy and stability of the positioning system. The experiments show that the average error of the constructed positioning system is controlled within 0.15 m, the maximum error is maintained at approximately 0.3 m, and the positioning system constructed by using low-cost sensors can achieve a positioning accuracy similar to that of the differential global navigation satellite system (DGNSS), which is beneficial for the promotion and application of intelligent mowers in orchards.