Inertial Sensors Research Articles

Accurate detection of gait events using neural networks and IMU data mimicking real-world smartphone usage

Wearable technologies such as inertial measurement units (IMUs) can be used to evaluate human gait and improve mobility, but sensor fixation is still a limitation that needs to be addressed. Therefore, aim of this study was to create a machine learning algorithm to predict gait events using a single IMU mimicking the carrying of a smartphone. Fifty-two healthy adults (35 males/17 females) walked on a treadmill at various speeds while carrying a surrogate smartphone in the right hand, front right trouser pocket, and right jacket pocket. Ground-truth gait events (e.g. heel strikes and toe-offs) were determined bilaterally using a gold standard optical motion capture system. The tri-dimensional accelerometer and gyroscope data were segmented in 20-ms windows, which were labelled as containing or not the gait events. A long-short term memory neural network (LSTM-NN) was used to classify the 20-ms windows as containing the heel strike or toe-off for the right or left legs, using 80% of the data for training and 20% of the data for testing. The results demonstrated an overall accuracy of 92% across all phone positions and walking speeds, with a slightly higher accuracy for the right-side predictions (∼94%) when compared to the left side (∼91%). Moreover, we found a median time error <3% of the gait cycle duration across all speeds and positions (∼77 ms). Our results represent a promising first step towards using smartphones for remote gait analysis without requiring IMU fixation, but further research is needed to enhance generalizability and explore real-world deployment.

Decentralized fault-tolerant control of multi-mobile robot system addressing LiDAR sensor faults

The control of multi-robot formations is a crucial aspect in various applications, such as transport, surveillance and monitoring environments. Maintaining robots in a specific formation pose or performing a cooperative task is a significant challenge when a fault occurs among any of the robots. This work presents a Decentralized Fault-Tolerant Control (DFTC) scheme that addresses lidar sensor faults within a system of multiple differential wheeled mobile robots. The robots change the formation shape according to the number of available robots within the formation. A Graph theory is implemented to represent the multi-robot formation and communication. Each mobile robot is equipped with three sensors: a wheel encoder, an Inertial Measurement Unit (IMU), and a lidar sensor. Sensor fault detection and isolation (FDI) is implemented at two levels. The pose estimation obtained from the wheel encoder and IMU is fused using an extended Kalman filter (EKF), and this pose estimation is utilized at the local level of lidar sensor FDI. At the system level, the FDI of the lidar sensor involves computing a residual by comparing the pose estimation with other lidar sensors mounted on other mobile robots within the formation. The presented FTC scheme is simulated in Simulink multi-robot environments.

Tightly coupled stereo vision-inertial odometry based on point and line feature

Abstract To improve the accuracy and robustness of visual simultaneous localization and mapping (SLAM) in low-texture environments, this paper proposes a robust and fast stereo vision inertial SLAM pose estimation method that combines point and line features with an inertial measurement unit (IMU). The method tightly couples visual point and line features with IMU constraints, forming a least-squares problem through the error of each constraint term for nonlinear optimization. To address the issues of over-segmentation and time consumption in traditional line segment detection (LSD) algorithms, an improved LSD algorithm is adopted to accelerate line feature extraction. This approach merges nearby line segments based on spatial geometric relationships and filters out invalid segments, improving the time efficiency of the algorithm. Finally, experiments conducted in low-texture environments demonstrate that our algorithm achieves high localization accuracy and robustness.

Physical Frailty Prediction Using Cane Usage Characteristics during Walking.

This study aimed to determine the characteristics of accelerations and angular velocities obtained by an inertial measurement unit (IMU) attached to a cane between older people with and without physical frailty. Community-dwelling older people walked at a comfortable speed using a cane with a built-in IMU. Physical frailty was assessed using exercise-related items extracted from the Kihon Check List. The efficacy of five machine learning models in distinguishing older people with physical frailty was investigated. This study included 48 older people, of which 24 were frail and 24 were not. Compared with the non-frail participants, the older people with physical frailty had a small root mean square value in the vertical and anteroposterior directions and angular velocity in the anteroposterior direction (p < 0.001, r = 0.36; p < 0.001, r = 0.29; p < 0.001, r = 0.30, respectively) and a large mean power frequency value in the vertical direction (p = 0.042, r = 0.18). The decision tree model could most effectively classify physical frailty, with an accuracy, F1 score, and area under the curve of 78.6%, 91.8%, and 0.81, respectively. The characteristics of IMU-attached cane usage by older adults with physical frailty can be utilized to effectively evaluate and determine physical frailty in their usual environments.

Pre-and-post impact fall detection based on support vector machines using inertial and barometric pressure data

Objective: This paper presents a novel real-time algorithm for fall detection, which contextualizes falls by identifying activities occurring both pre- and post-impact utilizing machine learning techniques and wearable sensors. Methodology: The activities selected to contextualize fall events included standing, lying, walking, running, climbing stairs, and using the elevator. Data were collected using an inertial measurement unit and a barometric altimeter positioned on the participants’ lower backs. Thirteen healthy subjects were observed performing the activities and fall events were recorded from five healthy subjects. The proposed algorithm combines thresholding and cascade support vector machines (SVMs), whose robustness is enhanced by a verification process of the subject’s posture aimed at determining the occurrence of the fall more accurately. Results: The performance of the algorithm was evaluated in terms of the hit rate (HT) both offline and in real-time. From the activities studied, stairs climbing proved to be the most challenging to detect, with an offline HT of 85% and an online HT of 76 %. The overall offline performance was superior, with an HT of 96 %, compared to the performance achieved online, an HT of 91 %; in both cases the fall detection HT was 100 %. Conclusions: The algorithm can be used to recognize fall events occurring to any user, as it has the advantage of not needing prior adaptation due to the nonlinear nature of the SVMs. The cascade SVMs allow for using small sets of variables, leading to low computational cost and a suitable real-time implementation. These features, in addition to the posture verification process, make our algorithm suitable for activity recognition in non-laboratory environments.

Technology for preventing work-related musculoskeletal injuries in healthcare professionals: A scoping review

Background &amp; Aim: This scoping review aims to identify and summarize how technology can help prevent work-related musculoskeletal injuries in healthcare professionals. Methods &amp; Materials: We conducted a scoping review following the steps provided by the Joanna Briggs Institute. The PRISMA® - Preferred Reporting Items for Systematic Reviews and Meta-Analyses model was used to organize the information, following the recommendations described in PRISMA-ScR (PRISMA Extension for Scoping Reviews) for the article presentation. A search of PubMed, Scopus, and CINAHL databases was conducted for all articles in December 2023. Results: Of the 964 initial articles identified, 7 met the inclusion criteria. The reviewed studies highlight the effectiveness of various technological interventions in reducing musculoskeletal injuries among healthcare professionals. Wearable technologies, such as inertial measurement units, have been effective in promoting correct posture and reducing the risk of musculoskeletal disorders. However, the studies also identified significant challenges, including the generalizability of findings, the need for more robust empirical evidence, and issues related to the long-term sustainability and cost-effectiveness of these technologies. Conclusion: The conclusion of this analysis highlights the need for scalable, effective, and customized therapies and calls for more study and development in gamification, wearable technologies, and tailored mobile applications.

Comparing the Ground Reaction Forces, Toe Clearances, and Stride Lengths of Young and Older Adults Using a Novel Shoe Sensor System.

In this study, we developed a lightweight shoe sensor system equipped with four high-capacity, compact triaxial force sensors and an inertial measurement unit. Remarkably, this system enabled measurements of localized three-directional ground reaction forces (GRFs) at each sensor position (heel, first and fifth metatarsal heads, and toe) and estimations of stride length and toe clearance during walking. Compared to conventional optical motion analysis systems, the developed sensor system provided relatively accurate results for stride length and minimum toe clearance. To test the performance of the system, 15 older and 8 young adults were instructed to walk along a straight line while wearing the system. The results reveal that compared to the young adults, older adults exhibited lower localized GRF contributions from the heel and greater localized GRF contribution from the toe and fifth metatarsal locations. Furthermore, the older adults exhibited greater variability in their stride length and smaller toe clearance with greater variability compared to the young adults. These results underscore the effectiveness of the proposed gait analysis system in distinguishing the gait characteristics of young and older adults, potentially replacing traditional motion capture systems and force plates in gait analysis.

Quantifying Trunk Impact Dynamics and Workload with Inertial Sensors in Goalball Players

The aim of this study was to quantify trunk impact dynamics in goalball players using inertial sensors and evaluate the goalball players’ workloads, focusing on changes between the first and second halves of a match to enhance understanding of the demands experienced throughout the game. Utilizing inertial technology, trunk impacts during goalball gameplay were analyzed to provide a holistic insight into how these impacts influence athletes’ dynamic stress loads, which refers to the physical demands placed on the body during dynamic movements. Six goalball players were recruited to wear an accelerometer during a whole goalball game to quantify trunk impacts. The results showed a higher number of total impacts and a higher number of impacts at higher levels during the first half, compared to a higher percentage of impacts at a low impact level in the second half. These results suggest that the intensity of gameplay is related to the number of impacts sustained, with players experiencing significantly more impacts, particularly at very low, low, and very high impact levels, in the first half compared to the second half. This decline in impacts aligns with the reduction in game intensity as the match progressed, as indicated by a lower heart rate and a trend towards a lower dynamic stress load in the second half. Future research could explore targeted training interventions aimed at optimizing workload and performance in goalball players.

Biomechanical Analysis of Injury Risk in Two High-Altitude Landing Positions Using Xsens Inertial Units and EMG Sensors.

High-altitude landing maneuvers can pose a significant injury risk, particularly when performed with different landing techniques. This study aims to compare the biomechanical parameters and injury risks associated with two landing positions-staggered foot landing and simultaneous bilateral landing-using Xsens inertial units and electromyography (EMG) sensors. A total of 26 university students (13 males, 13 females) participated in this study. Kinematic data were collected using inertial measurement units (IMUs), muscle activity was recorded with EMG, and ground reaction forces were captured using 3D force plates. The data were processed and analyzed using the AnyBody modeling system to simulate joint forces, moments, and muscle activation. This study found that simultaneous bilateral landing exhibited greater hip flexion-extension, knee flexion-extension, and ankle inversion. Vertical joint forces were also significantly higher in the hip, knee, and ankle during simultaneous bilateral landing. Staggered foot landing showed higher muscle forces in the gluteus maximus, iliopsoas, and quadriceps femoris (p < 0.001). The EMG analysis revealed significant differences in the biceps femoris (p = 0.008) and quadriceps femoris (p < 0.001). These findings suggest that simultaneous bilateral landing increases joint load, while staggered foot landing increases muscle activation, which may lead to different injury risks between the two techniques.

Sarcopenia screening based on the assessment of gait with inertial measurement units: a systematic review

BackgroundGait variables assessed by inertial measurement units (IMUs) show promise as screening tools for aging-related diseases like sarcopenia. The main aims of this systematic review were to analyze and synthesize the scientific evidence for screening sarcopenia based on gait variables assessed by IMUs, and also to review articles that investigated which gait variables assessed by IMUs were related to sarcopenia.MethodsSix electronic databases (PubMed, SportDiscus, Web of Science, Cochrane Library, Scopus and IEEE Xplore) were searched for journal articles related to gait, IMUs and sarcopenia. The search was conducted until December 5, 2023. Titles, abstracts and full-length texts for studies were screened to be included.ResultsA total of seven articles were finally included in this review. Despite some methodological variability among the included studies, IMUs demonstrated potential as effective tools for detecting sarcopenia when coupled with artificial intelligence (AI) models, which outperformed traditional statistical methods in classification accuracy. The findings suggest that gait variables related to the stance phase such as stance duration, double support time, and variations between feet, are key indicators of sarcopenia.ConclusionsIMUs could be useful tools for sarcopenia screening based on gait analysis, specifically when artificial intelligence is used to process the recorded data. However, more development and research in this field is needed to provide an effective screening tool for doctors and health systems.

Visual-Inertial Fusion-Based Five-Degree-of-Freedom Motion Measurement System for Vessel-Mounted Cranes

Vessel-mounted cranes operate in complex marine environments, where precise measurement of cargo positions and attitudes is a key technological challenge to ensure operational stability and safety. This study introduces an integrated measurement system that combines vision and inertial sensing technologies, utilizing a stereo camera and two inertial measurement units (IMUs) to capture cargo motion in five degrees of freedom (DOF). By merging data from the stereo camera and IMUs, the system accurately determines the cargo’s position and attitude relative to the camera. The specific methodology is introduced as follows: First, the YOLO model is adopted to identify targets in the image and generate bounding boxes. Then, using the principle of binocular disparity, the depth within the bounding box is calculated to determine the target’s three-dimensional position in the camera coordinate system. Simultaneously, the IMU measures the attitude of the cargo, and a Kalman filter is applied to fuse the data from the two sensors. Experimental results indicate that the system’s measurement errors in the x, y, and z directions are less than 2.58%, 3.35%, and 3.37%, respectively, while errors in the roll and pitch directions are 3.87% and 5.02%. These results demonstrate that the designed measurement system effectively provides the necessary motion information in 5-DOF for vessel-mounted crane control, offering new approaches for pose detection of marine cranes and cargoes.

Total Least Squares In-Field Identification for MEMS-Based Inertial Measurement Units

Inertial Measurement Units are widely used in various applications and, hardware-wise, they primarily consist of a tri-axial accelerometer and a tri-axial gyroscope. For low-end commercial employments, the low cost of the device is crucial: this makes MEMS-based sensors a popular choice in this context. However, MEMS-based transducers are prone to significant, non-uniform and environmental-condition-dependent systematic errors, that require frequent re-calibration to be eliminated. To this end, identification methods that can be performed in-field by non-expert users, without the need for high-precision or costly equipment, are of particular interest. In this paper, we propose an in-field identification procedure based on the Total Least Squares method for both tri-axial accelerometers and gyroscopes. The proposed identification model is linear and requires no prior knowledge of the parameters to be identified. It enables accelerometer calibration without the need for specific reference surface orientation relative to Earth’s gravity and allows gyroscope calibration to be performed independently of accelerometer data, without requiring the sensor’s sensitive axes to be aligned with the rotation axes during calibration. Experiments conducted on NXP sensors FXOS8700CQ and FXAS21002 demonstrated that using parameters identified by our method reduced cross-validation standard deviations by about two orders of magnitude compared to those obtained using manufacturer-provided parameters. This result indicates that our method enables the effective calibration of IMU sensor parameters, relying only on simple 3D-printed equipment and significantly improving IMU performance at minimal cost.

Optimizing electrostatic acceleration noise by precisely adjusting the differential potential between the electrodes and test mass for space inertial sensors

Optimizing electrostatic acceleration noise by precisely adjusting the differential potential between the electrodes and test mass for space inertial sensors

IMU Airtime Detection in Snowboard Halfpipe: U-Net Deep Learning Approach Outperforms Traditional Threshold Algorithms.

Airtime is crucial for high-rotation tricks in snowboard halfpipe performance, significantly impacting trick difficulty, the primary judging criterion. This study aims to enhance the detection of take-off and landing events using inertial measurement unit (IMU) data in conjunction with machine learning algorithms since manual video-based methods are too time-consuming. Eight elite German National Team snowboarders performed 626 halfpipe tricks, recorded by two IMUs at the lateral lower legs and a video camera. The IMU data, synchronized with video, were labeled manually and segmented for analysis. Utilizing a 1D U-Net convolutional neural network (CNN), we achieved superior performance in all of our experiments, establishing new benchmarks for this binary segmentation task. In our extensive experiments, we achieved an 80.34% lower mean Hausdorff distance for unseen runs compared with the threshold approach when placed solely on the left lower leg. Using both left and right IMUs further improved performance (83.37% lower mean Hausdorff). For data from an algorithm-unknown athlete (Zero-Shot segmentation), the U-Net outperformed the threshold algorithm by 67.58%, and fine-tuning on athlete-specific (Few-Shot segmentation) runs improved the lower mean Hausdorff to 78.68%. The fine-tuned model detected takeoffs with median deviations of 0.008 s (IQR 0.030 s), landing deviations of 0.005 s (IQR 0.020 s), and airtime deviations of 0.000 s (IQR 0.027 s). These advancements facilitate real-time feedback and detailed biomechanical analysis, enhancing performance and trick execution, particularly during critical events, such as take-off and landing, where precise time-domain localization is crucial for providing accurate feedback to coaches and athletes.

Enhancing smartphone security with human centric bimodal fallback authentication leveraging sensors.

Smartphones store valuable personal information, necessitating robust authentication methods to protect user data. This research proposes a lightweight bi-model fallback authentication technique that combines dynamic security questions and finger pattern recognition using inertial measurement units. The dynamic security questions are generated based on the smartphone's usage behavior, while the owner's finger movements are captured using four different inertial sensors: accelerometer, gyroscope, gravity sensor, and magnetometer. By combining the answers to the questions and the owner's finger movements, the user can be authenticated even if the primary authentication method fails. In this study, data was collected from 24 participants, including 12 primary phone users and 12 close adversaries, over a span of 28 days. The dynamic security questions, derived from call, SMS, battery charging events, application usage, location, and physical activity categories, achieved high accuracy rates, with call, SMS, and application usage surpassing . Incorporating the inertial measurement units significantly improved the accuracy of all question types, increasing from a maximum of to , while also enhancing the True Positive Rate from 0.79 to 0.99 compared to a previous study. This research presents a promising lightweight bi-model fallback authentication technique that leverages dynamic security questions and inertial measurement units data, demonstrating its effectiveness for enhancing smartphone security.

A Novel Nonlinear Stochastic-Resonance-Enhanced Acceleration Data Processing Approach

Abstract. Smartphones are indispensable tools in modern social life, and they can be used for online shopping, electronic payment, gaming, and navigation. In particular, low-cost inertial measurement unit (IMU) sensors are widely integrated into smartphones, so pedestrian dead reckoning (PDR) positioning techniques based on smartphone IMU sensors have been applied and developed. PDR positioning techniques require acceleration data for step detection, step length estimation, and step heading estimation. However, due to the cost limitations of the built-in IMU sensor in smartphones, acceleration data contains measurement noise and interference, resulting in poor consistency in acceleration peak detection and the generation of false peaks, which is not conducive to step detection and accurate step length estimation. Therefore, this paper proposes a stochastic resonance (SR) enhancement method for smartphone IMU acceleration data. The SR-enhanced acceleration data has better peak consistency and is conducive to step detection. Finally, the algorithm is evaluated using actual measurement data collected from a smartphone. The results show that the SR-enhanced acceleration data has excellent peak consistency and higher step detection accuracy.

A novel autonomous exploration algorithm via LiDAR/IMU SLAM and hierarchical subsystem for mobile robot in unknown indoor environments

Abstract Autonomous exploration in unknown environments is an essential capability for mobile robots. The complexity of autonomous exploration, however, means that existing algorithms struggle to balance efficiency and comprehensiveness, causing low mapping accuracy and redundant path planning. To perform accurate and efficient exploration tasks, we have proposed a novel autonomous exploration algorithm via LiDAR/IMU (Inertial Measurement Unit) Simultaneous Localization and Mapping (SLAM) and hierarchical subsystem for mobile robot in unknown environments. Firstly, to enhance mapping accuracy for mobile robot exploration, LiDAR/IMU SLAM is improved with the assistance of backward propagation and iterated Kalman filter, and Bidirectional Rapidly–Exploring Random Trees* (BI–RRT*) is applied for efficient frontier point detection. Secondly, we optimize local path planning by leveraging information theory through perceptual quality evaluation, which is then integrated with global path planning utilizing an enhanced Travelling Salesman Problem solver and a sparse grid map to amplify exploration efficiency. Thirdly, an enhanced hierarchical autonomous exploration method for mobile robots is proposed, which incorporates local path planning for seamless navigation around highly promising exploration spots, coupled with global path planning to effectively interconnect various sub–regions. Finally, simulations and field tests have demonstrated that the proposed method explores an unknown indoor environment with a 30.8% reduction in exploration time and a 29.9% reduction in exploration path in comparison with Dynamic Stage Viewpoint Planner. The map constructed in this paper has more accurate details and exploration paths have been shortened to ensure effective exploration.

Modified ICP based Framework for 3D Localization and Mapping in GNSS-denied Environments using LiDAR

Abstract. Lidar odometry and mapping has emerged as fundamental technology in various fields, including accurate positioning and mapping, autonomous vehicles, robotics, and environmental monitoring. The ability to create accurate maps and calculate trajectories is essential for localization and navigation in complex environments, particularly in scenarios where GNSS signal are unavailable. In this context, we propose a novel method for simultaneous localization and mapping (SLAM) specifically designed for GNSS-denied environments and without the need for high-accuracy ranging or inertial measurement units (IMUs). Our approach aims to address the challenges posed by GNSS-denied environments and the cost constraints associated with using multiple sensors. By using only lidar sensors, specifically the Velodyne VLP 16 sensor, we offer a cost-effective solution. Our method utilizes a modified version of the Iterative Closest Point (ICP) algorithm to handle consecutive lidar scans seamlessly. In addition to our method, we conducted thorough accuracy assessments on the created map. The reason behind extensive accuracy evaluation is to ensure the quality of registration. By comparing alignment between the features of different frames within the map and determining the error between the registered features and the original, we gain a more comprehensive understanding of registration quality.

An Automatic Mapping Method of Navigation Map for Outdoor Road Scenes

Abstract. In the process of autonomous navigation of outdoor mobile robots, four modules are involved: perception, localization, planning, and controlling. The perception module utilizes sensors such as cameras and radars based on various principles to analyze the robot's surroundings in real-time. The localization module uses GPS (Global Positioning System), IMU (Inertial Measurement Unit), and prior maps for real-time positioning analysis. The planning module plans optimal path based on the outputs of the first two modules, and the controlling module directs the robot's chassis to move along the planned optimal path. For the localization module, the accuracy of GPS positioning results heavily depends on weather conditions and GPS signal receptions. Even if the positioning results of imu are integrated, the positioning accuracy still cannot meet the needs of robot navigation. Therefore, using prior maps for repositioning can compensate for this accuracy deficiency. The planning module also requires path planning based on prior maps. If the a priori map storage is large, it will lead to difficulties in usage, maintenance, and updates. Therefore, it is crucial to research lightweight navigation map mapping methods. In this paper, an automatically mapping method of lightweight navigation maps is proposed, combining cameras and LiDAR (Light Detection and Ranging), including semantic informations necessary for outdoor navigation positioning, such as pole-like objects and traffic signs for robot longitudinal positioning, and lane line elements for robot lateral positioning. This method automatic generates robot navigation maps in Lanelet2 format, providing support for subsequent positioning and path planning modules.

Proposal of UAV-SLAM-Based 3D Point Cloud Map Generation Method for Orchards Measurements

This paper proposes a method for generating highly accurate point cloud maps of orchards using an unmanned aerial vehicle (UAV) equipped with light detection and ranging (LiDAR). The point cloud captured by the UAV-LiDAR was converted to a geographic coordinate system using a global navigation satellite system / inertial measurement unit (GNSS/IMU). The converted point cloud is then aligned with the simultaneous localization and mapping (SLAM) technique. As a result, a 3D model of an orchard is generated in a low-cost and easy-to-use manner for pesticide application with precision. The method of direct point cloud alignment with real-time kinematic-global navigation satellite system (RTK-GNSS) had a root mean square error (RMSE) of 42 cm between the predicted and true crop height values, primarily due to the effects of GNSS multipath and vibration of automated vehicles. Contrastingly, our method demonstrated better results, with RMSE of 5.43 cm and 2.14 cm in the vertical and horizontal axes, respectively. The proposed method for predicting crop location successfully achieved the required accuracy of less than 1 m with errors not exceeding 30 cm in the geographic coordinate system.