Sound Feedback Research Articles

Augmenting the training space of an epidural needle insertion simulator with HoloLens

ABSTRACT The goal of this study is to explore the potential of the Optical See-Through Augmented Reality (OST-AR) in the training of median and paramedian epidural anaesthesia administration. To this end, we propose EpiduralLens, an epidural needle insertion simulator that augments the training space by resorting to a dummy, a HoloLens, an AR target, 3D sound feedback, and voice commands. The proposed system projects relevant 3D anatomical information and visual guides that are placed on and around the dummy, which are complemented with aural feedback that guides the instruction process. EpiduralLens was evaluated by 6 anaesthesiologists. The results of the formal evaluation sessions indicate that our prototype had high acceptability by the experts, verifying that combining an aural interface with 3D visual interface is a useful way to aid immersion and improve the learnability of trainees. Moreover, the participants showed interest in using the application in future sessions as a training aid for median and paramedian epidural anaesthesia administration.

Sound feedback control model for live electronic performance in the Ecos Study

Through the Ecos Study we investigate possibilities for musical structuring based on theories of emergence, finding a fertile territory for experimentations within Agostino Di Scipio's paradigm of Audible Ecosystems. The inclusion of the acoustic environment as an active component of the musical system led us to rethink classical techniques of sound synthesis and modelling, some traditional models of electroacoustic performance, and to criticize the very role of interactions in a qualitative perspective. A positive feedback control model has been developed aiming at understanding the behaviour and the structure of the ecosystem supporting the implementation of the Spatial Instrument, a core element implemented through MAX/MSP patch and that offers a logical rationale for organizing speakers and microphones in the acoustic space. We introduce the underlying theoretical debate and present the feedback control mechanism as the basis from which the Spatial Instrument is developed.

The Advancement of Virtual Reality in Automotive Market Research: Challenges and Opportunities

Virtual Reality (VR) can play a key role in automotive marketing research, lowering costs and shortening the time to launch a new product. However, few VR applications support automotive customers’ experiences during the early stages of product design. This study aims to identify and characterize into attributes the challenges and opportunities for the application of Virtual Reality in car clinics through a systematic review of the literature and patents. We searched PatentScout, ScienceDirect, Springer, and IEEEXplore for studies published between the databases’ inception and July 2020. Of the 77,383 patents and 336,785 articles identified, 72 and 13 were eligible, respectively. We discovered that patents are strongly concentrated by a few inventors, that the United States has the most records, and that the most prevalent applications relate to devices for automatically reading responders’ emotions in virtual environments. The articles revealed sixteen categories of challenges and opportunities: cost, location to customers, flexibility in interactions, model transportation, depth perception, haptic perception, motion, movement perception/physical collision, color and texture, sound feedback, product interaction/manipulation, visual–spatial, graphic quality, intuitiveness, cybersecurity, and cybersickness. Virtual Reality may be used for automotive marketing research but key factors such as hardware and software specification, stimulus quality, and survey objectives must be considered.

Wearable human-machine interaction device integrated by all-textile-based tactile sensors array via facile cross-stitch

Novel HMI devices have shown great potential application in somatosensory games, intelligent robot systems and artificial intelligence, attracting lots of researcher interests. However, the lack of suitable flexible sensors for signal input, reasonable signal processing and feedback schemes extremely restricts practical applications of the novel HMI devices. In this paper, a flexible wearable tactile sensors array based on textiles was prepared. A wearable HMI device was fabricated by setting finger tapings and sound as signal input as well as feedback. The textile based-sensor exhibits a high sensitivity of 0.84 kPa−1, fast response time less than 4 ms, outstanding cycle stability and washability after optimizing sensors configurations and woven structures. Collecting as well as processing of finger tapping data, and sound feedback were realized based on ESP32-DevKitC circuit, Bluetooth module and Android APP. A strategy of predicting signal trend before the maximum tapping value was proposed to reduce the response time of wearable HMI device. In addition, we also made a series of adjustments to the wearable HMI device feedback referring to the characteristics of electronic drums, which fully proved the huge application potential of this wearable HMI device.

Online control of an assistive active glove by slow cortical signals in patients with amyotrophic lateral sclerosis

Objective. A brain–computer interface (BCI) allows users to control external devices using brain signals that can be recorded non-invasively via electroencephalography (EEG). Movement related cortical potentials (MRCPs) are an attractive option for BCI control since they arise naturally during movement execution and imagination, and therefore, do not require an extensive training. This study tested the feasibility of online detection of reaching and grasping using MRCPs for the application in patients suffering from amyotrophic lateral sclerosis (ALS). Approach. A BCI system was developed to trigger closing of a soft assistive glove by detecting a reaching movement. The custom-made software application included data collection, a novel method for collecting the input data for classifier training from the offline recordings based on a sliding window approach, and online control of the glove. Eight healthy subjects and two ALS patients were recruited to test the developed BCI system. They performed assessment blocks without the glove active (NG), in which the movement detection was indicated by a sound feedback, and blocks (G) in which the glove was controlled by the BCI system. The true positive rate (TPR) and the positive predictive value (PPV) were adopted as the outcome measures. Correlation analysis between forehead EEG detecting ocular artifacts and sensorimotor area EEG was conducted to confirm the validity of the results. Main results. The overall median TPR and PPV were >0.75 for online BCI control, in both healthy individuals and patients, with no significant difference across the blocks (NG versus G). Significance. The results demonstrate that cortical activity during reaching can be detected and used to control an external system with a limited amount of training data (30 trials). The developed BCI system can be used to provide grasping assistance to ALS patients.

Impact of Applying a Skin Compression With the Ultrasound Probe on Carotid Artery Strain Elastography

To study the impact of varying the external compression exerted by the ultrasound probe when performing a carotid strain elastography exam. Nine healthy volunteers (mean age 43 years ±13 years; 6 men) underwent a vascular ultrasound elastography exam using a custom made sound feedback handle embedding the probe, and allowing the sonographer to adjust the applied compression. A clinical standard practice (SP) force was first recorded, and then predetermined compression (PDC) forces were applied, ranging from 0 to 5 N for the left common carotid artery (CCA) or 2-12 N for the left internal carotid artery (ICA). Six carotid elastography features, namely maximum and cumulated axial strains, maximum and cumulated shear strains, cumulated axial translation, and cumulated lateral translation were assessed with noninvasive vascular elastography (NIVE) on near and far walls of carotids. The carotid intima media thickness (IMT) and diameter were also measured. All elastography features on the near wall of both CCA and ICA decreased statistically significantly as the PDC force increased; this association was also observed for half of the features on the far wall. Three NIVE features at the lowest PDC force (out of 72 that were tested) were statistically significantly different than values at the SP force. Overall, NIVE showed some variance to probe compression with linear regression slopes revealing changes of 10.1%-45.6% in magnitude over the whole compression range on both walls. The maximum IMT for the ICA near wall, and carotid lumen diameters of both CCA and ICA were statistically significantly associated with PDC forces; these features underwent a decrease of 10.2%, 36.2%, and 17.6%, respectively, over the whole range of PDC force increase. Other IMT measurements were not statistically significantly associated with applied PDC forces. These results suggest the need of technical guidelines for carotid strain elastography. Using the lowest probe compression while allowing a good B-mode image quality is recommended to improve the robustness of NIVE measurements.

A Navigation and Augmented Reality System for Visually Impaired People.

In recent years, we have assisted with an impressive advance in augmented reality systems and computer vision algorithms, based on image processing and artificial intelligence. Thanks to these technologies, mainstream smartphones are able to estimate their own motion in 3D space with high accuracy. In this paper, we exploit such technologies to support the autonomous mobility of people with visual disabilities, identifying pre-defined virtual paths and providing context information, reducing the distance between the digital and real worlds. In particular, we present ARIANNA+, an extension of ARIANNA, a system explicitly designed for visually impaired people for indoor and outdoor localization and navigation. While ARIANNA is based on the assumption that landmarks, such as QR codes, and physical paths (composed of colored tapes, painted lines, or tactile pavings) are deployed in the environment and recognized by the camera of a common smartphone, ARIANNA+ eliminates the need for any physical support thanks to the ARKit library, which we exploit to build a completely virtual path. Moreover, ARIANNA+ adds the possibility for the users to have enhanced interactions with the surrounding environment, through convolutional neural networks (CNNs) trained to recognize objects or buildings and enabling the possibility of accessing contents associated with them. By using a common smartphone as a mediation instrument with the environment, ARIANNA+ leverages augmented reality and machine learning for enhancing physical accessibility. The proposed system allows visually impaired people to easily navigate in indoor and outdoor scenarios simply by loading a previously recorded virtual path and providing automatic guidance along the route, through haptic, speech, and sound feedback.

A comparison design study of feedback modalities to support deep breathing whilst performing work tasks.

Deep breathing exercises are known to help decrease stress. Wearable and ambient computing can help initiate and support deep breathing exercises. Most studies have focused on a single sensory modality for providing feedback on the quality of breathing and other physiological data. Our research compares different feedback modalities on an individual's experience and ability to perform breath-based techniques at work. We designed three different interactive prototypes that used light, vibration and sound feedback modalities. We tested each prototype with 19 participants whilst they were performing typical work tasks in a naturalistic setting, followed by semi-structured interviews. We found that sound was the most successful feedback for the majority of participants, followed by vibration and ambient light. We developed an analytic tool, the Extended Cycle of Awareness, to facilitate understanding of the patterns of awareness and the flow of experience generated by participant interaction with prototype systems that provide feedback on the quality of breathing. Participants followed one of three different types of patterns: (1) ignoring the feedback; (2) not understanding the feedback and being overwhelmed by it; (3) successfully using the feedback to initiate deep breathing and reflect on the change in the quality of breathing. We offer a set of design recommendations for crafting interactive systems to support deep breathing at work, including personalization, designing for the cyclical process of attention and awareness, and designing for reflective practice.

Design of a Neurofeedback Training System for Meditation Based on EEG Technology

Meditation is a form of mental training that has therapeutic potential and cognitive benefits that may enhance attention, mental well-being, and neuroplasticity. However, the learning process is not easy because meditators do not receive immediate feedback that lets them know if they are correctly doing the activity. EEG Neurofeedback training is one of the techniques to train brain self-regulation and it has the potential to increase the effectiveness of meditation. However, the benefits greatly differ between subjects with a high percentage of inefficacy. In this work, an EEG Neurofeedback Training System is proposed based on user-centered design methodology to provide real-time performance feedback to meditators to increase levels of attention and relaxation through a visual, sound and smell stimuli interface. Levels of attention and relaxation of nine participants were measured with a mobile Neurosky EEG headset biosensor during meditation practice to analyze the incidence of each type of stimuli during activity. Visual stimuli feedback was able to increase attention levels of 78% of the participants by 11.8% compared to a meditation session without any stimuli. The sound stimuli feedback was able to increase the relaxation levels of 44.4% of the participants by 16% compared to a session without any stimuli. These results might bring new insights for the design of a neurofeedback system interface for meditation. Further research on neurofeedback training interfaces for meditators is suggested to validate these results with more participants.

Blink input interface enabling multiple candidate selection through sound feedback

Several input interfaces that employ eye-blinking detection have been proposed. These input interfaces can detect operating intentions indicated by eye-blink actions. In this study, we propose a new blink input interface with the aim of increasing the classifiable blink types in addition to the regular voluntary blink. The proposed interface employs a sound feedback that facilitates multiple candidate selection. The feedback sound represents each input candidate and is generated while switching over time. This interface enables the user to input their operating intentions by controlling the timing of eye opening. We developed a prototype with the proposed interface and evaluated the system. The results indicated that a total classification rate of 96.5% is achieved for four types of voluntary blinks with 10 subjects. This classification rate is in accordance that of our previous report for two types of voluntary blinks. Thus, we concluded that our proposed method is reliable.

Operation of button feedback design within TV remote control applications for middle‐aged and older adult

AbstractTV remote control interfaces have gradually changed from traditional physical buttons to touch screens. However, vision, touch, and even learning abilities can become impacted with increasing age, resulting in an impaired ability to operate these interfaces and issues such as an increase in mistouches on the device and an increase in searching time. Fifty middle‐aged and older adult between the ages of 45 and 64 were recruited to investigate whether changes to the design of buttons and sound effects influence the time and error rates in interface task operations. The results showed that buttons whose background colors changed when pressed reduced task completion time, whereas buttons whose outlines thickened did not. In addition, on/off keys should be designed with reference to current remote control buttons and styled in a similar manner. Finally, sound feedback design may be added in the channel selection function to reduce operation time and error rates.

Investigation of tuning control for musical saw based on hit sound feedback motion with an industrial humanod robot

Investigation of tuning control for musical saw based on hit sound feedback motion with an industrial humanod robot

Changes in dental hygiene students' working posture following digital sound feedback.

This study aimed to observe changes in working posture by measuring the REBA (Rapid Entire Body Assessment) score of dental hygiene students according to digital sound feedback linked with a smartphone application. This study was conducted on 28 fourth-year dental hygiene students who received theoretical and practical training on dental posture in the second year and then practised on mannequins and patients for about four semesters. Periodontal instrumentation was performed freely by applying digital sound notification feedback for four weeks after baseline, 30minutes per week. REBA was measured after performing periodic structure construction without providing digital sound notification feedback for the last 1-2minutes. Follow-up was conducted the same way 2-3weeks after the intervention period. The REBA score for total, neck and trunk of all subjects showed statistically significant decreases post-intervention compared with the baseline scores (total p<.001, neck p<.001 and trunk p=.042). A digital sound feedback system was shown to be effective in encouraging correct working posture in dental hygiene students by helping them improve their REBA scores.

Effects of Different Forms of Extrinsic Feedback on the Accuracy of Force Production and to Differentiate this Force in the Simple Cyclic Movements of the Upper and Lower Limb

Abstract Background: This study aimed to assess the accuracy of force production by the limbs and to identify the ability to differentiate this force during a progressively increasing value, in response to different types of extrinsic feedback. Material and methods: The study involved nineteen healthy and physically active boys and girls aged 12.82±0.34 years, body height 157.05±9.02 cm, and body mass 44.89±7.89 kg. The tasks were to perform a series of right and left upper limb pulls and pushes with increasing force using the levers of the kinesthesiometer and a series of lower limb presses on the pedal of the kinesthesiometer. The tasks were completed in three feedback conditions: no feedback, sound feedback, verbal feedback, and the retention test was used. To assess the level of accuracy of force production, the novel index of force production accuracy (FPAIndex) was used. Results: The outcomes expressing the value of FPAIndex on the point scale indicated that the highest level of kinesthetic differentiation was observed when no feedback was provided (1.17 points), and the lowest kinesthetic differentiation was recorded when verbal feedback was provided (3.33 points). However, they were devoid of statistical value. The repeated-measures analysis of variance ANOVA with the Tukey post-hoc test (HSD) indicated a significant lowest (p=0.0402) level of accuracy of FPA (x̄ 36.12±18.29 [N]) only for the act of left lower limb press (LL PRESS) in the retention test, while no feedback was provided to the subjects. Conclusions: The results of this study showed that verbal and sound extrinsic feedback did not affect the accuracy of force production by the upper and lower limbs and the ability to differentiate this force in simple movements among children.

A Comparative Study in Real-Time Scene Sonification for Visually Impaired People.

In recent years, with the development of depth cameras and scene detection algorithms, a wide variety of electronic travel aids for visually impaired people have been proposed. However, it is still challenging to convey scene information to visually impaired people efficiently. In this paper, we propose three different auditory-based interaction methods, i.e., depth image sonification, obstacle sonification as well as path sonification, which convey raw depth images, obstacle information and path information respectively to visually impaired people. Three sonification methods are compared comprehensively through a field experiment attended by twelve visually impaired participants. The results show that the sonification of high-level scene information, such as the direction of pathway, is easier to learn and adapt, and is more suitable for point-to-point navigation. In contrast, through the sonification of low-level scene information, such as raw depth images, visually impaired people can understand the surrounding environment more comprehensively. Furthermore, there is no interaction method that is best suited for all participants in the experiment, and visually impaired individuals need a period of time to find the most suitable interaction method. Our findings highlight the features and the differences of three scene detection algorithms and the corresponding sonification methods. The results provide insights into the design of electronic travel aids, and the conclusions can also be applied in other fields, such as the sound feedback of virtual reality applications.

Biomechanical Device for Strength Control in Dental Restorations

Abstract Introduction In the dentistry field, restoration of a damaged tooth using indirect restorations is a common activity. In the restoration process with cementing agents, there is a need to apply force to the insertion of the part that will rehabilitate the tooth. This force becomes essential to cause the flow of the cementitious material, thus improving the prognosis and longevity of the restoration-tooth assembly. Excessive force can cause damage and a little intensity force will not be enough for the correct seating of the piece. However, the applied force is dependent on the sensitivity of the dentist, and there are no tools that guarantee the aid in its monitoring. Objectives The biomechanical device must be able to monitor the forces applied on teeth restoration and has its importance based in clinical environment use, but above all will be a relevant tool in the learning process for dental medicine students. Methodology The developed device is based on some commonly used dental systems for dental restorations. A geometry was created using a computer aided design software and calculated by the finite element method. The developed solution uses the structural information for force control with strain gauges. The equipment interacts with the user using incorporated sound and light signals powered by a battery, but also can be wired to a computer. Results The medical team performed some tests in ceramic teeth samples, in order to ensure the reality of the tests. The device operation reveals an easy and stable force application as well as a correct sound and light feedback. After the sample’s analysis, the cement thickness and strength are within ideal parameters. Conclusion From this work resulted the invention of a functional biomechanical equipment that will be used in student learning process and in clinical context. The device had a good acceptance and feedback by the medical team, promising to revolutionize the way dental restorations are performed.

The perils of learning to move while speaking: One-sided interference between speech and visuomotor adaptation.

Our understanding of the adaptive processes that shape sensorimotor behavior is largely derived from studying isolated movements. Studies of visuomotor adaptation, in which participants adapt cursor movements to rotations of the cursor's screen position, have led to prominent theories of motor control. In response to changes in visual feedback of movements, explicit (cognitive) and implicit (automatic) learning processes adapt movements to counter errors. However, movements rarely occur in isolation. The extent to which explicit and implicit processes drive sensorimotor adaptation when multiple movements occur simultaneously, as in the real world, remains unclear. Here we address this problem in the context of speech and hand movements. Participants spoke in-time with rapid, hand-driven cursor movements. Using real-time alterations of vowel sound feedback, and visual rotations of the cursor's screen position, we induced sensorimotor adaptation in one or both movements simultaneously. Across three experiments (n = 60, n = 48 and n = 76, respectively), we demonstrate that visuomotor adaptation is markedly impaired by simultaneous speech adaptation, and the impairment is specific to the explicit learning process in visuomotor adaptation. In contrast, visuomotor adaptation had no impact on speech adaptation. The results demonstrate that the explicit learning process in visuomotor adaptation is sensitive to movements in other motor domains. They suggest that some forms of speech adaptation may lack an explicit learning process altogether.

Quality of Feedback in Higher Education: A Review of Literature

In raising the standards for professional educators, higher educators must be prepared to provide the highest quality feedback on student performance and work products toward improved outcomes. This review of the literature examined the major findings of 70 quantitative, mixed methods, or qualitative studies found in higher education journals across a range of disciplines. Multiple recommendations and results for feedback emerged which fall into the categories described by Susan Brookhart. This review found research for each of Brookhart’s categories, with results indicating differences between the perceptions of adherence to sound feedback practices versus the reality of implementation, the potential for innovative tool use, and a disagreement about the effectiveness of peers for providing effective feedback. Indicators for quality within the research confirmed the importance of commonly accepted standards such as positivity, specificity, timeliness, and encouraging active student participation. Additionally, trends and themes indicated a need for the consistent implementation of the feedback exchange process and flexibility to account for student input/preferences. Greater consistency toward the application of these quality indicators should be undertaken when determining the quality of higher education feedback for preservice teachers prior to undertaking summative licensure assessments.

Randomised controlled trial of real-time feedback and brief coaching to reduce indoor smoking

BackgroundPrevious secondhand smoke (SHS) reduction interventions have provided only delayed feedback on reported smoking behaviour, such as coaching, or presenting results from child cotinine assays or air particle counters.DesignThis SHS...

Effectiveness of a new sensorized videolaryngoscope for retraining on neonatal intubation in simulation environment

BackgroundIn recent years, medical training has significantly increased the use of simulation for teaching and evaluation. The retraining of medical personnel in Italy is entrusted to the program of Continuous Education in Medicine, mainly based on theoretical training. The aim of this study is to assess whether the use of a new sensorized platform for the execution of the neonatal intubation procedure in simulation environment can complement theoretical retraining of experienced health professionals.MethodsNeonatal intubation tests were performed using a commercial manikin and a modified video-laryngoscope by the addition of force and position sensors, which provide the user with feedback when the threshold is exceeded. Two categories carried out the simulation tests: anesthesiologists and pediatricians. The categories were divided into three groups each, and various configurations were tested: the first group of both specialists carried out the tests without feedback (i.e. control groups, gr. A and A1), the second groups received sound and visual feedback from the instrument (gr. B and B1) and the third ones had also the support of a physician expert in the use of the instrument (gr. C and C1). The instrumentation used by pediatricians was provided in a playful form, including a game with increasing difficulty levels.ResultsBoth in the case with feedback only and in the case with humans support, anesthesiologists did not show a specific trend of improvement. Pediatricians, in comparison with anesthesiologists, showed a positive reaction to both the presence of feedback and that of experienced personnel. Comparing the performance of the two control groups, the two categories of experienced doctors perform similar forces. Pediatricians enjoyed the “Level Game”, through which they were able to test and confront themselves, trying to improve their own performance.ConclusionsOur instrument is more effective when is playful and competitive, introducing something more than just a sound feedback, and allowing training by increasing levels. It is more effective if the users can adapt their own technique to the instrument by themselves, without any external help.