Smartphone Display Research Articles

Knowledge-based, computerized, patient clinical decision support system for perioperative pain, nausea and constipation management: a clinical feasibility study

Opioid administration is particularly challenging in the perioperative period. Computerized-based Clinical Decision Support Systems (CDSS) are a promising innovation that might improve perioperative pain control. We report the development and feasibility validation of a knowledge-based CDSS aiming at optimizing the management of perioperative pain, postoperative nausea and vomiting (PONV), and laxative medications. This novel CDSS uses patient adaptive testing through a smartphone display, literature-based rules, and individual medical prescriptions to produce direct medical advice for the patient user. Our objective was to test the feasibility of the clinical use of our CDSS in the perioperative setting. This was a prospective single arm, single center, cohort study conducted in Strasbourg University Hospital. The primary outcome was the agreement between the recommendation provided by the experimental device and the recommendation provided by study personnel who interpreted the same care algorithm (control). Thirty-seven patients were included in the study of which 30 (81%) used the experimental device. Agreement between these two care recommendations (computer driven vs. clinician driven) was observed in 51 out 54 uses of the device (94.2% [95% CI 85.9–98.4%]). The agreement level had a probability of 86.6% to exceed the 90% clinically relevant agreement threshold. The knowledge-based, patient CDSS we developed was feasible at providing recommendations for the treatment of pain, PONV and constipation in a perioperative clinical setting.Trial registration number & date The study protocol was registered in ClinicalTrial.gov before enrollment began (NCT05707247 on January 26th, 2023).

Initial Design of IoT-Based Earthquake Intensitymeter Using MMI Scale with Smartphone Display

This paper discusses the initial design of an earthquake intensitymeter measuring instrument using the IoT-based MMI scale. This research is motivated by the lack of instrumentation technology applied to the community for earthquake mitigation, which is related to the geographical location of Indonesia in earthquake-prone areas. The existing earthquake intensitymeter instrument still has shortcomings in terms of hardware and data acquisition. So this paper tries to provide a solution to the problem by using an MPU6050 accelerometer sensor that can measure PGA values simultaneously on three axes. This system is also equipped with an IoT-based intensitymeter for data acquisition that can be accessed via smartphone. In this system, the MPU6050 sensor is tested for characteristics first using the UC Berkeley Seismological Myshake application, and the average linearity test data obtained is 0.994. The data acquisition system is webserver-based so that every bit of data read every second will be sent to the webserver. The webserver is also equipped with a real-time measurement graph, and every smartphone device can access the data using the IP address of the webserver.

A Comparative Study of the Sensitivity and Specificity of the Ishihara Test With Various Displays

Visual colour differentiation in clinical research requires colour-competent (CC) participants. The Ishihara colour charts (ICC) have established themselves as the standard for CC screening of colour vision deficiencies (CVD). However, the extent to which the results can be compared with a presentation of the colour charts on a smartphone display (SD) is currently unknown. The aim of this in vitro study was to determine the sensitivity and specificity of the Ishihara colour deficiency test depending on the presentation mode. Dental students (female n = 28; male n = 10; mean age, 23.5 ± 2.65 years; median age, 23.0 ± 13.0 years) evaluated 25 Ishihara test plates on their SD (n = 38) and/or a calibrated monitor (HP monitor, 22-inch; n = 18). The median size of the SD was 6.0 inches. Datasets with more than 2 failed charts were scored. When the Ishihara test charts were presented on a PC screen, the sensitivity was 94.4% and the specificity was 82.4% (0 mistakes: n = 14, <3 failures: n = 3, 14 false answers: n = 1). On the SD, a sensitivity of 96.0% and a specificity of 94.7% were calculated (89.5% were correct; 4 participants [10.5%] made <3 errors; and 1 participant made 21 errors). No significant difference between display modi (PC vs SD) was evaluated (P > .05). The presentation of ICC on an SD is useful and can be used for the investigation of a possible CVD of large groups. Comparable results to data projection can be achieved with a high degree of certainty. For CVD screening of larger groups (eg, students in preclinical training as part of CC training), the presentation of ICC on the SD can be used. This research was able to demonstrate that the sensitivity and specificity of the usual presentation method (Ishihara's booklet or data projection) is comparable.

A smartphone-controllable molecular diagnostic platform for SARS-CoV-2 detection by reverse-transcription recombinase polymerase amplification

We constructed a portable molecular diagnostic microsystem, enabling the whole processes of genetic analysis for SARS-CoV-2. The proposed platform was a miniaturized size and was comprised of three main parts: a microfluidic device with a 3D-printed solution loading cartridge, an operating system including a tailor-made heater board, a syringe pump and an optical fluorescence detector, and a smartphone with a customized app for the remote and automatic control. The microfluidic device was designed to control the complicated fluidic flow through only the passive valves, and could perform the RNA extraction from the viral lysate via glass membranes and the target gene amplification by reverse-transcription recombinase polymerase amplification (RT-RPA). The 3D-printed cartridge allowed the facile chemical solution storage and loaded a designated solution into the microfluidic device. A smartphone with a browser-based app could control the on-and-off status of solenoid valves, the workflow of a syringe pump to automatically introduce solutions on a chip, the heater board to supply the constant temperature for RT-RPA, and the periodic activation of the Pi camera and a 488 nm laser to measure the fluorescence signal in the reaction chambers that showed the amplification profiles on the smartphone display in real-time. Using the proposed smartphone-controllable diagnostic platform, the N gene and S gene of SARS-CoV-2 were successfully detected at a limit-of-detection (LOD) of 10 copies/μL within 1 hr in a sample-to-answer-out format. Ten out of 22 clinical samples were successfully analyzed for SARS-CoV-2, demonstrating the practical applications for the on-site diagnostics of patient samples.

Smartphone application with 3D-printed needle guide for faster and more accurate CT-guided interventions in a phantom.

This study is to determine whether a needle guidance device combining a 3D-printed component with a smartphone would decrease the number of passes and time required to perform a standard CT-guided needle procedure in a phantom study. A 3D-printed mechanical guide with built-in apertures for various needle sizes was designed and printed. It was mounted on a smartphone and used to direct commercially available spring-loaded biopsy devices. A smartphone software application was developed to use the phone's sensors to provide the real-time location of a lesion in space, based on parameters derived from preprocedural CT images. The physical linkage of the guide, smartphone, and needle allowed the operator to manipulate the assembly as a single unit, with real-time graphical representation of the lesion shown on the smartphone display. Two radiology trainees and 3 staff radiologists targeted 5 lesions with and without the device (50 total procedures). The number of passes and time taken to reach each lesion were determined. Use of the smartphone needle guide decreased the mean number of passes (with guide, 1.8; without guide, 3.4; P < 0.001) and mean time taken (with guide, 1.6 min; without guide, 2.7 min; P = 0.005) to perform a standard CT-guided procedure. On average, the decreases in number of passes and procedure time were more pronounced among trainees (P < 0.001). The combination of a mechanical guide and smartphone can reduce the number of needle passes and the amount of time needed to reach a lesion in a phantom for both trainees and experienced radiologists.

Rural Geosystems’ Future in the Smartphone World: The Inception of Romanian Tourist Sites

The present study aims to analyze the role of the advancement of smartphones in rural communities’ redefinition and future development opportunities. This paper explores how smartphone applications are transforming our cultural worlds as they are materially constituted in dynamic living Geosystems and virtually illustrated through collective stereotypical images. This research was carried out in Romania using Geomedia methodology, Google Earth datasets and unstructured interviews in order to assess the specific characteristics of analyzed locations and examine the impacts of technology’s evolution on rural communities. The results are as follows. Firstly, modern smartphone applications are providing the possibility for any rural Geosystem to sustainably adjust to modern technology, conserving its cultural values in the human–computer interaction. Secondly, many remote communities want to learn how to be found by worldly tourists within the touch of a smartphone display, and how to transform their traditional households in exquisite accommodations and share the daily life experiences for their families’ livelihood and communal wellbeing enhancement. Thirdly, there is an important tourism expertise deficiency and a considerable need for the valorization of local tourism potential in rural Romanian communities.

인공지능과 증강현실 기술을이용한 모래성 놀이 가이드 애플리케이션설계 및 구현

With the popularity and the advanced graphics hardware technology of mobile devices, various mobile applications that help children with physical activities have been studied. This paper presents SandUp, a mobile application that guides the play of building sand castles using artificial intelligence and augmented reality(AR) technology. In the process of building the sandcastle, children can interactively explore the target virtual sandcastle through the smartphone display using AR technology. In addition, to help children complete the sandcastle, SandUp informs the sand shape and task required step by step and provides visual and auditory feedback while recognizing progress in real-time using the phone’s camera and deep learning classification. We prototyped our SandUp app using Flutter and TensorFlow Lite. To evaluate the usability and effectiveness of the proposed SandUp, we conducted a questionnaire survey on 50 adults and a user study on 20 children aged 4~7 years. The survey results showed that SandUp effectively helps build the sandcastle with proper interactive guidance. Based on the results from the user study on children and feedback from their parents, we also derived usability issues that can be further improved and suggested future research directions.

A Low-Latency Streaming On-Device Automatic Speech Recognition System Using a CNN Acoustic Model on FPGA and a Language Model on Smartphone

This paper presents a low-latency streaming on-device automatic speech recognition system for inference. It consists of a hardware acoustic model implemented in a field-programmable gate array, coupled with a software language model running on a smartphone. The smartphone works as the master of the automatic speech recognition system and runs a three-gram language model on the acoustic model output to increase accuracy. The smartphone calculates and sends the Mel-spectrogram of an audio stream with 80 ms unit input from the built-in microphone of the smartphone to the field-programmable gate array every 80 ms. After ~35 ms, the field-programmable gate array sends the calculated word-piece probability to the smartphone, which runs the language model and generates the text output on the smartphone display. The worst-case latency from the audio-stream start time to the text output time was measured as 125.5 ms. The real-time factor is 0.57. The hardware acoustic model is derived from a time-depth-separable convolutional neural network model by reducing the number of weights from 115 M to 9.3 M to decrease the number of multiply-and-accumulate operations by two orders of magnitude. Additionally, the unit input length is reduced from 1000 ms to 80 ms, and to minimize the latency, no future data are used. The hardware acoustic model uses an instruction-based architecture that supports any sequence of convolutional neural network, residual network, layer normalization, and rectified linear unit operations. For the LibriSpeech test-clean dataset, the word error rate of the hardware acoustic model was 13.2% and for the language model, it was 9.1%. These numbers were degraded by 3.4% and 3.2% from the original convolutional neural network software model due to the reduced number of weights and the lowering of the floating-point precision from 32 to 16 bit. The automatic speech recognition system has been demonstrated successfully in real application scenarios.

Automated Redox Monitoring System (ARMS): An Instrument for Measuring Dissolved Oxygen Levels Using a Potential Redox Sensor (ORP) in a Prototype of Shrimp Farming Pond with an Internet-Based Monitoring System

A data acquisition system for measuring and storing dissolved oxygen levels has been implemented to monitor water quality levels in shrimp culture media using an internet-based potential redox sensor (ORP). The purpose of this study is to apply ARMS, an instrument for monitoring internet-based potential redox data (dissolved oxygen levels) in shrimp culture media in real-time to determine the condition of water quality. This system is designed using an ORP sensor that uses WIFI communication. In principle, when the ORP sensor is placed in the water in the shrimp culture media, the potential redox data will be detected by the sensor connected to the ESP8266 which processes and transmits data which is then displayed and analyzed on the smartphone interface. In this study, 9 units of shrimp culture media prototype ponds were used for observational tests. The object of observation in the pond is water quality data in the form of sediment potential redox values. At this stage of research, two processes of observation of data collection were conducted. The first process is to monitor water quality conditions on the user's smartphone display, in the form of the potential redox value of each pool measured by the ARMS instrument for 12 weeks. The second process is to compare the potential redox observation data measured by the ARMS instrument and the ORP Meter in each pool. Observation of comparative data took place during the 6th week. The sediment potential redox values for treatments 1, 2, and 3 were 69 mV, 151 mV, and 210 mV respectively. The average redox potentials in the water are in the range of 90.56 mV to -263 mV for treatment 1; 90.75 mV to -62,934 mV for treatment 2; 90.65 mV to 60.73 mV for treatment 3. This range is the measurement range from week 0 (shrimp seed stocking) to week 4. The results of the comparison of the two tools show that the accuracy of the ARMS tool is more than 95%.

Considering chromatic adaptation in camera white balance

Chromatic adaptation is an important mechanism in the human visual system. It helps to maintain the color appearance of illuminated objects relatively constant by automatically removing the color cast of the illumination. White balance, an important step in camera ISP pipeline, is designed to simulate the chromatic adaptation mechanism by automatically or manually specifying the white point of a captured scene. Conventional white balance algorithms simply adjust the color appearance of the captured scene to how it would appear under daylight, regardless of the illumination of the scene. Recent studies, however, clearly suggested that incomplete chromatic adaptation happened under some illumination conditions, which should be considered in white balance. In this study, we systematically varied the chromaticities of the illumination in a viewing booth, and also the chromaticities of the illumination in two viewing booths. The observers viewed the viewing booth(s) first and then adjusted the color appearance of the image of the booth(s) shown on a smartphone display by adjusting the image white point. The results clearly suggested the necessity to consider the degree of chromatic adaptation in camera white balance and provided guidance on how white balance should be performed.

Smartphone display size can influence perceptual judgments

Classic research in perception has suggested that visual context can impact how individuals perceive object characteristics like physical size. The current set of studies extends this work to an applied setting by examining whether smartphone display size can impact the perception of objects presented on smartphones. Participants viewed several target items, on two different sized virtual device displays based on actual consumer devices and were asked to make simple judgments of the size of presented objects. Results from both experiments confirm that display size impacts perceived size, such that larger displays cause users to significantly underestimate the size of objects moreso than smaller displays. This is the first study to confirm such an effect, and suggests that beyond aesthetics or cost, one’s personal choice of device might have additional performance consequences.

Understanding the role of visuals in commercial website interaction on smartphone display

Flexible and ease of internet access through mobile device in Indonesia has changed the way users interact with commercial websites, especially online ticketing service website. Yet, no study on how the presented website visuals on smartphone display perceived and experienced by users is found. This paper exposes users’ interactive experience on smartphone display, showcasing 3 (three) popular online ticketing service providers in Indonesia, traveloka dot com, pegi-pegi dot com, and tiket dot com. 60 individuals were purposively sampled and each was asked to access all chosen websites using provided smartphone. 2 (two) pages follow-up questionnaire was presented to each respondent: first page is for identifying users’ perception 5 (five) items likert-scale responses and second page is for identifying users’ experiences using Schrepp, Hinderks &amp; Thomaschewski’s UXQ (User Experience Questionnaire). Results show that when interacting with online ticketing service websites on smartphone, sites that look simple and easy to interact with may provide sense of savvyness, comfortability, and security. This indicates that presented website visuals on smartphone display affect users’ experience when using online services. Although further studies are needed, this results offer valuable insights to the discussions of human interactive experience in using online platform.

Smartphone display size can cause distortions in perceptual estimates of size

Everyday we consume massive amounts of visual information on mobile devices like smartphones. However, are there consequences for viewing information on these devices? In 2 experiments, participants viewed several target objects on two differently sized virtual smartphone displays, and then made a judgment of the size of each target item. Results from both experiments confirm that smartphone display size does impact user perceptions of size, such that larger displays cause users to significantly underestimate the size of objects. This effect held when target items were presented alone, or concurrently with a non-target referent. This is the first study to confirm such an effect and suggests that the size of a smartphone display can negatively influence the accuracy of users’ visual perception. Thus, beyond aesthetics or cost, it must be realized that the choice of device might have additional perceptual consequences for consumers.

Augmenting Around-Device Interaction by Geomagnetic Field Built-in Sensor Utilization.

In this paper, we investigate the possibilities for augmenting interaction around the mobile device, with the aim of enabling input techniques that do not rely on typical touch-based gestures. The presented research focuses on utilizing a built-in magnetic field sensor, whose readouts are intentionally affected by moving a strong permanent magnet around a smartphone device. Different approaches for supporting magnet-based Around-Device Interaction are applied, including magnetic field fingerprinting, curve-fitting modeling, and machine learning. We implemented the corresponding proof-of-concept applications that incorporate magnet-based interaction. Namely, text entry is achieved by discrete positioning of the magnet within a keyboard mockup, and free-move pointing is enabled by monitoring the magnet’s continuous movement in real-time. The related solutions successfully expand both the interaction language and the interaction space in front of the device without altering its hardware or involving sophisticated peripherals. A controlled experiment was conducted to evaluate the provided text entry method initially. The obtained results were promising (text entry speed of nine words per minute) and served as a motivation for implementing new interaction modalities. The use of neural networks has shown to be a better approach than curve fitting to support free-move pointing. We demonstrate how neural networks with a very small number of input parameters can be used to provide highly usable pointing with an acceptable level of error (mean absolute error of 3 mm for pointer position on the smartphone display).

Preservice Chemistry Teacher Perception toward Contextual Learning Implementation of OLEDs in Organic Chemistry Learning

This study aimed to explore chemistry pre-service teacher view toward implementation of contextual learning in Organic Chemistry. The context that was investigated about is Organic Light Emitting Diodes (OLEDs), which was a novel display technology that is being used for smartphone display. Seventeen pre-service chemistry teachers were interviewed about their knowledge about organic chemistry, conjugated double bond, OLEDs and their view about implementing OLEDs context in organic chemistry learning. Three groups of questions were asked to the pre-service chemistry teacher, most of them indicating lack knowledge about detail information of OLEDs even though they really appreciate if OLEDs was introduced in Organic Chemistry learning especially in conjugated double bond and nature-generated organic compound topics.

Designing Smartphone Displays with a Focus on the Line Thickness of Figures and Pictograms

参加型連携ミュージアム支援システムは二ヶ国語の展示解説を提供しており，ナビゲーションは主に文字が使用されている．より操作しやすくなるように，ナビゲーション用ピクトグラムを使用する．第1の目的として，ピクトグラムの「図」の対象物を明らかにした．第2の目的として，スマートフォン上におけるピクトグラムの視認性と理解度が高くなる「線の太さ」を明らかにした．第3の目的として，実証実験を行い，被験者の84.8%がピクトグラムを見やすいと回答し，その有効性が実証された．第4の目的として，ピクトグラムと文字を併記し，どちらが分かりやすいかどうか検証し，ピクトグラムが概ね支持されたことが明らかになった．さらに追加実験を行い，システムを継続して使用することで，ピクトグラムやシステムの評価が向上し，操作時間の短縮効果が期待された．

CORONAVIRUS COVID-19 ROILS DISPLAY SUPPLY CHAIN.

CORONAVIRUS COVID-19 ROILS DISPLAY SUPPLY CHAIN.

Failure analysis on cracking of blind and buried vias of printed circuit board for high-end mobile phones

Purpose The submitted paper is mainly concerned with the cracking of blind and buried vias of printed circuit board (PCB) for smartphones which were encountered with abnormal display problems like scramble display or no display during service and had to be recalled. Design/methodology/approach To found out the root causes of this failure and dissolve this commercial dispute, comprehensive failure analysis was performed on the printed circuit board assemblies (PCBAs) and PCBs of the failed smartphone, such as macrograph and micrograph observation, chemical compositions analysis, thermal performance testing and blind via pull-off experiment, which finally helped to determine the causes. Besides that, the failure mechanisms were discussed in detail, and pertinent countermeasures were proposed point by point. Findings It was found that the PCB blind vias cracking was the main reason for the scramble display or no display of the smartphone, and the incomplete cleaning process before copper plating was the root cause of the blind vias cracking. Practical implications Achievement of this paper would not only help to provide the solid evidence for determining the responsibility of this commercial dispute but also lead to a better understanding of the failure mechanisms and prevention methods for similar failure cases of other advanced mobile phones. Originality/value Most failure analysis researches of PCBAs only focused on the unqualified products from manufacturing, while this paper addressed a failure analysis case of PCBAs products for smartphones from actual services, which was relatively rarely reported in the past.

Thermochemical Modelling and Experimental Validation of In Situ Indium Volatilization by Released Halides during Pyrolysis of Smartphone Displays

The present study focuses on the pyrolysis of discarded smartphone displays in order to investigate if a halogenation and volatilization of indium is possible without a supplementary halogenation agent. After the conduction of several pyrolysis experiments it was found that the indium evaporation is highly temperature-dependent. At temperatures of 750 °C or higher the indium concentration in the pyrolysis residue was pushed below the detection limit of 20 ppm, which proved that a complete indium volatilization by using only the halides originating from the plastic fraction of the displays is possible. A continuous analysis of the pyrolysis gas via FTIR showed that the amounts of HBr, HCl and CO increase strongly at elevated temperatures. The subsequent thermodynamic consideration by means of FactSage confirmed the synergetic effect of CO on the halogenation of indium oxide. Furthermore, HBr is predicted to be a stronger halogenation agent compared to HCl.

Smartphone camera-based device-to-device communication using neural network-assisted high-density modulation

Device-to-device (D2D) communication has become one of the focuses for future wireless communications in conjunction with rapidly growing smartphone technologies. Smartphone camera-based D2D communication is presented as a favorable solution to supporting indoor D2D communications. As a smartphone has both camera and display, two smartphones can communicate over a relatively short range distance indoors in the form of smartphone display (transmitter) and smartphone camera (receiver) link. The smartphone camera-based wireless communication called optical camera communication (OCC), however, suffers from low data rate that is at most a hundred kilobits per second. To ameliorate this, we propose a high-density modulation that is more efficient in achieving an Mbps rate for smartphone camera-based D2D systems, by exploiting two-dimensional data transmission capability in OCC. Neural network is also implemented to improve the performance of the proposed system. To verify the proposed system, simulations and experiments were performed. It is demonstrated that a 2.66 Mbps rate of the proposed system is achieved with an acceptable bit error rate.