Interactive Touch Screen Research Articles

Situating data stories in space to entice new audiences to engage with science

ABSTRACT Science communication predominantly engages individuals who already possess a pre-existing interest in science, thereby limiting its reach to a broader and more diverse audience. Situated approaches that intertwine content with spatial design may overcome interest barriers as it allows for spontaneous encounters with science. This paper describes the design of a multi-modal physicalisation coined Star Listener as the result of a collaboration between scientific experts (in astrophysics), design researchers and media professionals. Star Listener consists of different sensory engagement modalities, including textual information panels, speakers that distribute sonified data of stars, two public video displays with an animated explainer and interactive touchscreens with a mini-game. Star Listener was placed in an entryway of a public library for a period of 2 months. We evaluated this set-up by observing and interviewing passersby, both in an in-the-wild study and as a controlled in-the-wild study. We present design recommendations for the design of situated data representations and narrative physicalisations to support engagement of varied audiences with science.

Effects of Playing an Interactive Educational App on Children's Learning and Executive Function

AbstractChildren are increasingly using educational apps, but little research has been conducted to determine their effectiveness. The current study compared the effect of an interactive touchscreen app to the effect of a noninteractive video about the app on young children's Chinese characters learning and executive functions (EFs). In a mixed between‐within design, 50 children aged 5 to 6 years old were randomly assigned to play the app on touchscreen or to watch a noninteractive video about the app. Results showed that children in the app condition made more progress from the pretest to the posttest in Chinese characters learning, and more improvement in working memory scores and inhibitory capacity scores compared to the video condition. Results suggest that interactive literacy apps on touchscreens benefit children's learning and EFs. Future research should continue to focus on the impact of different forms of touchscreen use on children's executive functioning.

Enhanced sensitivity in acute myocardial infarction diagnosis through optimized multiplex biomarker detection on a paper-based microfluidic platform with individual control capabilities

Acute myocardial infarction (AMI) is a severe condition with high mortality, requiring timely diagnosis, especially in low-resource settings where centralized testing is unavailable. Leveraging our previously developed, reliable, highly integrated on-chip rotary valving system on the microfluidic paper-based analytical device (µPAD), we propose a novel multiplex paper-based microfluidics immunoassay platform for the onsite detection of key cardiac biomarkers—Myoglobin (Myo), cardiac troponin I (cTnI), and creatine kinase-MB (CKMB)—in artificial serum. It enhances assay performance through individually controlled assay conditions, facilitating rapid AMI diagnosis. Compared to existing paper-based multiplex microfluidic ELISA systems, our µPAD uniquely enables the assay of each biomarker under separate, optimally controlled incubation conditions within a single test through the valving system, which leads to optimized signal-to-noise ratio (SNR) performance and introduces more flexibility in multiplex testing. The valving system in the µPAD is driven by a single servo motor, which is controlled via a microcontroller and an interactive touchscreen. These components are integrated into a highly programmable, easy-to-assemble platform that offers fast, low-cost, and user-friendly operation. Utilizing our platform, autonomous ELISA assays were performed on Myo, cTnI, and CKMB for calibration, achieving limits of detection (LOD) of 1.43 ng/mL for Myo, 0.2 ng/mL for cTnI, and 0.735 ng/mL for CKMB. Subsequent spike-and-recovery experiments also confirmed the platform's accuracy and precision in obtaining the test results within 30 minutes and 20 μL serum sample. These results highlight the platform's transformative potential for clinical AMI diagnosis and commercialization, providing a cost-effective and accessible solution for point-of-care testing in diverse settings.

Methods for Adaptive Transformation of Content in Hypertext Format on Corporate TV and Information Kiosks of Educational Institutions

Purpose of the study: to consider and implement in practice a system for displaying content on screens of different resolutions and orientations in relation to an educational institution, using both a pure Smart TV (built-in browser of modern TV) and a player connected to Digital Signage screens. In system engineering, the main emphasis (and, as a result, the key task) is on the absence of duplication of content for different types of output screens (including interactive touchscreen kiosks), which is especially important because the implemented system will be built on free, open-source technologies and integrated into the current university website, which no other proprietary Digital Signage software system can offer.Materials and methods: the study uses different methods of transformation and output of content, but adaptation methods based on cascading style sheets (CSS) are mainly used. The experience of foreign programmers working with adaptive layouts for the web and operating their own blogs was studied (in the “Reference” section). Compromise methods for displaying graphic images and video materials are considered and proposed based on the experience gained during testing of the prototype system.Results: development of a system for displaying content on multi-format screens, requiring minimal subsequent support and intervention from the administrator responsible for filling it with content. An analysis of some potential solutions and their compatibility was carried out, taking into account browser support for CSS3 and HTML5 standards, and working solutions were selected that can be used in the design of individual templates for displaying content in hypertext format and CSS designs (rules) that work for the purpose of the study. The article compares approaches to designing adaptive templates for displaying web content in HTML (hypertext) format. The basic principles are considered under which content intended primarily for a university website can, without a third-party administrator (and also, in some cases, with minimal intervention) be displayed on corporate TV and touchscreen kiosks of universities thanks to the use of cascading style sheets (CSS) and relative units of measurement (vh, vw, vmin, vmax) and tags introduced in HTML5. The article also discusses how to level out the nuances associated with different resolutions of graphic images and screen orientation.Conclusion: the final paragraphs of the article conclude on the nuances of the functioning of the developed system, the effectiveness of which directly depends on methods of implementation and technologies used, chosen and discussed in the article. The implementation of the system will increase the awareness of students of an educational institution about events (announced or conducted), and will allow the system administrator to increase work efficiency by publishing and administering content only in “one window” (for example, on the university website), and the developed output template and/or CSS rules will display it on the internal screens, maintaining readability and perception of information. The developed and tested methods can be used by programmers, working in educational institutions.

INTERACTIVE EDUCATION ON SUSTAINABLE USE OF ELECTRICAL DEVICES

Education in GREEN electrical energy and production usage is essential for young people. Every consumer can do a lot if they use electrical devices wisely. This paper will present the design, intention and use of a didactical learning exhibit for middle and high school students during technical days on faculty and faculty promotions and for educational purposes. Our main goal is to introduce students to how some everyday electrical devices work, how much energy they use and how they can save as users. The most significant emphasis will be electromagnetic devices such as elevators and devices we use daily. We will use a professional approach and design for that purpose, but we will focus on presenting it on an interactive touchscreen and small examples of those devices. The content will be in graded expertise levels, from simple picture and animation calculations to the advanced picture and mathematical model presentations. The exhibit will be designed modularly so that content or presentation can change quickly and be made from recycled or sustainable materials as much as possible. KEYWORDS:Sustainable; Educational; Electricity; Electromagnetic devices; Interactive; Elevator; Exhibit

The impact of interactive touchscreen images on the well-being of schoolchildren in the context of inclusive education

The impact of interactive touchscreen images on the well-being of schoolchildren in the context of inclusive education

Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment.

We present a visual analytics approach for multi-level visual exploration of users' interaction strategies in an interactive digital environment. The use of interactive touchscreen exhibits in informal learning environments, such as museums and science centers, often incorporate frameworks that classify learning processes, such as Bloom's taxonomy, to achieve better user engagement and knowledge transfer. To analyze user behavior within these digital environments, interaction logs are recorded to capture diverse exploration strategies. However, analysis of such logs is challenging, especially in terms of coupling interactions and cognitive learning processes, and existing work within learning and educational contexts remains limited. To address these gaps, we develop a visual analytics approach for analyzing interaction logs that supports exploration at the individual user level and multi-user comparison. The approach utilizes algorithmic methods to identify similarities in users' interactions and reveal their exploration strategies. We motivate and illustrate our approach through an application scenario, using event sequences derived from interaction log data in an experimental study conducted with science center visitors from diverse backgrounds and demographics. The study involves 14 users completing tasks of increasing complexity, designed to stimulate different levels of cognitive learning processes. We implement our approach in an interactive visual analytics prototype system, named VISID, and together with domain experts, discover a set of task-solving exploration strategies, such as "cascading" and "nested-loop', which reflect different levels of learning processes from Bloom's taxonomy. Finally, we discuss the generalizability and scalability of the presented system and the need for further research with data acquired in the wild.

Correlational study on novelty factor, immersive tendencies, purchase intention and memory in immersive VR e-commerce applications

E-commerce is a field that changed how consumers purchase and interact with products. Although, inherent limitations such as the difficulty of testing the products “first-hand” before a purchase can compromise consumers’ trust in online purchases. Virtual Reality (VR) has been investigated as a tool to solve limitations in several fields and how we can harness its potential to improve the overall user experience. This study analysed how immersive VR (IVR) could solve these limitations by allowing consumers to test products beforehand. We have studied how the Novelty Factor (evaluated by the users’ past VR experience) and Immersive Tendencies correlate with the users’ Purchase Intention and Memory (how well they remember the product’s characteristics). We have analysed a sample of 38 participants (21 males) from 18 to 28 years old. Participants experienced a refrigerator with an interactive touchscreen in an IVR setup and were guided through its functionalities. Results indicated that memory of the product’s characteristics was positively correlated with how recently they experienced VR. No correlations were found in the female sample. A negative correlation between Purchase Intention and Memory of the product’s characteristics was found in the male sample. We concluded that IVR applications could become helpful for both consumers and online shops in an e-commerce context regardless of the Novelty Factor and Immersive Tendencies of consumers. However, differences between genders should be further investigated.

Large Interactive Touchscreens as an Opportunity for Synchronous Hybrid Teaching during the COVID-19 Pandemic and Beyond.

The year 2020 will be remembered as the year of COVID-19 and its subsequent lockdowns. The time to return to face-to-face teaching has arrived, but the shadow of the disease still hangs over teachers, students, and society. Disruption in teaching can still occur for students, or even teachers, if they are either diagnosed as COVID-19 positive or as a contact case and forced to self-isolate. In order to limit the impact of self-isolation on learning, synchronous hybrid teaching (i.e., teaching face to face to students in a classroom and to students online at the same time) was successfully implemented owing to the combination of video conference software and a large interactive touchscreen. The setup presented in this paper allows courses to be broadcast to students at home (i.e., voice, visual pedagogic support, and, more interestingly, indications handwritten by the teacher) as well as simultaneously teaching to students in the classroom face-to-face. It also allows self-isolated teachers to teach tutorials from their home to students in the classroom. This paper focuses on the use of large interactive touchscreens for synchronous hybrid teaching and its evaluation by students using a questionnaire. The key findings of this study are that students prefer synchronous hybrid teaching rather than missing a course and that synchronous hybrid teaching should only be used in case of absolute necessity.

Patterns of Touch Screen Technology Use in Religious Tourism and Pilgrimage

The purpose of this study is to examine the effective use of interactive touchscreen technology by pilgrims and the Umrah performers during the Hajj and Umrah rituals. The study relied on a media survey methodology. A questionnaire was used as a tool to collect data. A total of 400 pilgrims and Umrah performers participated in the study. The study drew from the uses and gratifications approach. Results indicated that the bulk of pilgrims and the Umrah performers are active and heavy users on using the interactive touchscreen technology. Moreover, the findings confirmed that there is a strong correlation between the intensity of usage of touchscreen technology by pilgrims as well as Umrah performers and their demographic variables. More importantly, the findings revealed that touchscreen usage increased the spread of awareness, guidance, and information among pilgrims and Umrah performers about the Hajj and Umrah rituals.

Teaching Preschoolers Theory of Mind Skills With Mobile Games

This single-case research study examined whether interactive touch screen apps enriched with Theory of Mind (ToM)—enhancing language would promote ToM skills in preschoolers. Six typically developing girls between the ages of 46- and 52- months participated in multiple sessions across the three phases of the study: In baseline, participants played games without voice-overs; in the original treatment phase, participants played games with embedded voice-overs; finally, in the modified treatment phase, participants first played games with embedded voice-overs, then engaged in the researcher-led conversation. All sessions across the three phases concluded with ToM assessments: two measures based on a continuous scale. The first measure included three tasks targeting earlier-developing ToM skills (diverse desires, diverse beliefs, and knowledge access), and the other measure had two tasks that assessed a later-developing ToM competency, false belief understanding. Results showed that apps with ToM-embedded language improved children’s earlier-developing ToM skills (i.e., understanding that people can have different desires, beliefs, and knowledge access) in the phase where an adult-led conversation also followed voice-over-enriched app play. Apps with ToM-embedded language without a follow-up discussion were only marginally effective in promoting the earlier-emerging ToM skills. Across the conditions, apps were not effective in promoting children’s later-developing ToM skills—false belief understanding. Our findings indicate that incorporating ToM conducive language in mobile apps can promote ToM development in preschoolers, especially when supplemented by an adult-led conversation.

Investigating Cross-Modal Approaches for Evaluating Error Acceptability of a Recognition-Based Input Technique

Emerging input techniques that rely on sensing and recognition can misinterpret a user's intention, resulting in errors and, potentially, a negative user experience. To enhance the development of such input techniques, it is valuable to understand implications of these errors, but they can very costly to simulate. Through two controlled experiments, this work explores various low-cost methods for evaluating error acceptability of freehand mid-air gestural input in virtual reality. Using a gesture-driven game and a drawing application, the first experiment elicited error characteristics through text descriptions, video demonstrations, and a touchscreen-based interactive simulation. The results revealed that video effectively conveyed the dynamics of errors, whereas the interactive modalities effectively reproduced the user experience of effort and frustration. The second experiment contrasts the interactive touchscreen simulation with the target modality - a full VR simulation - and highlights the relative costs and benefits for assessment in an alternative, but still interactive, modality. These findings introduce a spectrum of low-cost methods for evaluating recognition-based errors in VR and a series of characteristics that can be understood in each.

Development of the supply system, control algorithm and architecture of verbal robot

This work is supported by grant from the Ministry of Education and Science of the Republic of Kazakhstan within the framework of the Work №AP08053034 «Development of new methods for modeling and recognition of Kazakh sign language», Institute Information and Computational Technologies CS MES RK. This article reviews the supply system, control algorithm and architecture of verbal robot. The robot is based on publicly available 3D printer. In this research was developed architecture of general programme system of verbal robot, also improved supply system and control algorithm of overall system. Using Jetson Tx1 equipment and a touch screen for interaction with InMoov, an interface was made to control the entire system. The Kinect detector plays a major role in the process of studying this topic. Compared with the existing humanoid robots, the verbal robot is highly automated platform, low cost and fully functional.

An Individual Cognitive Stimulation Therapy App for People with Dementia and Carers: Results from a Feasibility Randomized Controlled Trial (RCT).

BackgroundThere is a lack of digital resources that support the cognition and quality of life (QoL) of people with dementia. The individual cognitive stimulation therapy application (iCST app) aims to provide cognitive stimulation and social interaction to people with dementia and carers through interactive touch-screen technology. This study set out to determine the feasibility of conducting a full-scale, randomized controlled trial (RCT) with the iCST app.MethodsThis was a single blind, feasibility RCT including people with mild to moderate dementia and their carers. Multiple trial components were assessed including recruitment and retention rates, intervention fidelity and usability, and acceptability of the outcome assessments which included measures of cognition and QoL. A sample of the intervention group was invited to a semi-structured post-trial interview to examine the experience of using the iCST app.ResultsSixty-one dyads were randomised to the iCST app (n = 31) or treatment-as-usual (TAU) control group (n = 30) for 11 weeks. In the iCST app group, 77% used the intervention for 20 minutes or more each week. Carers using the iCST app rated their QoL better at follow-up 2 compared to the TAU control group (EQ-5D, MD = 7.69, 95% CI = 2.32–13.06, p = 0.006). No significant differences were found on the other outcome measures.ConclusionThe iCST app was deemed usable and enjoyable. Most participants completed the activities more quickly than anticipated and did not have enough activities to continue using the app frequently. Expansion of the iCST app is needed to maintain engagement for longer. Findings indicate that computerised cognitive stimulation can be beneficial, and a large-scale RCT is feasible with modifications to trial components. The results are relevant to researchers, software developers, policy-makers, people with dementia and carers who are looking to be involved in such interventions.Trial RegistrationClinicalTrials.gov, NCT03282877. Registered on 19 July 2017.

User Evaluation of a Multi-Platform Digital Storytelling Concept for Cultural Heritage

Digital storytelling platforms have proven to be a great way of bringing cultural heritage closer to people. What lacks is a deeper understanding of the user experience of such systems, especially in multi-platform digital storytelling. For the last three years, we have been developing a project called Spotlight Heritage Timisoara, which is at its core a digital storytelling platform for the city of Timisoara (Romania), soon to be European Capital of Culture in 2023. The project consists of a website, mobile applications, and interactive museographic and street exhibitions. This paper presents a multi-platform usability evaluation study which employed semi-structured interviews, observations, think-aloud protocol, SUS questionnaire, Net Promoter Score and Product Reaction Cards to gather insights from 105 participants and reveal usability problems in the Spotlight Heritage context. We found out that the four platforms, i.e., interactive touchscreen table, desktop/laptop, mobile and Augmented Reality, have very good usability scores, are considered accessible and useful, work seamlessly together, and create user satisfaction and loyalty, across demographic groups, having the potential to bring people closer to cultural heritage.

Mobile device use among preschool-aged children in Greece.

In the last decade, interactive touchscreen devices have become ubiquitous in young children, and toddlers first experience touchscreen technology before two. Although parents have a vital role in developing the home environment as a stimulus for development, they also have conflicting views on the appropriateness of using apps to deliver educational content for assorted reasons. The purpose of the study was to reveal various aspects of children’s smart mobile use at home, such as the frequency of mobile device usage, preferred app types, and parent beliefs and strategies. Three hundred twenty-five parents of kindergarten children took part in this study. The present study revealed that parents seek to support their children’s learning at home via mobile devices. Furthermore, parents lack knowledge about app developmentally appropriateness and need further guidance. We expect the findings to serve as a reference for researchers to better information for parents and create apps with real educational value for children.

How pedagogical relations in early years settings are reconfigured by interactive touchscreens

AbstractWhile interactive touchscreens are currently entering into educational practice, little is known about what this means for learning in early childhood and, in particular, how touchscreens shape action and communication. In this paper, we examine the interactions of 2‐year‐olds and their teachers in a multilingual preschool in Sweden. We analyse the communicative environment between the children, teachers and shared touchscreens and books in the context of reading. A mixed‐methods analysis was used, taking a concept of action that includes both verbal, non‐verbal utterances and digital touch. The analysis shows a reconfiguration to the interactional dynamic where children perform comparable amounts of actions in sessions with the touchscreen and book reading but less talk during the touchscreen sessions. However, while talking less, children display other types of communicative actions. We analyse the changing interactional dynamic that follows, its implications to learning and early childhood pedagogical practice and how interaction can be reconceptualised as cycles of communication and action in which educational scaffolding unfolds. Practitioner notesWhat is already known about this topic Touchscreens are a significant part of children's lives and educational curricula. There is considerable uncertainty on how touchscreens can be incorporated into early childhood education. Little is known about how educational social interaction changes with touchscreens such as iPads. What this paper adds A mixed methods multimodal analysis of the changing actions and dynamics of iPads as compared with bookreading. Children's patterns of communication change towards less talk and more bodily communication, while teachers’ actions remain somewhat similar. Touch actions change the dynamics of interaction, can alter the pedagogical situation and bring a reconceptualisation towards a cyclical and embodied view of interaction. Implications for practice and/or policy New patterns of action may require a recalibration of educational practices. Teachers need to attend to new sets of touch actions that children use to communicate and act with as displays of knowledge. The use of touch screens should be seen as complementary to established practices of language and literacy training (such as book reading) rather than replacing them.

Table Reservation and Meal Ordering System Using QR Code

At present, people have been waiting anxiously for the system that will satisfy their needs more clearly. The majority of the companies in the restaurant sector is looking for some software that improves the quality of delivery and increasing revenue. In a typical system, the waiter records the customer's order, and then put the order in to the kitchen, and then billing is done, which spends a lot of time and might lead to errors. The goal of this project is to automate the process of ordering food from the table in a restaurant and reserving a table, as well as to improve the quality of their customer service. Smart Restaurant is a concept of a restaurant's business that is based on the use of state-of-the-art technology from reservation to the order and the customer sign a relationship with you. The traditional restaurant will be replaced with the help of a smartphone, a tablet, or a graphical user interface and interactive touch screens. Customers will have to order their food via mobile phones by scanning a QR code on a table, as they are directly linked to the kitchen via a central server. In addition, our records are permanently stored on a central server, which can then be used for the marketing, distribution and sales. A smart restaurant, decrease the number of staff who work at the hotel-services, so as to increase the profit margins. The kitchen is going to be one of the interfaces which will be provided in accordance with the following priority (first-come-first-served). This app will help you to find more detailed information on the restaurant and its services, as well as the ease of ordering food and reservation table.

An Individual Cognitive Stimulation Therapy App for People With Dementia and Their Carers: Protocol for a Feasibility Randomized Controlled Trial.

BackgroundThere is a need for more resources to support the cognition and quality of life of people with dementia. The individual cognitive stimulation therapy (iCST) app aims to provide cognitive stimulation and social interaction to people with dementia and carers through interactive touchscreen technology. The iCST app has been developed according to the principles of CST and iCST, which have previously shown to improve the cognition and quality of life of people with dementia and benefit the relationship between the person with dementia and his/her carer. The iCST app has also shown to improve the quality of the carer’s life.ObjectiveThe aim of this study is to evaluate the usability of the iCST app intervention and the feasibility of conducting a full-scale randomized controlled trial (RCT) to assess the clinical effectiveness of the iCST app intervention compared to that of treatment-as-usual for people with mild-to-moderate dementia.MethodsWe aim to recruit 60 people with mild-to-moderate dementia and their informal carers as dyads in a multi-center feasibility RCT with a treatment-as-usual control group. Both parties must be able to provide informed consent and participate in the intervention. Dyads will complete a baseline assessment that will include cognition and quality of life measures and they will subsequently be randomized (1:1) to the iCST app intervention in addition to usual care or to usual care only. All participants will be followed up at 5 weeks and at 11 weeks after the baseline assessments. A range of feasibility outcomes will be assessed, including recruitment and retention rates, intervention fidelity and usability, and acceptability of the outcome measures. A sample of the experimental group will be invited to a semistructured posttrial interview to further examine the experience of using the iCST app.ResultsThis study received funding in May 2015 and obtained ethical approval in March 2018. Data collection began in November 2018 and was completed in March 2020 with a total of 61 dyads recruited. Data analyses are in progress and the final results are expected to be available in the spring of 2021.ConclusionsThis study will investigate whether it is feasible to conduct a full-scale RCT to evaluate the clinical effectiveness of the iCST app in comparison to that of usual care alone. In addition, this study will examine the usability of the iCST app. The data will provide information on potential modifications to be made to the intervention, study design, and study process.Trial RegistrationClinicalTrials.gov NCT03282877; https://clinicaltrials.gov/ct2/show/NCT03282877International Registered Report Identifier (IRRID)DERR1-10.2196/24628

Design of a Framework for Professional Development Programs for Teachers in the Use of Interactive Touch Screen

Interactive Touch Screens (ITSs) are distributed in selected schools in Sri Lanka. Although, in these schools, selected teachers are trained on the use of the ITS, comprehensive training on the instructional strategies of ITS is yet to be provided. The objective of the study was to design and develop a framework for professional development programme (PDP) for teachers on the use of ITS. The sample of 31 teachers of an educational zone in the Colombo district was selected to test the methodology. Instruments for quantitative data collection were six scales and to collect qualitative data open-ended questions were used. Design Based Research (DBR) approach was made to evaluate the new methodology. DBR approach is characterized by analysis of the problem domain, design of the solution (intervention), iterative cycles of testing and refining the solution and finally reflecting on the whole process to arrive at design principles and inventing the solution. Intervention of this study was in terms of two professional development programmes on the integration of ITS in instruction. The results of the first intervention are presented in this paper. Analysis of data formed the feedback to design the revised PDP. The results of the study are the feedback to the proposed revisions to the next PDP. The feedback was to increase the time allocation of the PDP, provide more hands-on experience, demonstrate ITS-based instructional strategies related to different subject areas and conduct separate PDPs for non-ICT teachers.