Smart Home Control Research Articles

Information-Centric IoT-Based Smart Home Control and Monitoring System

Information-Centric IoT-Based Smart Home Control and Monitoring System

GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model Agents

Existing gesture interfaces only work with a fixed set of gestures defined either by interface designers or by users themselves, which introduces learning or demonstration efforts that diminish their naturalness. Humans, on the other hand, understand free-form gestures by synthesizing the gesture, context, experience, and common sense. In this way, the user does not need to learn, demonstrate, or associate gestures. We introduce GestureGPT, a free-form hand gesture understanding framework that mimics human gesture understanding procedures to enable a natural free-form gestural interface. Our framework leverages multiple Large Language Model agents to manage and synthesize gesture and context information, then infers the interaction intent by associating the gesture with an interface function. More specifically, our triple-agent framework includes a Gesture Description Agent that automatically segments and formulates natural language descriptions of hand poses and movements based on hand landmark coordinates. The description is deciphered by a Gesture Inference Agent through self-reasoning and querying about the interaction context (e.g., interaction history, gaze data), which is managed by a Context Management Agent. Following iterative exchanges, the Gesture Inference Agent discerns the user’s intent by grounding it to an interactive function. We validated our framework offline under two real-world scenarios: smart home control and online video streaming. The average zero-shot Top-1/Top-5 grounding accuracies are 44.79%/83.59% for smart home tasks and 37.50%/73.44% for video streaming tasks. We also provide an extensive discussion that includes rationale for model selection, generalizability, and future research directions for a practical system etc.

Wireless sensor network-based health monitoring and smart home assistance for the older adults in sports and wellness towns.

Integrating technology with rural development is essential for addressing the unique challenges faced by aging populations in rural areas. China's national rural revitalization strategy emphasizes the importance of developing characteristic towns that focus on health and wellness demands, particularly for the older adults. However, there is a gap in the literature regarding the systematic use of technology to support the health and daily living needs of this demographic. This study aims to bridge this gap by proposing a wireless sensor network (WSN)-based system that integrates health monitoring and smart home assistance, specifically tailored for older adults residents in sports and wellness towns. The system's design involves collecting and analyzing historical activity data and basic physiological parameters from older adults residents' homes. The data are cleaned, combined and stored to prepare it for behavior analysis, which is vital for controlling smart home equipment. Preliminary health assessments are conducted using the collected physiological data. A hybrid network leveraging Sub-G and Wi-Fi technologies is optimized for the purposes of collecting and uploading data, based on a comparative analysis of wireless communication options. This study significantly contributes to the advancement of sports and wellness towns by promoting healthy aging through cutting-edge technological solutions.

The Analysis of Smarter Future

With the continuous development of technology, smart home control systems, as one of the applications of artificial intelligence in daily life, are receiving increasing attention. However, smart home control systems face challenges in practical applications, such as complex scenarios and multimodal information. In this context, this paper introduces Visual Question Answering (VQA) technology to enhance the intelligence and user experience of smart home control systems. Despite the potential advantages of VQA technology in smart home control systems, current models still have certain shortcomings in handling local image information and integrating visual-language multimodal features. To address this, this paper proposes an innovative Transformer-based Multimodal Fusion Network (TMFNet) model. TMFNet aims to overcome the limitations of existing models in dealing with complex smart home scenarios by introducing a global-local feature attention mechanism, deep encoding-decoding modules, and multimodal representation modules.

IUAC: Inaudible Universal Adversarial Attacks Against Smart Speakers

Intelligent voice systems are widely utilized to control smart home applications, which raises significant privacy and security concerns. Recent studies have revealed their vulnerability to adversarial attacks, replay attacks, etc. However, these attacks rely on the victim’s voice data. In our work, we investigate a stealthy and command-independent attack that does not necessitate collecting victims’ voices. Our proposed attack, IUAC, misleads the voice system to go against the victim’s will, regardless of the commands delivered. Our core concept is to train highly robust attack commands through the construction of diverse data, rendering the user’s commands negligible. To achieve stealthy attacks, we leverage a high-frequency carrier to construct an inaudible universal adversarial command. Extensive experiments conducted with real-world datasets demonstrate that our attack system attains an average attack success rate of 96% while resisting environmental interference. Moreover, our attack success rate against real-world voice systems is 4.52 × higher than the state-of-the-art. Finally, we propose an effective defense mechanism and provide experimental tests to validate its efficacy.

Research on Universal Design of Smart Home Interface Navigation Based on Visual Interaction

The study focuses on analyzing the design characteristics of display and control interface navigation in smart home terminals for users of different ages. By examining the design features of the current typical smart home terminal display and control interface navigation, interface navigation design is the research object. Experimental research is conducted with young adult group (n = 15) and middle-aged to elderly group (n = 15) participants to identify the optimal interface navigation design through specific behavioral indicators, eye movement indicators, and subjective indicators. The results show that different interface layouts impact task completion performance. Middle-aged and older individuals perform better with multi-level highlighting operations. Both age groups prefer interface layouts featuring less-level dual navigation, specifically the left-side type, and multi-level highlighting. These results can improve the versatility of smart home interface design, expand the user base, and provide information for developing smart products.

Analysis and optimization of smart home control system stability analysis and optimization

Analysis and optimization of smart home control system stability analysis and optimization

Design and implementation of embedded hardware in furniture control based on DSP

The continuous progress of embedded technology and Internet of Things technology has accelerated the arrival of the era of home intelligence. By designing a smart home control system based on embedded DSP technology, it can detect temperature, humidity, flammable gas leakage, smoke, fire, and other indicators in the home environment, and carry out intelligent control of the detected security risks. The core of the system is the smart home management terminal, which is responsible for the network interconnection inside and outside the home. Terminal hardware includes a high-speed DSP chip, various interface modules, and so on. The software adopts the C/OS-II operating system to realize multi-task processing. This paper briefly summarizes DSP technology and embedded technology, and proposes the composition of intelligent home control system based on embedded DSP technology, as well as the hardware and software design and implementation of the system. Through the smart home system, users can control home conditions and obtain public service information anytime and anywhere, which is highly practical.

A CRITICAL REVIEW OF IOT APPLICATIONS IN SMART HOMES: SECURITY RISK ANALYSIS

The new and problematic age of shrewd residential bundles (from this point forward called applications) in light of Internet of Things (IoT) is essentially controlled and dispersed. To give significant bits of knowledge into mechanical situations and bolster analysts, we should perceive the to be had choices and holes in this line of exploration. Along these lines, on this glance at, an outline is done to delineate examinations scene directly into a sound scientific classification. In this paper, I have a pattern to audit a few deals with savvy homes utilizing web o things (IOT) as of late. We have pattern to examine numerous ways use for steps of brilliant homes like keen home security, savvy home condition, shrewd home gadgets and association. Web of Things (IoT) is a rising development that is making our world increasingly savvy. Associated world can't be imagined without IoT. An IoT based Smart Home is one such model. In IoT engaged Smart Home condition various things, for instance, lighting, home contraptions, PCs, observation camera, etc all are related with the Internet and empowering customer to screen and control things offering little appreciation to time and region necessity. This paper delineates Frugal Labs IoT Platform (FLIP) for building IoT enabled Smart Home. This paper looks at components of Smart Home and its applications and presents FLIP plan with execution of Smart Home organizations using FLIP through a proposed structure. The proposed system showed in this paper is used for checking and controlling Smart Home condition. Web of Things (IoT) conceptualizes the chance of remotely partner and watching genuine (things) through the Internet. Concerning our home, this thought can be suitably combined to make it progressively astute, increasingly secure and robotized. This IoT adventure bases on building a sharp remote home security structure which sends alerts to the owner by using Internet if there ought to emerge an event of any trespass and raises an alarm on the other hand. Keywords— Internet of things (IOT), smart home, Security, device, controller, Machine to Machine Communication, Security Threats, Security Countermeasures.

Three-phase coded triboelectric nanogenerator disk: A novel approach for generating diverse control instructions in human–machine interactions

Triboelectric nanogenerator (TENG) has been widely utilized in a variety of real-world applications such as the Internet of Things (IoT) and human–machine interactions (HMIs). However, current technologies are difficult to be implemented in the situations that require a large amount of control instructions, due to the limitation on the size and the cost of the TENG-based interface. In this paper, a sliding operation three-phase coded TENG based control disk HMI interface is developed by integrating three coded copper electrodes, polytetrafluoroethylene (PTFE) film, and electronic signal processing circuits. The three-phase coded TENG electrodes enable the ability to overcome the challenge of increasing the number of generatable control instructions. The proposed system successfully achieves thirty sensing transitions through the utilization of the three-phase patterned electrodes. To evaluate the performance of this system, four applications, including English letters typing, game control, smart home control, and authentication access control, are implemented in real-time. An embedded microcontroller with a Bluetooth interface is employed to process and transmit the triboelectric control signal. The proposed TENG control disk effectively supports all functionalities required for these applications. Overall, the successful implementation and support of these applications demonstrate the effectiveness and versatility of the proposed TENG control disk in real-world scenarios and potential environments.

Based on Raspberry Pi Voice Controlled Smart Home System

Based on Raspberry Pi Voice Controlled Smart Home System

Smart and Secure Home with Chatbot

This study delves into the fusion of smart home technology with robust security measures alongside the integration of a chatbot interface. This convergence aims to streamline home automation while fortifying security protocols. Smart home devices, sophisticated algorithms, and encryption techniques form the bedrock of this secure environment. Additionally, the incorporation of a chatbot enhances user interaction, offering an intuitive interface for monitoring and controlling smart home functionalities. Emphasizing the pivotal role of proactive security measures, this paper underscores the symbiotic relationship between advanced home technology, stringent security, and a user-friendly chatbot interface in creating a harmonious and secure living space.

Adapted Contrastive Predictive Coding Framework for Accessible Smart Home Control System Based on Hand Gestures Recognition

Smart home control systems have been widely used to control multiple smart home devices such as smart TVs, smart HVAC, and smart bulbs. While targeting the design of a smart home environment, the accessibility of the entire system is crucial to achieving a comfortable and accessible environment for all home individuals. Thus, in this paper, we are aiming to improve the daily quality of life of the elderly and Disabled individuals by improving the user experience of a vision-based accessible home control system based on an integrated self-supervised and supervised learning framework that provides a robust capability of extracting the features to enhance the overall performance via adapting the contrastive predictive coding concepts and deep learning for real-time hand gesture recognition system. The proposed framework provides an accessible smart home control system with a significant improvement in the user experience.

J.A.R.V.I.S: A Personal Assistant Robot

Abstract: Personal assistant robots are becoming increasingly popular as versatile devices that can assist individuals in various aspects of daily life. These robots are designed to be small and portable, with user-friendly interaction features that allow them to navigate tight spaces and interact closely with users. Equipped with sensors, cameras, and AI algorithms, personal assistant robots can perceive and respond to their environment, recognize faces and voices, and perform tasks such as setting reminders, providing information, and controlling smart home devices. They offer a range of benefits in different settings, including smart homes, healthcare facilities, and public spaces, where they can serve as personal assistants, health monitors, and information guides. The ability of personal assistant robots to learn and adapt to users' preferences and behaviors over time enables them to provide personalized and intuitive assistance, making them suitable for individuals of all ages. As advancements in their design and capabilities continue, personal assistant robots are expected to have an even greater impact on enhancing daily life in the future

Humidity-resistant, breathable, waterproof, and bionic triboelectric electronic skins for self-powered haptic sensing and human motion recognition

Researchers have been striving for a long time to create an electronic skin (E-skin) that can rival or surpass human skin in functionality. Herein, inspired by human skin, we developed a bionic triboelectric E-skin (BTE-skin) via a cost-effective method with superior humidity-resistance, breathability and waterproofness. Benefiting from introducing HKUST-1 into silicone rubber as the triboelectric layer significantly enhances the humidity resistance of the triboelectric E-skin, and the output is increased by a factor of 2.15 at 90 % relative humidity. The construction of a fully enclosed electrode structure and a three-dimensional microporous array structure promises BTE-skin excellent breathability (water vapor transmission of 500 g/m2/d and air permeability of 293 mm/s) and waterproofness. In addition, the BTE-skin exhibits a wide sensing range (up to 100 kPa), ultra-high pressure response sensitivity in the low-pressure region (504.60nA/kPa), fast response time (42 ms), and excellent cycling stability over 10,000 cycles. Furthermore, based on the BTE-skin, a self-powered smart home control system and a visual leg motion recognition system have been successfully developed. This work proposes a new strategy for tracking electronic human skin and manifests great potential in the intelligent wearable sensing field, which can help human life move toward a more convenient and intelligent future.

A novel coreless current sensing mechanism for two-wire power cord

In the development of smart home products, energy monitoring, and control systems, there is a significant need for precise and reliable electric current measurement. Most domestic appliances, whether residential or commercial, are powered by power cords with two wires. A reliable and accurate current probe would be required to detect current in two-wire power cables. Existing current sensors for two-wire power cables are complex, bulky (they use a magnetic core), and need full access to the power cord. In this paper a coreless, contactless current probe that requires only limited access of the space around the two-wire power cable is proposed. The sensor unit presented here measures the current accurately even for certain types of misalignments of the power cord. This makes the current measurement less sensitive to minor mechanical displacements, radius of the conductors, and the overall insulation thickness of power cord. In the proposed current probe, one-of-a-kind and highly reliable arrangement of magnetic field sensors, are used to measure the magnetic flux density caused by the current passing in the power cord. The current is computed using a derived mathematical formula which is expressed in terms of the voltage outputs of the magnetic sensors. To provide a clear understanding of the measurement process, an analysis using the Finite Element Method (FEM) is performed. The functionality of the proposed current probe is theoretically tested. Considering different sources of errors, an accuracy of less than 1.5% is obtained.

Security assessment and improvement of building ethernet KNXnet/IP protocol

KNXnet/IP is a KNX-building automation protocol that communicates through an IP network. It is mainly used in the field of smart home and building automation control, allowing remote access to KNX devices through an IP network, so that building functions can be managed and controlled anywhere through an Internet connection. However, with the development of smart homes and building automation, such physical devices based on IP communication are more and more frequently in contact with the Internet, resulting in more and more security issues for home devices and buildings exposed to the Internet. This paper uses the formal analysis method-colored Petri net (CPN) combined with the CPN Tools to model the KNXnet/IP protocol and analyze the protocol interaction process. Based on the Dolev-Yao attacker model, the security of the KNXnet/IP protocol is evaluated and tested, and it is verified whether there are three types of attackable vulnerabilities in the protocol: replay, tampering, and spoofing. After CPN modeling analysis and verification, it is found that tampering and replay vulnerabilities in the original protocol. Therefore, we introduce timestamp and hash to strengthen the security mechanism of the protocol, which ensures the integrity, confidentiality, and freshness of the security mechanism of the protocol. After the final analysis and verification, the improvement scheme proposed in this paper can effectively improve the security performance of the protocol.

Mass-production of biomimetic fur knitted triboelectric fabric for smart home and healthcare

While triboelectric nanogenerated knitted fabrics are regarded as a state-of-the-art and reliable energy source for wearable electronics, there are two bottlenecks in their widespread applications: few mass-manufacturing strategies and low power output. Here, by mature weft-knitted technologies, a 3D single-faced jacquard pile fabric TENG (SJPF-TENG) with the merits of high surface pile density, excellent comfort and breathability, good thermal insulation property, and superior durability, is mass-produced. Based on the high-density pile structure (about 16128 piles per cm2), the surface area of pile fabrics is 42.2 times that of the plain structure, which endows the SJPF-TENG with higher electrical outputs and good detection precision. With a peak power density of 1.4 W m−2 (dozens of times that of conventional textile-based TENGs), the SJPF-TENG is capable of lighting up 1392 light-emitting diodes, powering miniature electronics, and charging various capacitors. Furthermore, a self-powered remote control, an intelligent alphabet writing pad, a smart fluff carpet, and a proof-of-concept fluff keyboard array with 3×3 sensing pixels are demonstrated to verify its outstanding sensing performance. Our results provide a massive prospect for high-power textile-based TENGs in large-area energy harvesting, smart-home control systems, entertainment, elder healthcare, and security warnings.

AI Based Smart Robot (Chatbot) using Python

This research paper explores the development and functionality of the AI Based smart Robot, which includes an interactive chatbot. A chatbot, in its essence, is an artificially intelligence computer program that performs communication using the audio system, A chatbot, created with the Gemini API, is basically a talking robot that build using the Gemini API toolbox. This chatbot, it listens to your voice, understands what you're saying and give responds back to you. It develop to assistance to users. Additionally, the project’s application in Customer Service, Virtual Assistant, Healthcare, Education, Smart Home Control.

Enhanced performance triboelectric nanogenerator based on mullite/PVA composites for self-driven sensing and smart home control

Polyvinyl alcohol (PVA) has good biocompatibility, a simple fabrication process, and environmental protection, which is very suitable for the production of triboelectric nanogenerator (TENG) applied to smart home control. However, the output performance of the TENG composed of PVA and PDMS films is not high. Previous research has explored the enhancement of PVA-based TENG performance by doping with conductive materials to modify the dielectric properties of PVA composite films. Nevertheless, this approach is associated with issues of high production costs and energy consumption. This work prepared a mullite/PVA composite material TENG (MP-TENG), the introduction of mullite induced interfacial polarization in the composite film. This effect resulted in the appearance of polarization centers, thereby enhancing the charge-sensing capability of the composite film. Consequently, the triboelectric output performance of the MP-TENG was improved. MP-TENGs with different amounts of mullite fiber doping were prepared, and the maximum output performance was obtained when the doping level reached 3 wt%. At this concentration, the composite film exhibited an open-circuit voltage of 70.89 V and a short-circuit current of 2.45 μA. An enhancement of 1.78 and 1.71 times was achieved with respect to the pure PVA-TENG, respectively. In addition, MP-TENG exhibited excellent sensing characteristics, a smart home control system was designed in conjunction with a hardware circuit, which captured hand motions and encoded them to generate binary codes to control the on/off state of the indoor home.