Multimodal Information System Research Articles

INCLUSIVE TECHNIQUES OF COLOR HARMONIZATION OF THE INTERIOR SPACE OF PUBLIC BUILDINGS

The work, based on systematized theoretical and practical experience, defines the main inclusive techniques of color harmonization of the interior space of public buildings in the aspect of comfortable perception of the architectural environment by groups of the population with limited mobility and people with special needs: the technique of using contrasting colors, the technique of using a color coding system, the technique of using Braille and tactile elements, the technique of application of light signals, the technique of using neutral colors for the floor and walls, the technique of using audiovisual signals, the technique of providing touch accessibility, the technique of color indicators of doors and entrance area, the technique of color coding of infrastructure. During the study of inclusive techniques of harmonizing the internal space of public buildings, several aspects that need improvement were identified. The introduction of tactile and sound indicators, effective use of contrasts and a color scheme allowed to create an environment that takes into account the needs of people with visual impairments. For the further development of inclusive spaces, it is recommended to take into account the needs of the community and use the latest research methods. The integration of tactile and sound indicators, the development of multimodal information systems and the application of technological innovations are important elements of increasing the effectiveness of inclusive design.

Towards Multimodal Information Systems for Assisting Humans in Production and Logistics Processes

Information support systems for coping with and mastering increasing process complexity are becoming a success factor for many companies. The information systems available today are predominantly implemented as mobile applications and, as the range of functions grows, place increasingly high demands on the user interface. To reduce the cognitive load, these are tailored to the user and are limited in functionality or require special training, which is costly and impractical for some user groups. Current voice interaction interfaces offer advantages in this context, but the communication of data to the user can be done more meaningfully and clearly in graphical or multimodal form. Furthermore, both interaction modes neglect essential sources of information in industrial and logistics use cases, such as available information about documents and physical properties of objects. Methodologically, this contribution proceeds as follows: First, a literature review was conducted on Cognitive Load Theory, Human-Computer Interaction, Social Response Theory, and the cooperative principle of conversation with a focus on human-machine interaction. Subsequently, expert interviews on relevant application areas in the field of production and logistics were conducted in order to identify use cases and derive system requirements. Based on the findings, a concept for an stationary adaptive multimodal information system was developed, which, to our knowledge, does not exist yet due to the combination of a 2D/3D scanner and conversational intelligence and can be used to improve human-machine interaction in the context of Industry 5.0.

Neutrosophic Image Segmentation: An Approach for the Treatment of Uncertainty in Multimodal Information Systems

Information explosion in this era has led to the proliferation of digital data in form of images, text, video, and audio. Uncertainty is a major issue in information access and retrieval models, and incomplete information needs to be treated in information systems because imprecision indicates the existence of a value that cannot be measured. There is no denial of the fact that uncertainty puts a hindrance in obtaining information in real-time systems, and as per knowledge rarely does any study of information retrieval using image segmentation treat imprecise and inconsistent information inherited in information systems. This work proposes to transform images in the neutrosophic domain for the treatment of uncertainty that persists in information recovery. Later, the image is segmented using the neutrosophic segmentation algorithm and its results are compared with the Modified Fuzzy c-Means segmentation algorithm, which is the earlier used segmentation algorithm in information systems. The experiment is conducted on a variety of multimodal images from the Berkeley Segmentation Dataset and Benchmark, showing the effectiveness of the proposed method for information systems. The proposed image segmentation using neutrosophy seems to yield a smaller error of 0.011, but the error obtained using the fuzzy c-means (MFCM) method is 0.13, which is larger than the proposed approach. The work also demonstrates how well neutrosophic segmentation can segment images having different noise levels as well as clean images. The results show that the proposed algorithm yields the most accurate segmented image for feature extraction which can be utilized while designing effective information systems.

The role of coordination costs in mode choice decisions: A case study of German cities

Abstract In times of accelerating urbanization and environmental pollution, mode choice decisions (MCD) are a critical parameter in a city’s appearance and its environmental impacts. Simultaneously, the emerging smartphone multimodal traveller information systems (SMTIS) simplifies the usage of multimodal trips and, therefore, enhance the options in MCD. Current MCD models, in addition to considering classic parameters like travel time and cost, also consider socioeconomic variables and latent variables, such as modal preferences or mode-specific characteristics. However, from the users’ perspective, one main influence is currently still not sufficiently considered in these models: Coordination costs for planning the trip, such as looking-up time tables for public transport. Consequently, we introduced this variable in a multinomial logit model and made a representative survey in Germany for measuring the coordination effort and evaluating our model. Our results support our hypothesis that coordination costs have a significant impact on MCD. We therefore conclude that further developments in information systems together with supporting policies may influence the MCD and, hence, lead to more sustainable cities in the future.

Factors influencing the behavior of multi-modal information search

PurposeWith the increasing abundance of network resources and big data, multi-modal information search (MMIS) has been paid more and more attention, but the research results of MMIS are relatively few. This paper attempts to put forward constructive suggestions for the design of multi-modal information system, so that the system can have a better user experience, help users improve the efficiency of obtaining information and optimize the information service mode.Design/methodology/approachA research model of influencing factors is established by using the TAM (technology acceptance model) theory. The influencing factors of users' multi-modal information search behavior (MMISB) are analyzed by using questionnaire, experiment and the structural equation model. On the basis of this, some suggestions are put forward to build the multi-modal search (MMS) system and improve the efficiency of MMIS.FindingsThe research shows that users' MMISB is directly related to their search intention, and the search intention can influence users' cognition of the usefulness and ease of MMIS through their own information search ability and system characteristics. The user's MMIS ability is affected by the demand expression ability and retrieval ability cognition; the user's cognition of system characteristics is affected by the system function and information quality. This shows that the user's MMISB is closely related to the user's cognitive situation, but due to the author's limited time and research ability, only the questionnaire survey method cannot be used to in-depth research and explore the influencing factors of MMIS. Therefore, in the future research, we should combine the interview method to further track the user's emotional factors and scene factors.Originality/valueFor the first time, TAM theory is combined with cross-modal retrieval behavior and the paper explores the influencing factors and evaluation indexes of users' MMISB. The second, the questionnaire was compiled to investigate the influencing factors of the MMISB of the university group, and the reliability analysis, validity analysis, correlation analysis and structural equation model analysis of the survey data are carried out . The survey data and analysis results are original, which can provide a theoretical basis for improving the service level of MMIS.

An Eco-Friendly Multimodal Route Guidance System for Urban Areas Using Multi-Agent Technology

The use and coordination of multiple modes of travel efficiently, although beneficial, remains an overarching challenge for urban cities. This paper implements a distributed architecture of an eco-friendly transport guidance system by employing the agent-based paradigm. The paradigm uses software agents to model and represent the complex transport infrastructure of urban environments, including roads, buses, trolleybuses, metros, trams, bicycles, and walking. The system exploits live traffic data (e.g., traffic flow, density, and CO2 emissions) collected from multiple data sources (e.g., road sensors and SCOOT) to provide multimodal route recommendations for travelers through a dedicated application. Moreover, the proposed system empowers the transport management authorities to monitor the traffic flow and conditions of a city in real-time through a dedicated web visualization. We exhibit the advantages of using different types of agents to represent the versatile nature of transport networks and realize the concept of smart transportation. Commuters are supplied with multimodal routes that endeavor to reduce travel times and transport carbon footprint. A technical simulation was executed using various parameters to demonstrate the scalability of our multimodal traffic management architecture. Subsequently, two real user trials were carried out in Nottingham (United Kingdom) and Sofia (Bulgaria) to show the practicality and ease of use of our multimodal travel information system in providing eco-friendly route guidance. Our validation results demonstrate the effectiveness of personalized multimodal route guidance in inducing a positive travel behavior change and the ability of the agent-based route planning system to scale to satisfy the requirements of traffic infrastructure in diverse urban environments.

Collaborative Platforms and Data Pools for Smart Urban Societies and Mobility as a Service (MaaS) from a Competition Law Perspective

In the Smart Urban society all devices and service providers will monitor, collect data and exchange data, whilst the device producers and service providers will store, distribute, analyse and re-use data on a grand scale. If firms would like to combine data, they need to give each other access either by sharing, trading, or pooling the data. On the one hand, industry-wide pooling of data could increase efficiency of certain services, and contribute to the innovation of other services, e.g., think about self-driven cars or even creating whole networks for transport available on one platform, i.e. Mobility as a Service (MaaS). On the other hand, firms combining business data may use the data, not to advance their services or products, but to collude, to exclude competitors or to abuse their market position. Indeed, by combining their data and collaborate they can gain market power, and, hence, the ability to violate competition law. We also see platforms hoarding data and designing the data architecture so to become system leaders in vertical value chains, exclusively obtain all data from various sources creating a silo or ecosystem. This paper will discuss a new platform configuration being developed regarding transport services. The new idea for a transport platform is being developed and discussed under the notion of MaaS. MaaS is a new transport paradigm that integrates existing and new mobility services, public and private transport services such as subway and e-scooters, into one single digital platform, providing customised door-to-door transport and offering personalised trip planning and payment options. The development of integrated multimodal information systems and integrated payment solutions have enabled the unfolding of the MaaS concept. We will analyse the MaaS concept from a competition law perspective, and whether the concept might be in violation of EU Competition Law, specifically Articles 101 and 102 TFEU, respectively.

Graph Database Schema for Multimodal Transportation in Semarang

Background: Semarang has broad area that cannot be covered entirely by single transportation mode. To reach a specific location, people often use more than one public transportation mode. Apart from Bus Rapid Transit, another exist namely angkot or city transportation. Multimodal traveler information is then required to help passenger searching for a route. Several studies of multimodal traveler information system has been conducted, however the data model for multimodal transportation did not conceived in detail.Objective: Proposes a database of multimodal transportation design using graph data model by taking Semarang as a case study.Method: We create our model in oriented entity-relationship diagram (O-ERD) and map this O-ERD to the graph database schema.Result: We develop our data model in graph database schema and we implement the model using Neo4J graph database for validation purpose. Our model consist of three graph node label namely Shelter, Angkot Stopper, and Closer Place. To validate our model, we execute a search query using the Cypher query to look for location with closer place to it.Conclusion: Our data model was successfully developed and implemented. Searching transportation route in the implementation of our model has been conducted using cypher query. It can successfully display all possible paths and routes. Our query can distinguish between one mode of transportation with another.Keywords: Graph database, Multimodal transportation, Neo4j, Cypher

Assessing the visual and cognitive demands of in-vehicle information systems

BackgroundNew automobiles provide a variety of features that allow motorists to perform a plethora of secondary tasks unrelated to the primary task of driving. Despite their ubiquity, surprisingly little is known about how these complex multimodal in-vehicle information systems (IVIS) interactions impact a driver’s workload.ResultsThe current research sought to address three interrelated questions concerning this knowledge gap: (1) Are some task types more impairing than others? (2) Are some modes of interaction more distracting than others? (3) Are IVIS interactions easier to perform in some vehicles than others? Depending on the availability of the IVIS features in each vehicle, our testing involved an assessment of up to four task types (audio entertainment, calling and dialing, text messaging, and navigation) and up to three modes of interaction (e.g., center stack, auditory vocal, and the center console). The data collected from each participant provided a measure of cognitive demand, a measure of visual/manual demand, a subjective workload measure, and a measure of the time it took to complete the different tasks. The research provides empirical evidence that the workload experienced by drivers systematically varied as a function of the different tasks, modes of interaction, and vehicles that we evaluated.ConclusionsThis objective assessment suggests that many of these IVIS features are too distracting to be enabled while the vehicle is in motion. Greater consideration should be given to what interactions should be available to the driver when the vehicle is in motion rather than to what IVIS features and functions could be available to motorists.

Will commute drivers switch to park-and-ride under the influence of multimodal traveler information? A stated preference investigation

The knowledge about en-trip mode switching behavior with presence of multimodal traveler information is very limited so far. This study investigated the impacts on commute drivers’ en-trip mode switch decisions of smartphone multimodal traveler information systems (SMTIS) which integrate dynamic information of auto-drive and subway park-and-ride (P&R). This is based on data collected from a stated preference survey in Shanghai, China. A panel mixed probit model which accounts for potential correlations of observations among a same driver and heterogeneity in preferences for travel time savings and comfort level of subway car was developed. The panel model has a much better goodness of fit than a model without consideration of panel effect and heterogeneity. The results show that SMTIS have significant impacts on commuter drivers’ decision about switching from auto drive to P&R; the impacts depend on personal attributes including gender, age, education level, income, and P&R use experience; the sensitivity to time savings in the case non-incident induced delays, and the sensitivity to comfort level of subway, both vary significantly among the driver sample.

Multimodal medical imaging repository and information system in epilepsy surgery

Surgery is an option for patients with drug-resistant epilepsy, but it requires a comprehensive assessment. Electroencephalography (EEG), magnetic resonance imaging (MRI), and functional MRI (fMRI) are used to localize the epileptogenic zone, which directly affects the surgery outcome. Accessing EEG, MRI, and fMRI results and patient information simultaneously using traditional methods might result in misinformation and increase the workload of clinicians. In this study, we developed a modern web-based repository system for the preoperative evaluation of epilepsy disorder, including multimodal medical images and patient information. Our dedicated system is enriched with clinical metadata that are not currently available and is managed with an online application. It overcomes the identified problem and minimizes possible medical errors. In conclusion, this system has the potential to accelerate surgical procedures, get reliable results, and improve the seizure outcome. It is an extensive solution for epilepsy hospitals and clinical research centers. It may serve as a standard template for archiving multiple imaging techniques.

MINOS Multimodal Information and Navigation Cloud System for the Corporate Cyber-Physical Smart Space

MINOS Multimodal Information and Navigation Cloud System for the Corporate Cyber-Physical Smart Space

Adaptive Multimodal In-Vehicle Information System for Safe Driving

This paper proposes an adaptive multimodal in-vehicle information system for safe driving. The proposed system filters input information based on both the priority assigned to the information and the given driving situation, to effectively manage input information and intelligently provide information to the driver. It then interacts with the driver using an adaptive multimodal interface by considering both the driving workload and the driver's cognitive reaction to the information it provides. It is shown experimentally that the proposed system can promote driver safety and enhance a driver's understanding of the information it provides by filtering the input information. In addition, the system can reduce a driver's workload by selecting an appropriate modality and corresponding level with which to communicate. An analysis of subjective questionnaires regarding the proposed system reveals that more than 85% of the respondents are satisfied with it. The proposed system is expected to provide prioritized information through an easily understood modality.

InKoPoMoVer – Cooperative Positioning for Real-time User Assistance and Guidance at Multi-modal Public Transit Junctions

AbstractThe study ‘Cooperative Positioning for Real-time User Assistance and Guidance at Multi-modal Public Transit Junctions’ (InKoPoMoVer) aims at a better understanding of passenger movement at multi-modal transit situations for providing improved passenger assistance and guidance. By using a novel Differential Wi-Fi (DWi-Fi) approach through intelligent Cooperative Positioning (CP), algorithms can be generated, which considerably increase the accuracy of person tracking, allowing for the derivation of movement patterns. Due to user support smoothly transit at the stations is enabled, thus the gap in current multimodal transport information systems where routing is not performed at the junction itself is closed. Addressing ethical and usability aspects will ensure user-friendly results. In this article, the concept of transit assistance is introduced followed by a comprehensive discussion of the suitable CP localization techniques and sensors as well as the implementation strategy.

A Traveller Information System: Minimisation of the Number of Graphs’ Nodes Involved When Processing Route Requests

Abstract The number of people using public transport is continuously increasing. Transport companies want to fulfil travellers’ expectations wherever possible. However, the great number of public transport companies operating in the same area can sometimes confuse travellers as to which route they should take and how to obtain the information relative to their journey. In this paper we suggest integrating several traveller information systems from different companies into the same multimodal information system, offering companies the choice not to share their data. This encourages them to join the system. Additionally, we have minimised the number of nodes involved when processing travellers’ requests in order to simplify the calculation process. To put our plan into action, we have opted for a multi-agent system coupled with the Voronoi decomposition for managing the network.

State and Development of Background Information for the Evaluation of Czech Cancer Screening Programmes

Czech cancer screening programmes feature a comprehensive multimodal information system which covers all the levels of assessment needed - population-based monitoring (Czech National Cancer Registry), monitoring of results in the diagnostic databases of centres, as well as the quantification of coverage and outputs of primary care according to the administrative data of health care payers. A system of personalised invitations to cancer screening programmes was launched in 2014, based on a stand-alone component of the information system which makes it possible to identify eligible clients in health care payers databases. The system was fully standardised and uniformly implemented in all health insurance companies; its functionalities also involve both continuous and retrospective assessment of the results of personalised invitation. The legislative framework in force will have to be applied and implemented for a more comprehensive and integrated employment of all involved data sources, i.e. cancer registries, screening registries, and administrative data. The system must be able to analyse de-identified individual records on clients participation in screening programmes, and thus to ensure an adequate analysis of performance indicators in compliance with international recommendations.

Designing next generation multimodal traveler information systems to support sustainability-oriented decisions

This article explores functionality that could be included in the next generation multimodal travel information system to support sustainability-oriented decisions. It identifies situations in the journey's three phases, pre-, on- and post-trip that have the potential to change travel patterns and also transport choices that the individual makes in order to perform activities in their daily life. Requirements on a traveler information system were derived from these situations and choices. The identified requirements are then transferred into functionalities in a travel information system that has potentials to encourage decisions that could lead to lower energy usage. Nine traveler information systems for multimodal and public transport travel are systematically investigated to find out if they include the proposed functionality. The investigated systems are in operation primarily in Sweden, Germany, the UK and one has global coverage. The investigation results in a discussion about future opportunities with proposal to encourage sustainability oriented travel decisions in the next generation travel information system.

Use of ITS Technologies for Multimodal Transport Operations – River Information Services (RIS) Transport Logistics Services

Interoperable and interconnected solutions for the next generation of multimodal transport management and information systems are the ultimate objectives of both the European transport logistics operators and of the European Commission. In the field of Inland Navigation River Information Services (RIS) is the corresponding Intelligent Transport System (ITS) primarily addressing administrative services. However, traffic information can also generate benefits for commercial stakeholders of the European transport and logistics sector by improving transport planning and management processes along multimodal transport chains.

Multimodal transport information system: modelling approach for goods traceability

One of the main keys to ensure an optimisation of the supply chain in its globality is to succeed to synchronise the physical and the information flows throughout the various links constituting to the whole of the chain. In an environment with globalising economies and increasing competition leading to the remoteness of the various nodes of supply chain, transport and in particular the multimodal transport takes its full importance. In this context the optimisation of physical movement of goods through a solution of follow-up and traceability can contribute to a better mastery of the various flows of the global supply chain. In this paper, we present on the basis of innovative research approaches a modelling approach of modelling of goods traceability data. Then, in order to integrate our traceability data with the other data of the transport chain, but also in order to facilitate the sharing and the exchange of our data we propose an intermediation platform based on the web services logic.

Towards Environment-to-Environment (E2E) multimedia communication systems

We present an approach to connect multiple remote environments over web for natural interaction among people and objects. Focus of current communication and telepresence systems severely restrict user affordances in terms of movement, interaction, peripheral vision, spatio-semantic integrity and even information flow. These systems allow information transfer rather than experiential interaction. We propose Environment-to-Environment (E2E) as a new paradigm for communication which allows users to interact in natural manner using text, audio, and video by connecting environments. Each Environment is instrumented using as many different types of sensors as may be required to detect presence and activity of objects. This object position and activity information is used by a scalable event-based multimodal information system called EventServer to share the appropriate experiential information with other environments as well as to present incoming multimedia information on right displays and speakers. This paper describes the design principles for E2E communication, discusses system architecture, and gives our experience in implementing prototypes of such systems in telemedicine and office collaboration applications. We also discuss the research challenges and a road-map for creating more sophisticated E2E applications in near future.