Multimedia Web Research Articles

Fusing cross-media for topic detection by dense keyword groups

Events are real-world occurrences that lead to the explosive growth of web multimedia content such as images, videos and texts. Efficient organization and navigation of multimedia data in the topic level can boost users׳ understanding and enhance their experience of the events that have happened. Due to the potential application prospects, multimedia topic detection has been an active area of research with notable progress in the last decade. Traditional methods mainly focus on single media, so the results only reflect the characteristics of one certain media and topic browsing was not comprehensive enough. In this paper, we propose a method of utilizing and fusing rich media information from web videos and news reports to extract weighted keyword groups, which are used for cross-media topic detection. Firstly by utilizing the video-related textual information and the titles of news articles, a maximum local average score is proposed to find coarse weighted dense keyword groups; after that, textual linking and visual linking are applied to refine the keyword groups and update the weights; finally, the documents are re-linked with the refined keyword groups to form an event-related document set. Experiments are conducted on cross-media datasets containing web videos and news reports. The web videos are from Youku, YouTube׳s equivalent in China, the news reports from sina.com, some of which contain topic-related images. The experimental results demonstrate the effectiveness and efficiency of the proposed approach.

Flash: building the interactive web

Adobe Flash began as a simple animation tool and grew into a multimedia platform that offered a generation of creators and innovators an astonishing range of opportunities to develop and distribute new kinds of digital content. For the better part of a decade, Flash was the de facto standard for dynamic online media, empowering amateur and professional developers to shape the future of the interactive Web. In this book, Anastasia Salter and John Murray trace the evolution of Flash into one of the engines of participatory culture. Salter and Murray investigate Flash as both a fundamental force that shaped perceptions of the web and a key technology that enabled innovative interactive experiences and new forms of gaming. They examine a series of works that exemplify Flash's role in shaping the experience and expectations of web multimedia. Topics include Flash as a platform for developing animation (and the Flashimation aesthetic); its capacities for scripting and interactive design; games and genres enabled by the reconstruction of the browser as a games portal; forms and genres of media art that use Flash; and Flash's stance on openness and standards--including its platform-defining battle over the ability to participate in Apple's own proprietary platforms. Flash's exit from the mobile environment in 2011 led some to declare that Flash was dead. But, as Salter and Murray show, not only does Flash live, but its role as a definitive cross-platform tool continues to influence web experience.

Pattern-Based Near-Duplicate Video Retrieval and Localization on Web-Scale Videos

With the exponential growth of web multimedia contents, the Internet is rife with near-duplicate videos, the video copies applied with visual/temporal transformations and/or post productions. Two critical issues, copyright infringement and search result redundancy, arise accordingly. To resolve these problems, this paper proposes a spatiotemporal pattern-based approach under the hierarchical filter-and-refine framework for efficient and effective near-duplicate video retrieval and localization . Firstly, non-near-duplicate videos are fast filtered out through a computationally efficient data structure, termed pattern -based index tree (PI-tree). Then, an m- pattern -based dynamic programming (mPDP) algorithm is designed to localize near-duplicate segments and to re-rank the videos retrieved. The influence of time shift misalignment can be alleviated by time-shift m-pattern similarity (TPS) measurement. Comprehensive experiments on the five datasets are conducted to verify the effectiveness, efficiency, robustness, and scalability of the proposed approach. Convincing results demonstrate that our proposed approach outperforms the state-of-the-art approaches in terms of mean average precision (MAP) and normalized detection cost rate (NDCR) on the testing datasets. Furthermore, the proposed approach can achieve high quality of near-duplicate video localization in terms of quality frames (QF) and mean F1.

Guest Editorial: Ad Hoc Web Multimedia Analysis with Limited Supervision

With the popularity of social media applications and Web 2.0 techniques, there is an explosive growth of web multimedia data generated from user-sharing web sites such as Flickr, YouTube, and Facebook. The social characteristics and the increased scalability turn out to be a great challenge in the semantic understanding and retrieval of web multimedia. Though the users’ comments and tagging can be well exploited to provide more semantic cues for the web multimedia analysis, the annotations of these data contain a lot of noisy tags and are always weakly tagging. Thus, the supervision information available is limited due to the huge output space. Furthermore, for web multimedia analysis, the negative examples come from an infinite semantic space and we have no clue about the semantics these negative examples include. Thus, how to construct the generic model for each ad hoc multimedia analysis task (a.k.a. AdHocWeb Multimedia Analysis) is a challenging problem for the social media applications on the web. The research of ad hoc web multimedia analysis with limited supervision is an interesting and fundamental research area, which involves several fields, ranging from machine learning, multimedia retrieval, and computer vision to data mining. This issue consists of 11 papers, which are briefly discussed as follows. Visual content analysis is a fundamental problem in ad hoc multimedia analysis, which will facilitate the semantic understanding of multimedia data. In this issue, two papers investigate visual content analysis and its applications in super-resolution and image-based localization on mobile phone. The “Depth map Super-Resolution based on joint dictionary learning” (10.1007/s11042-014-2002-6) paper utilizes unsupervised dictionary learning for depth map super-resolution. This method transforms a low-resolution depth map to a high-resolution depth map. Different from previous depth map super-resolution methods, the proposed algorithm uses a joint dictionary learning method with both lowand high-resolution depth Multimed Tools Appl (2015) 74:463–465 DOI 10.1007/s11042-014-2419-y

Voice Application Generator Platform for Real Time Multimedia Vehicle Sensor based Notifications

Nowadays, many software applications are used to offer services or functionalities to drivers. Even though, there is a lack of applications that offer drivers the possibility to express their need to generate a specific application in real time. In this research, the authors present an innovative platform that allows users to generate multimedia web applications that use real time vehicle sensor information. The creation of applications is specified through a voice interface to allow users to generate applications while driving. Information used in the applications is collected combining mobile device sensors (accelerometer, GPS, light sensor, barometer, etc.) and vehicle real time On-board Diagnosis port information (speed, engine revolutions per minute, fuel consumption, coolant temperature, throttle, battery voltage, etc.). The domain of generated applications includes driving safety, road state, parameter notifications, social applications, etc. The generated applications can display visual information systems such as maps, audio, video and measurement gauges. For the analysis of this paper, the authors present three prototypes to demonstrate the platform capabilities.

Tourism Information Search System Based on Android Mobile Phone

In this paper, a design and an implementation on an intelligent guide system based on Android platform is proposed. The hardware of system is based on ARM platform, and the schematics of its main modules such as power, SDRAM are given. Then Android operation system is transplanted on the ARM platform. On this basis, the application software is developed using Eclipse and Android SDK, and it is consisted of three modules: multimedia application, web maps and recording. The module of multimedia application includes audio, picture and video. Web maps can display Google Maps on the device and achieve positioning. The record module has implemented the several normal operation on a record, such as creating, modifying and displaying.

Semi-Supervised Heterogeneous Fusion for Multimedia Data Co-Clustering

Co-clustering is a commonly used technique for tapping the rich meta-information of multimedia web documents, including category, annotation, and description, for associative discovery. However, most co-clustering methods proposed for heterogeneous data do not consider the representation problem of short and noisy text and their performance is limited by the empirical weighting of the multi-modal features. In this paper, we propose a generalized form of Heterogeneous Fusion Adaptive Resonance Theory, called GHF-ART, for co-clustering of large-scale web multimedia documents. By extending the two-channel Heterogeneous Fusion ART (HF-ART) to multiple channels, GHF-ART is designed to handle multimedia data with an arbitrarily rich level of meta-information. For handling short and noisy text, GHF-ART does not learn directly from the textual features. Instead, it identifies key tags by learning the probabilistic distribution of tag occurrences. More importantly, GHF-ART incorporates an adaptive method for effective fusion of multi- modal features, which weights the features of multiple data sources by incrementally measuring the importance of feature modalities through the intra-cluster scatters. Extensive experiments on two web image data sets and one text document set have shown that GHF-ART achieves significantly better clustering performance and is much faster than many existing state-of-the-art algorithms.

Development of Marine Diesel Engine Database Based on Web

The combination of marine diesel engine traditional multimedia teaching material database and Web database developed the Web database based on. The system development environment, system function, system architecture and database gateway technology are analyzed in the paper. Further this database plays a role in the network education in now.

Exploiting Multimedia in Creating and Analysing Multimedia Web Archives

The data contained on the web and the social web are inherently multimedia and consist of a mixture of textual, visual and audio modalities. Community memories embodied on the web and social web contain a rich mixture of data from these modalities. In many ways, the web is the greatest resource ever created by human-kind. However, due to the dynamic and distributed nature of the web, its content changes, appears and disappears on a daily basis. Web archiving provides a way of capturing snapshots of (parts of) the web for preservation and future analysis. This paper provides an overview of techniques we have developed within the context of the EU funded ARCOMEM (ARchiving COmmunity MEMories) project to allow multimedia web content to be leveraged during the archival process and for post-archival analysis. Through a set of use cases, we explore several practical applications of multimedia analytics within the realm of web archiving, web archive analysis and multimedia data on the web in general.

Information extraction from multimedia web documents: an open-source platform and testbed

The LivingKnowledge project aimed to enhance the current state of the art in search, retrieval and knowledge management on the web by advancing the use of sentiment and opinion analysis within multimedia applications. To achieve this aim, a diverse set of novel and complementary analysis techniques have been integrated into a single, but extensible software platform on which such applications can be built. The platform combines state-of-the-art techniques for extracting facts, opinions and sentiment from multimedia documents, and unlike earlier platforms, it exploits both visual and textual techniques to support multimedia information retrieval. Foreseeing the usefulness of this software in the wider community, the platform has been made generally available as an open-source project. This paper describes the platform design, gives an overview of the analysis algorithms integrated into the system and describes two applications that utilise the system for multimedia information retrieval.

3D graphics on the web: A survey

In recent years, 3D graphics has become an increasingly important part of the multimedia web experience. Following on from the advent of the X3D standard and the definition of a declarative approach to presenting 3D graphics on the web, the rise of WebGL has allowed lower level access to graphics hardware of ever increasing power. In parallel, remote rendering techniques permit streaming of high-quality 3D graphics onto a wide range of devices, and recent years have also seen much research on methods of content delivery for web-based 3D applications. All this development is reflected in the increasing number of application fields for the 3D web. In this paper, we reflect this activity by presenting the first survey of the state of the art in the field. We review every major approach to produce real-time 3D graphics rendering in the browser, briefly summarise the approaches for remote rendering of 3D graphics, before surveying complementary research on data compression methods, and notable application fields. We conclude by assessing the impact and popularity of the 3D web, reviewing the past and looking to the future.

Web Videos – Concerns About Accessibility based on User Centered Design

Recently, the production and availability of multimedia Web content, as videos, have increased. In this scenario it is important to consider accessibility requirements so that any user can whelm the barriers to access content regardless of the limitations imposed by either deficiency or some temporary restriction. One of the main barriers found in the current players is the restriction to make videos accessible on the Web and little research on how to overcome those limitations has been conducted. This paper describes the three phases of User Centered Design, in which an evaluation with real users of an accessible video player is conducted. A video player, called Facilitas, is proposed in order to provide the rationale of how some of those barriers or limitations could be overcome. Its controls are new and different from the ones in other players. We have observed that by reducing accessibility barriers, the design process leads to an improved product in terms of usability. A user testing is described to explain which controls users frequently use to complete a task.

How Technology Helps to Create New Learning Environments by Use Digital Museum Resource

Multimedia Technologies, communication and WEB allow the opportunity to develop tools to apply new teaching methodologies and learning way in the School. On the other side Museum resources are available online to support teaching activities. The research team (Digilab of Sapienza University and “Via Val Maggia” School) has launched a project to develop a new way to teaching based on objects specially museum digital resources, therefore new learning environments have been created. A particularly Information System and a tool to build e-book have been designed to teachers to improve student learning by use digital museum objects information. The Polo Museale Sapienza has given a important contribution with its digital cultural heritage. Linked and Open Data technologies have been applied to share cultural heritage with education materials. We will discuss the results of the project and we will show examples of the creative means that teachers have built to use museum objects in the classroom through tools developed by Project. The project results could be important to develop a distance learning system to help student at home or to long life learning

Dynamic Service Composition for Telecommunication Services and Its Challenges

As communication networks have evolved towards IP (Internet Protocol) networks, telecommunication operators has expanded its reach to internet multimedia web content services while operating circuit-switch networks in parallel. With the adoption of SOA (Service Oriented Architecture) that enables service capability interfaces to be published and integrated with other service capabilities into new composite service, service composition allows telecommunication providers to accelerate more new services provisioning. From the perspective of telecommunication providers to deliver integrated composite service from different providers and different network protocols, this paper is aimed to present the current service composition based on middleware approaches; discuss the requirements of meeting the challenges; and compare the approaches.

MOWL

Several multimedia applications need to reason with concepts and their media properties in specific domain contexts. Media properties of concepts exhibit some unique characteristics that cannot be dealt with conceptual modeling schemes followed in the existing ontology representation and reasoning schemes. We have proposed a new perceptual modeling technique for reasoning with media properties observed in multimedia instances and the latent concepts. Our knowledge representation scheme uses a causal model of the world where concepts manifest in media properties with uncertainties. We introduce a probabilistic reasoning scheme for belief propagation across domain concepts through observation of media properties. In order to support the perceptual modeling and reasoning paradigm, we propose a new ontology language, Multimedia Web Ontology Language (MOWL). Our primary contribution in this article is to establish the need for the new ontology language and to introduce the semantics of its novel language constructs. We establish the generality of our approach with two disperate knowledge-intensive applications involving reasoning with media properties of concepts.

Web Multimedia Object Classification Using Cross-Domain Correlation Knowledge

Given a collection of web images with the corresponding textual descriptions, in this paper, we propose a novel cross-domain learning method to classify these web multimedia objects by transferring the correlation knowledge among different information sources. Here, the knowledge is extracted from unlabeled objects through unsupervised learning and applied to perform supervised classification tasks. To mine more meaningful correlation knowledge, instead of using commonly used visual words in the traditional bag-of-visual-words (BoW) model, we discover higher level visual components (words and phrases) to incorporate the spatial and semantic information into our image representation model, i.e., bag-of-visual-phrases (BoP). By combining the enriched visual components with the textual words, we calculate the frequently co-occurring pairs among them to construct a cross-domain correlated graph in which the correlation knowledge is mined. After that, we investigate two different strategies to apply such knowledge to enrich the feature space where the supervised classification is performed. By transferring such knowledge, our cross-domain transfer learning method can not only handle large scale web multimedia objects, but also deal with the situation that the textual descriptions of a small portion of web images are missing. Empirical experiments on two different datasets of web multimedia objects are conducted to demonstrate the efficacy and effectiveness of our proposed cross-domain transfer learning method.

Curve Analysis on Learning Potential and Multimedia Music Courseware Design Based on Web Technology

With the continuous development of Internet, Internet technology has laid a solid foundation for the implementation of multimedia teaching courseware design. Based on computer Internet resource, multimedia courseware design is paid more and more attention, and Internet multimedia courseware design network frame construction has become one of the urgent problems in the field of education. This paper analyses the access path and method of computer Internet multimedia English courseware resources, on this basis, Web multimedia music courseware students end is constructed based on OMAP590 audio design idea, and build the analysis model of music learning potential curve under the multimedia interactive music courseware interface, to a certain extent to provide theoretical basis and technical support for the multimedia courseware design and music teaching machine assessment.

A Web Service Framework Supporting Multimedia Streaming

The transfer of streaming data is not well supported by current web services standards. To include multimedia streaming support in the web services domain, this paper presents a novel multimedia streaming web services framework for the transfer of streaming multimedia content. First, the framework includes an implementation of a query service for publishing a description of the multimedia content that is input to or output from a multimedia web service. This query service is specified in an extension of WSDL. Using MPEG-7 metadata, content descriptions can be queried before the invocation of a multimedia web service. Second, two new MEPs and their SOAP HTTP bindings are created for the exchange of streaming data between two SOAP endpoints. The implementations of these new MEPs use the MIME multipart/related structure and MTOM packaging when transferring the multimedia packets as SOAP messages. To reduce the transfer overhead introduced by the packaging method, this paper investigated extensively the application of various compression schemes for the SOAP messages as well as for the packaging of the binary packet data. Experiments show that the proposed framework can achieve a performance comparable to a simple HTTP multimedia streaming method.

G56(P) How to Construct Hi-Fidelity Online Medical Device Simulators

ObjectivesI set out to investigate how the workings of a complex medical device could be visually represented and documented on paper, and then be translated into computer code to produce...

From CD-ROM to the WWW: Coming Full Circle

This article describes the challenges faced and solutions adopted in adapting a multimedia-rich CD-ROM program, the Variétés de français program, to operation over the World Wide Web (WWW). While full web functionality offered the promise of flexible network distribution, it also had to confront the dual limitations of multimedia authoring systems and web based programming. In seeking to combine the best of full multimedia programming and centralized WWW mediated delivery, the Variétés de français-WWW program has come full circle to the CD-ROM for its base. The program runs locally to retrieve media resources, perform intelligent answer processing, and data collection and turns to the web only when necessary for data transfer, external WWW links, and electronic communication. Given the current state of the art, the article concludes that such a hybrid solution offers the most effective approach to courseware development.