RETRACTED: Intelligent digital art design fusion platform based on multimodal transformation
With the continuous advancement of artificial intelligence technology, intelligent digital art design gradually integrates multi-modal data, such as images, text, and audio, in the creative process, improving the creativity and efficiency of design. Traditional art design platforms have problems such as insufficient information fusion and low creative efficiency when dealing with multi-modal data. In order to solve these challenges, this paper proposes an intelligent digital art design fusion platform based on multi-modal Transformer, which effectively fuses data of different modalities through the multi-modal Transformer architecture to improve creative efficiency and work quality. The proposed multi-modal Transformer framework is a novel approach to digital art creation, overcoming traditional limitations of single-modal platforms by integrating image, text, and audio. This multi-modal fusion significantly enhances creative efficiency by 33.3% and creativity by improving both the diversity and expressiveness of the generated artworks, primarily within a unified image resolution framework. However, the current platform is optimized for fixed resolution image generation. Handling mixed resolutions or modified images (in pixel or grid formats) presents challenges, particularly in maintaining output integrity. This limitation is recognized and will be addressed in future work through adaptive resolution techniques. The innovation lies in effectively leveraging the self-attention mechanism to balance the computational load while enriching creative outputs, addressing both artistic and technological challenges. Specific data analysis shows that the average time of three-modal fusion creation design is 80 min, while that of single-modal creation is 120 min, which proves the significant advantages of multi-modal fusion in accelerating design creation. In addition, the platform has also achieved good results in the quality of creation, and the creative score has increased by about 25% compared with the traditional platform.
- Research Article
- 10.1515/comp-2024-0012
- Oct 29, 2024
- Open Computer Science
At present, digital media art and environmental design industries are rising in various fields, making art design a popular major. In the era of artificial intelligence (AI), the establishment of public cloud Internet of things in universities and improving the security of design information will help the integration of digital media art and environmental art design, and improve the efficiency of digital media art and environmental design. This article first explains the principles and existing problems of virtual reality (VR) technology, digital media art, and environmental design, then uses AI algorithm to integrate digital media art and environmental design, and finally analyzes the impact of the integration of digital media art and environmental design based on VR technology. The results show that the satisfaction of the integration of digital media art and environmental design based on VR technology has increased by 8.77%. In addition, VR technology also improves the speed of integration of digital multimedia art and environmental design, as well as the added value and design quality of design works. In short, the use of VR technology can better promote the integration of digital multimedia art and environmental design.
- Book Chapter
- 10.3233/faia250275
- Mar 31, 2025
- Frontiers in artificial intelligence and applications
In order to solve the problem of low efficiency and quality of enterprise software engineering talent cultivation, the design of personalized cultivation program for enterprise digital talents based on intelligent learning platform is proposed. The design adopts a layered design method, combined with artificial intelligence algorithms, and develops a platform containing functional modules such as course management, student learning tracking, interaction and feedback, data analysis and reporting. In order to verify the effectiveness and performance of the intelligent platform, professional testing software is used to test the functionality and performance of the platform and the traditional platform. The experimental results show that the functional coverage of the intelligentized platform reaches 98.0% (higher than the 92.0% of the traditional platform), and the error discovery rate is 0.5% (lower than the 2.3% of the traditional platform), which indicates that it has higher stability and reliability. In terms of test pass rate, the platform is 99.5% compared to 96.0% for traditional platforms, reflecting the high usability of the platform. In the performance test, under the simulated scenario of 1,000 concurrent users, the average response time of the platform is 1.2s, while the traditional platform is 2.5s, reflecting the significant performance advantage of the platform. In terms of system throughput, the platform can handle 1500 requests per second, which is higher than the traditional platform. In terms of resource utilization, the utilization rates of the CPU and memory of the platform under high load are 70.0% and 65.0% respectively, while those of the traditional platform are as high as 85.0% and 80.0% respectively, indicating that the platform is more efficient in resource management. Conclusion: The intelligent platform outperforms the traditional platform in terms of function coverage, error detection rate, system throughput and other key indexes, which verifies its effectiveness and performance advantages in the modern education environment.
- Research Article
1
- 10.32629/jai.v7i5.1663
- Jun 6, 2024
- Journal of Autonomous Intelligence
<p>Through an in-depth analysis and evaluation of digital design in traditional graphic art, this paper focuses specifically on how blockchain can enhance the digital representation and management of these designs. The integration of AI and digital design art is taking a major leap forward, breathing new life into traditional cultural elements by harnessing AI's capabilities to create immersive interactive experiences. This paper uses fuzzy comprehensive evaluation method to evaluate the digital design of classic pattern art, highlighting the richness, interest, innovation and digitalization of pattern. Blockchain technology provides a secure and decentralized platform for the storage and verification of digital graphic art, preserving the cultural and artistic value of the design. By linking digital design to blockchain, we can create a transparent and verifiable record of the creation and ownership of each artwork, promoting ethical practices in the digital art market. The study shows that the combination of VR and AR with blockchain technology not only revolutionizes the way traditional Chinese pictorial paintings are perceived and appreciated, but also provides a powerful framework for managing and protecting related digital assets. The final scores obtained through the fuzzy comprehensive evaluation - 86.17 for richness, 89.24 for liking, 90.61 for innovation, and 91.38 for digitalization - underscore the significant advantages that the application of these technologies brings to the digital design of traditional pattern art.In conclusion, the application of blockchain technology in the realm of digital design of traditional pattern art is not merely a technological advancement but a cultural and ethical imperative. It ensures the preservation of traditional art forms in their digital manifestations, while also opening up new avenues for innovation and global appreciation.</p>
- Research Article
4
- 10.1155/2022/2901815
- Jul 6, 2022
- Advances in Multimedia
With the development of the times, figurative expressions no longer meet the creative needs of artists and the aesthetic demands of the people. In order to express art in a more profound way, the perfect use of abstract graphics plays a crucial role in the success of the work. In recent years, there has been a surge in the creation of digital art, but there is relatively little theoretical literature on the combination of abstract graphics as a visual language and digital art. In addition, research on the theoretical aspects of digital art design is also relatively weak, so it is essential to analyse the formal aesthetics and innovative applications. In fact, digital art design has a very important role to play in promoting the development of creative cultural industries. In other words, the healthy development of digital art design can influence the future prospects of a country’s creative and cultural industries. Digital art design is an integrated and complex production process and labour outcome. In addition to its human, aesthetic, and social value, digital art also has an economic value. Digital art is a new art form that combines digital technology and artistic aesthetics. As such, digital art is characterised by high technology, diverse forms, popularised art, and the advantages of high communication, interactivity, and influence, which can provide more assistance for the innovation and application of abstract graphics. Digital art is multifaceted and has an artistic expression that cannot be matched by other forms of technology. Abstract graphics, driven by digital art, are full of novelty and interest and can greatly enrich people’s emotions and senses. Abstract graphics bring the experience of digital art to its fullest potential. The combination of digital art and abstract graphics offers more innovation and possibilities for the development of art and will bring great prosperity to art communication. With the widespread use of computer and network technology, the Internet has developed rapidly. In this context, digital art, as art created in a digital way and concept, has gained widespread attention. As a result, how to integrate existing computer resources in the new environment to build a model of digital art design effectiveness will cause a direct influence on the quality of digital art design with digital content innovation as the core. At the same time, as digital art becomes more and more popular, the demand for digital talents becomes very urgent. As a result, the cultivation of high-quality digital talents has become a major concern for society. Therefore, in order to explore the success of digital art design and the cultivation of digital art talents, and to better serve the innovation of digital art, this paper proposes a digital art effectiveness model based on the K-medoids algorithm. This model can provide a deeper and more comprehensive understanding of digital art and abstract graphics and provide theoretical support for professional design creation.
- Research Article
59
- 10.1016/j.neucom.2023.127181
- Dec 29, 2023
- Neurocomputing
Multimodal transformer with adaptive modality weighting for multimodal sentiment analysis
- Research Article
20
- 10.3390/rs15030650
- Jan 21, 2023
- Remote Sensing
In recent years, there have been many multimodal works in the field of remote sensing, and most of them have achieved good results in the task of land-cover classification. However, multi-scale information is seldom considered in the multi-modal fusion process. Secondly, the multimodal fusion task rarely considers the application of attention mechanism, resulting in a weak representation of the fused feature. In order to better use the multimodal data and reduce the losses caused by the fusion of different modalities, we proposed a TRMSF (Transformer and Multi-scale fusion) network for land-cover classification based on HSI (hyperspectral images) and LiDAR (Light Detection and Ranging) images joint classification. The network enhances multimodal information fusion ability by the method of attention mechanism from Transformer and enhancement using multi-scale information to fuse features from different modal structures. The network consists of three parts: multi-scale attention enhancement module (MSAE), multimodality fusion module (MMF) and multi-output module (MOM). MSAE enhances the ability of feature representation from extracting different multi-scale features of HSI, which are used to fuse with LiDAR feature, respectively. MMF integrates the data of different modalities through attention mechanism, thereby reducing the loss caused by the data fusion of different modal structures. MOM optimizes the network by controlling different outputs and enhances the stability of the results. The experimental results show that the proposed network is effective in multimodality joint classification.
- Research Article
18
- 10.32919/uesit.2021.01.01
- Mar 31, 2021
- Ukrainian Journal of Educational Studies and Information Technology
The development of digital technologies leads to a variety of pictorial arts. With the advent of computer technology and communication technologies, areas such as computer graphics, computer and digital design, and phenomena such as digital art have emerged. The article analyzes these concepts, which provided an opportunity for further study. Based on the analysis of Internet resources on digital art, the following main trends are identified: virtual art, 3D printing, open source software, art of artificial intelligence, a combination of 2D animation and modern technologies, 3D painting, UX / UI design, game design, concept art and character design. Examples of reflection these tendencies in modern art are given. Given the selected trends, it is shown how they affect the content of training in computer graphics and digital design for students of the educational program "Digital Design" (list of compulsory and optional educational components, the content of educational practice). It is noted that to successfully work with computer graphics, students need to master traditional knowledge of pictorial arts (the concept of composition, color, perspective, proportions, shadows) and the ability to use them to create digital products using computer programs (2D graphic editors and 3D graphics) and digital technology (graphics tablet, personal and personal computer, projection equipment, camera, devices for VR and AR reality, scanner and printer, including 3D scanner and 3D printer).
- Research Article
- 10.7575/aiac.ijels.v.13n.2p.397
- Apr 4, 2025
- International Journal of Education and Literacy Studies
The objectives of the research are: (1) to study the images, events of fairy tales and legends, (2) to study creative design of artworks from fairy tales, (3) to present paintings for digital distribution and literacy. This study is a qualitative research. A qualitative study is conducted using multiple regions of Chinese fairy tales and legends as the research object. The research data are collected through relevant literature, related books and research papers. The research tools include survey method, observation method, interview method and focus group discussion to collect data and information. The population and sample of the study consisted of 40 people, and the data are analyzed using concepts and theories. The results of the research are presented through descriptive analysis. The results of the research are as follows: Firstly, to study the origin, background and development of Chinese fairy tales and legends; images and events. Secondly, to analyze the characteristics, styles, and techniques of expression of Medieval painting art; artists and works of Medieval painting art, applying them to the creative design of artworks. As well as analyzing and applying the concepts of Digital media art and Digital illustration design. Finally, combining the integration of Digital media technology and art, presenting fairy tales and legends through Digital art, and dissemination of innovative paintings on electronic media and literacy. In conclusion, the combination of Chinese fairy tales and legends and Medieval painting art can produce a unique visual language and visual effect in Digital art. This application makes Chinese fairy tales and legends easier to understand and appreciate, and expands the inheritance and dissemination of Chinese fairy tales and legends.
- Research Article
1
- 10.54097/ajst.v6i1.9024
- Jun 2, 2023
- Academic Journal of Science and Technology
As a cutting-edge field, holographic imaging has developed rapidly. It is widely used in stage performances, commercial displays, and other aspects. While enriching the visual language of contemporary art and design, it also reflects its widespread application value. From the perspective of children's psychological healing, innovative research methods are used to provide new design applications for the art design of public spaces in children's hospitals through holographic imaging technology, and to contribute development ideas to design innovation in this field. With the rapid development of China's society and economy, as well as the opening up of national population policies, the healthy growth of young children is increasingly receiving widespread attention. As a special group, children involve various aspects such as society, culture, education, psychology, etc. The integration of art into children's medical environment forms an important part of modern hospital design, which directly affects the rehabilitation effect of children and the medical level of the hospital. This article focuses on conducting in-depth healing research by combining the physical and mental characteristics, cognition, and contemporary aesthetic language of children. Under the support of children's psychology theory, explore the new application of holographic imaging technology in children's hospital space. Apply holographic stage technology to the innovative design of children's activity centers in children's hospitals. Utilize holographic stage cartoon images to enhance emotional communication and interaction among children, create a space for artistic healing, inject cultural connotations into children's hospitals, and achieve the goal of happy medical treatment for children. Extract design concepts and overall solutions for interactive experience, spatial environment, artistic healing, emotional care, and other aspects. Through innovative digital media art design, a new application experience has been formed in medical space art, media and other designs, optimizing children's medical spaces, and providing useful reference and reference for the development of children's medical design and digital media art design in China.
- Conference Article
3
- 10.1117/12.2659085
- Nov 23, 2022
The digital media interactive installation art takes the computer software and hardware as the platform, forms a four-dimensional space-time through the installation media, introduces the action and participants into the simulated virtual environment, and interacts with the art works by stimulating the participants' hearing, vision, touch and smell. With the development of the digital age, digital media interactive installation art design has become an important direction in the field of art design. Especially today, when green design is advocated, it is necessary to introduce the concepts of green, energy saving, ecology and environmental protection into the digital media interactive installation art design, so as to enhance the core value of installation art design. This paper discusses the art design principles, design elements and design applications of digital media interactive devices based on green design.
- Research Article
7
- 10.2478/amns.2023.2.01684
- Dec 27, 2023
- Applied Mathematics and Nonlinear Sciences
Cultural and creative industry is one of the main fields of digital art element design, and this paper utilizes digital art design for visualization programming of cultural and creative works. Through the three elements of 3D model, registration method and animation composition, the intelligent design process of AR cultural and creative products is defined, and the editing process of AR cultural and creative products is sorted out on this basis. Construct the model of cultural and creative products containing digital art elements, solve the problem of inconsistency between the coordinates and the model network appearing in the modeling, and then carry out the back-end design processing for AR cultural and creative products editing, which constitutes the whole back-end module through real-time methods and multiple trigger events. Through the method of empirical analysis, the feasibility of adding digital art elements to cultural and creative products, the consumers’ willingness to purchase cultural and creative products, and the innovation performance of cultural and creative products are analyzed. In the test of the moderating effect of the intelligent design of digital art elements on the cultural and creative products, the performance of the cultural and creative products improves synchronously with the embedding of the digital art elements, and the mean value finally stays at 0.375, and all the straight lines are above zero.
- Research Article
1
- 10.32629/rerr.v6i5.2156
- Jun 6, 2024
- Region - Educational Research and Reviews
With the rapid advancement of technology, holographic imaging technology has also developed rapidly, bringing unprecedented creativity and expressive methods to digital media art design. This paper explores the impact of holographic imaging technology on digital media art design. The analysis is divided into four parts: the first part introduces the definitions and current trends of holographic imaging technology and digital media art design; the second part discusses the relevance of holographic imaging art to digital media art design, analyzing their technical and artistic complementarity; the third part focuses on the impact of holographic imaging technology on digital media art design, exploring innovations in visual effects, artistic creation processes, and audience interaction methods; the fourth part showcases the practical applications of holographic imaging technology in digital media art design through specific cases in photography, art exhibitions, virtual advertising, and 3D movies. This paper aims to reveal the importance and potential development directions of holographic imaging technology in future artistic creation and audience experience by analyzing its application and impact in digital media art design.
- Conference Article
4
- 10.1109/is48319.2020.9200112
- Aug 1, 2020
In recent years, the number of users of socio-cyber-physical systems, smart spaces, and the Internet of things systems has increased. This fact actualizes the problem of automatic recognition of destructive behavior of users, such as aggression. Users behavior in socio-cyber-physical systems can be represented in different modalities: facial expressions, motor activity of human body, non-verbal speech behavior, verbal speech behavior. This work considers possible methods and conceptual models of data fusion of various modalities in human aggression recognition task. All the considering methods are based on the transfer learning approach and multimodal data fusion, which forms a latent space. Three methods of multimodal data fusion are described: the first method is based on principal component analysis and singular value decomposition, the second method is based on a neural net-work (NN) that process data of different modalities simultaneously, and the third method is based on an NN that process data of different modalities separately. The conceptual models and mathematical description of the considering methods as well as key aspects of data processing and the main features of the forming la-tent spaces are provided.
- Conference Article
- 10.1109/actce66599.2025.00016
- Sep 27, 2025
With the vigorous development of digital trade, the platform has accumulated a huge amount of multimodal data, including text, images, audio and video. The diversity and complexity of these data bring great challenges to data integration and utilization. Firstly, this paper analyzes the data characteristics of German digital trading platform, and points out that its data sources are extensive, diverse and huge. Then, the technical framework of multimodal data fusion (MDF) based on deep learning is introduced in detail, covering key links such as data preprocessing, feature extraction, multimodal data fusion and model training and optimization. In the data preprocessing stage, clean and annotate data of different modalities; In the feature extraction process, pre trained language models such as GPT, Convolutional Neural Network (CNN), and Conv Recurrent Neural Network (Conv RNN) are used to process text, image, and audio/video data; In the fusion stage, the method based on attention mechanism is used to calculate the weights between different modal features to achieve effective fusion; Finally, the multi-modal Transformer architecture is used to train the model, and the performance of the model is optimized by means of cross entropy loss function, Adam optimization algorithm and L2 regularization. Through practical application cases, this paper shows the remarkable effect of MDF technology in the product recommendation system of German digital trading platform. After the application of the technology, the time for users to find their favorite products has been greatly shortened, the operating efficiency of the platform has been significantly improved, the operating cost has been reduced, and the user satisfaction has also been improved, especially in the accuracy and personalization of product recommendation. This fully proves that MDF technology has great application potential and value in digital trading platform.
- Research Article
1
- 10.1088/1742-6596/1693/1/012086
- Dec 1, 2020
- Journal of Physics: Conference Series
In order to solve the problem of poor operation effect of traditional artificial intelligence platform, a cloud-based collaborative artificial intelligence platform construction and design method is proposed. The platform operation efficiency is improved by optimizing the cloud edge cooperative integration architecture and improving the platform configuration function. At the same time, the cloud-side collaborative data edge algorithm is optimized. Through denoising, clustering and iterative processing of data information, the interference noise in the data processing process is eliminated, and the problem of poor data effect is solved, thus ensuring the stable operation of the cloud-side collaborative artificial intelligence platform. Finally, the experiment proves that compared with the traditional intelligent platform, the operation effect and efficiency of the cloud-based collaborative artificial intelligence platform are obviously improved, which fully meets the research requirements.