Integral Imaging Research Articles

ФОРМИРОВАНИЕ МЕНТАЛЬНЫХ РЕПРЕЗЕНТАЦИЙ: НОВЫЙ ПОДХОД К ОБЪЯСНЕНИЮ ПРИРОДЫ АНТИЦИПАЦИОННОЙ ДЕЯТЕЛЬНОСТИ

The systemic functional-regulatory approach played a big role in identifying the general patterns of anticipatory activity and in recognizing anticipation as one of the basic properties of the psyche. From this point of view, the concept of A.A. Ukhtomsky about the integral image, which is an integral part of his doctrine of the dominant as the main system-forming principle of the organization of human behavior and psycheб is of particular interest. The integral image, as a product of the dominant, acts as a kind of anticipatory scheme that predetermines the vector and nature of future activity. The dynamic development of the integral image can be represented as a series of successive and hierarchically organized levels of mental transformation. Ukhtomsky's concept for the first time provides a holistic platform for explaining the nature of anticipating activity and those systemic cognitive deficits that occur in developmental disorders. In this case, the dominant need acts as the main condition for the transition of a sensory image as a certain generalized representation from a potential formation into an active component of the formation of anticipatory schemes of behavior. Created on the basis of a synthesis of natural science and humanities knowledge about human nature, the concept of an integral image is an example of a comprehensive interdisciplinary approach to the problems of studying the basic foundations of human mental activity and can currently act as a new paradigm in the study of anticipation problems.

Fast ACE (FACE): an error-bounded approximation of Automatic Color Equalization.

We present an efficient algorithm to approximate the Automatic Color Equalization (ACE) of an input color image, with an upper-bound on the introduced approximation error. The computation is based on Summed Area Tables and a carefully optimized partitioning of the plane into rectangular regions, resulting in a pseudo-linear asymptotic complexity with the number of pixels (against a quadratic straightforward computation of ACE). Our experimental evaluation confirms both the speedups and high accuracy, reaching lower approximation errors than existing approaches. We provide a publicly available reference implementation of our algorithm.

The Flipping-Free Full-Parallax Tabletop Integral Imaging with Enhanced Viewing Angle Based on Space-Multiplexed Voxel Screen and Compound Lens Array

Tabletop integral imaging display with a more realistic and immersive experience has always been a hot spot in three-dimensional imaging technology, widely used in biomedical imaging and visualization to enhance medical diagnosis. However, the traditional structural characteristics of integral imaging display inevitably introduce the flipping effect outside the effective viewing angle. Here, a full-parallax tabletop integral imaging display without the flipping effect based on space-multiplexed voxel screen and compound lens array is demonstrated, and two holographic functional screens with different parameters are optically designed and fabricated. To eliminate the flipping effect in the reconstruction process, the space-multiplexed voxel screen consisting of a projector array and the holographic functional screen is presented to constrain light beams passing through the corresponding lens. To greatly promote imaging quality within the viewing area, the aspherical structure of the compound lens is optimized to balance the aberrations. It cooperates with the holographic functional screen to modulate the light field spatial distribution. Compared with the simulation results, the distortion rate of the imaging display is reduced to less than 9% from more than 30%. In the experiment, the floating high-quality reconstructed three-dimensional image without the flipping effect can be observed with the correct 3D perception at 96° × 96° viewing angle, where 44,100 viewpoints are employed.

High-speed three-dimensional image pickup system using an event camera and integral imaging

High-speed three-dimensional image pickup system using an event camera and integral imaging

Steformer: Efficient Stereo Image Super-Resolution With Transformer

With the rapid development of stereoscopic vision applications, stereo image processing techniques have attracted increasing attention in both academic and industrial communities. In this paper, we study the fundamental stereo image super-resolution (SR) problem, which aims to recover high-resolution stereo images from low-resolution (LR) stereo images. Since disparities between stereo images vary significantly, convolutional network-based stereo image SR methods show a limitation in capturing long-range dependencies. To address this problem, this paper proposes to leverage the capability of self-attention in Transformers to efficiently capture reliable stereo correspondence and incorporate cross-view information for stereo image SR. Our model, named Steformer, consists of three parts: cross attentive feature extraction, cross-to-intra information integration and high-quality image reconstruction. In particular, the cross attentive feature extraction module employs residual cross Steformer blocks (RCSB) for long-range cross-view information extraction. Then, the cross-to-intra information integration module exploits cross-view and intra-view information using cross-to-intra attention mechanism (C2IAM). Finally, residual Steformer blocks (RSB) are designed for feature pre-processing in high-quality image reconstruction. Extensive experiments show that Steformer achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations, while the total number of parameters can be reduced by up to 40.71%.

Engineering molecular nanoprobes to target early atherosclerosis: Precise diagnostic tools and promising therapeutic carriers.

Atherosclerosis, an inflammation-driven chronic blood vessel disease, is a major contributor to devastating cardiovascular events, bringing serious social and economic burdens. Currently, non-invasive diagnostic and therapeutic techniques in combination with novel nanosized materials as well as established molecular targets are under active investigation to develop integrated molecular imaging approaches, precisely visualizing and/or even effectively reversing early-stage plaques. Besides, mechanistic investigation in the past decades provides many potent candidates extensively involved in the initiation and progression of atherosclerosis. Recent hotly-studied imaging nanoprobes for detecting early plaques mainly including optical nanoprobes, photoacoustic nanoprobes, magnetic resonance nanoprobes, positron emission tomography nanoprobes, and other dual- and multi-modality imaging nanoprobes, have been proven to be surface functionalized with important molecular targets, which occupy tailored physical and biological properties for atherogenesis. Of note, these engineering nanoprobes provide long blood-pool residence and specific molecular targeting, which allows efficient recognition of early-stage atherosclerotic plaques and thereby function as a novel type of precise diagnostic tools as well as potential therapeutic carriers of anti-atherosclerosis drugs. There have been no available nanoprobes applied in the clinics so far, although many newly emerged nanoprobes, as exemplified by aggregation-induced emission nanoprobes and TiO2 nanoprobes, have been tested for cell lines in vitro and atherogenic animal models in vivo, achieving good experimental effects. Therefore, there is an urgent call to translate these preclinical results for nanoprobes into clinical trials. For this reason, this review aims to give an overview of currently investigated nanoprobes in the context of atherosclerosis, summarize relevant published studies showing applications of different kinds of formulated nanoprobes in early detection and reverse of plaques, discuss recent advances and some limitations thereof, and provide some insights into the development of the new generation of more precise and efficient molecular nanoprobes, with a critical property of specifically targeting early atherosclerosis.

АВТОРСЬКИЙ МІФ ВІЛЬЯМА ФОЛКНЕРА: СНОУПСИЗМ vs АМЕРИКАНСЬКА МРІЯ

The article presents an analysis of William Faulkner՚s authorial myth, with a particular focus on the concept of «Snopesism» in the context of the American dream. The aim is to clarify the nature of the mythological component of Faulkner՚s Yoknapatawpha trilogy as a system of perception of America՚s national identity in the context of globalization. The article seeks to determine the author՚s attitude towards the functioning of the myth of the American dream in the conditions of globalization, multiculturalism of American society, and the coexistence of national and global cultures, through the analysis of the true meaning and purpose of the concept of «Snopesism» in the Snopes saga. The analysis of the mythological discourse of Faulkner՚s Yoknapatawpha trilogy sheds light on the functions and role of mythology in the search for national self-identification in the conditions of globalization. Reading Faulkner՚s novels from the perspective of their mythological component holds theoretical significance for understanding the features of modern interpretation and perception of the most widespread and basic myths of the American nation. Faulkner modulates or ignores historical data, but the basic structure of history with three turning points (rise-fall-reconstruction) is evident in his novels. The rise represented the Old South, which Faulkner was nostalgic for, but he did not idealize the plantation myth or the plantation aristocracy. The fall is the Civil War and Reconstruction, which forms a watershed between the Old South and the post-war South of the Snopes and Popeyes. The New South is the third moment, with the rapid development of urbanization and industrialization, and racial and class segregation. Faulkner՚s portrayal of the New South is an artistic study of the emerging class – the Snopes family, who struggled to change their status after the Civil War and Reconstruction. The Snopes represent the white underclass that cared only about profit and status, and for whom the end justified any means. They work their way from a sharecropper՚s shack to the upper echelons of Jeffersonian society through a series of tricks, bravado, lies, fraud, theft, and law-breaking. The article analyses the philosophy of «Snopesism» through each representative of the Snopes family. The article argues that the southern tradition, with its rich arsenal of concepts and images, plays a key role in American society and fiction, defining the main content of moral values that influenced the formation of the national character of Americans. The mythology of the frontier, images of frontier heroes, pioneers, and people who carry out a civilizing mission is one of the elements of the Puritan epic in fiction. Another complex of national mythology is formed on the basis of the concept of the «American dream», which continues to define the features of the American way of life. These three mythological traditions constantly interact and intersect with each other, forming integral mythological images that reflect the peculiarities of American society, the nation, and national heroes. The increasing multiculturalism of American society and globalization significantly affect the nature and content of modern national mythology. However, traditional national myths continue to determine the main vectors of the country՚s national development. Ethnic mythology is transformed into the traditional key mythologemes of the USA. The article concludes that the study of Faulkner՚s novels from the perspective of their mythological component provides significant theoretical insights into the features of modern interpretation and perception of the most widespread and basic myths of the American nation. Keywords: William Faulkner, authorial myth, Yoknapatawpha, Snopes trilogy/saga, American dream, Snopesism, American literature of the South.

РАЗВИТИЕ СЛУХОВОГО ВОСПРИЯТИЯ МУЗЫКАНТОВ-ИНСТРУМЕНТАЛИСТОВ С НАРУШЕНИЯМИ ЗРЕНИЯ

The article focuses on the auditory perception of students with profound visual impairments. The category of "perception" is considered in psychology as a process of reflection in the consciousness of an integral sensual image of an object or phenomenon. In the musical-aural perception of musicians with visual impairments, the subjective image of an object, phenomenon or process directly affects the auditory analyzer, and in a latent form the system of motor and tactile analyzers. Musical sound is understood as a pitch or noise sound, carrying the function of a means of a specific semantic expression. The auditory sensations appear due to the effects of periodic oscillations of sound waves on the auditory receptor. The shape of a sound wave's oscillations is reflected in a specific quality — the timbre of sound. When playing a musical instrument, the performer extracts a sound with a certain pitch, dynamics, timbre and duration. The article emphasizes that the development of musical ear of visually impaired musicians, as the ability to perceive and represent musical images, are inextricably linked to the images of memory. It is important that perceptual skills at the level of sensations and auditory perception are formed and developed under the influence of living conditions, training and the requirements of musical and practical activity.

Aspects of preserving cultural diversity in modern conditions

The paper addresses the issues of preserving cultural diversity on the example of the Chechen Republic. Cultural values play an important role in the development of education, science, cultural life of peoples and cooperation, so each state strives to preserve these values for future generations. Representatives of more than 190 peoples live in the Russian Federation; hence, preservation of cultural diversity is one of the priorities of the state cultural policy. In modern conditions, the cultural diversity of civil nations is increasing, and the peoples are seeking more and more means, including political and legal ones, to preserve and develop their integrity and cultural image. One of the main factors that indicates the state of the ethnopolitical situation and the nature of interethnic relations is the balance of ethnic forces. Owing to stabilization of the socio-political situation in Chechnya, the need for revival of multi-ethnicity as the most important factor and condition for the republic development is a priority. Chechen society includes more than 40 peoples and nationalities. There are 11 national cultural centers and 6 national cultural autonomies in the Chechen Republic. Members of these organizations are actively involved in the public life of the region, promoting traditions and culture of their ethnic group. Modern nations are culturally, religiously and politically more pluralistic than traditional communities that have maintained their unity through fundamental traditions in culture or religion. The ethnocultural policy pursued in the Chechen Republic provides the conditions for representatives of ethnic communities to satisfy their national and cultural needs, and to preserve their religious and national identities.

НАСКАЛЬНЫЕ ИЗОБРАЖЕНИЯ ХОДЖИКЕНТА

The limestone rock with petroglyphs in the village of Khodzikent (Uzbek: Xo'jakent) is one of the most well-known and accessible rock art sites of Uzbekistan, with a rich history of discovery and study. The first mentions of signs on the rock have been known in print since 1879, but the systematic study of rock images has been organized by many researchers since the middle of the 20th century, such as H.A. Alpysbaev, G.V. Parfenov, G.V. Shatsky, D. Kabirov, M.M. Khuzhanazarov, etc. In addition to the published data, this work includes unique archival materials that shed new light on the research of the Khodzikent petroglyphs by the Bostandyk archaeological team led by G.V. Parfenov. The analysis of historiographical materials reveals a number of controversial issues related primarily to the quality of fixation of pictorial sources and discrepancies in their chronological attribution. A continuous survey of promising sites and a documentation technique, developed taking into account the specifics of the Khodzikent petroglyphs (the smoothness of their contours), allowed the authors to obtain qualitatively new results: to identify a previously unknown surface with the image of a “rosette”, fix 119 rock images on the “central” rock and determine the sequence of their creation using palimpsests and planigraphy analysis, reflect in digital drawings an integral image of the site of rock art. The relative chronology and analysis of iconography and the pictorial series indicate a possible broad chronological framework for the creation of Khodzikent rock images: from the Eneolithic to the early Middle Ages.

Monochromatic Integral Image Identification Based on Adaboost and Viola-Jones Classifier

Monochromatic Integral Image Identification Based on Adaboost and Viola-Jones Classifier

Illumination-Insensitive Binary Descriptor for Visual Measurement Based on Local Inter-Patch Invariance

Binary feature descriptors have been widely used in various visual measurement tasks, particularly those with limited computing resources and storage capacities. Existing binary descriptors may not perform well for long-term visual measurement tasks due to their sensitivity to illumination variations. It can be observed that when image illumination changes dramatically, the relative relationship among local patches mostly remains intact. Based on the observation, consequently, this study presents an illumination-insensitive binary (IIB) descriptor by leveraging the local inter-patch invariance exhibited in multiple spatial granularities to deal with unfavorable illumination variations. By taking advantage of integral images for local patch feature computation, a highly efficient IIB descriptor is achieved. It can encode scalable features in multiple spatial granularities, thus facilitating a computationally efficient hierarchical matching from coarse to fine. Moreover, the IIB descriptor can also apply to other types of image data, such as depth maps and semantic segmentation results, when available in some applications. Numerical experiments on both natural and synthetic datasets reveal that the proposed IIB descriptor outperforms state-of-the-art binary descriptors and some testing float descriptors. The proposed IIB descriptor has also been successfully employed in a demo system for long-term visual localization. The code <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> of the IIB descriptor will be publicly available.

Source Rendering Platform for Splicing Realized Integral Imaging Light Field 3D Display

Source Rendering Platform for Splicing Realized Integral Imaging Light Field 3D Display

Compression and reconstruction of photon counting integral imaging

集成成像技术作为一种重要的裸眼三维显示技术，在完整记录三维场景信息的同时，庞大的数据量给传输和存储带来了压力。为了实现图像的有效压缩和重构，根据光子计数集成成像的特点，基于分布式压缩感知理论，提出用于图像压缩与重构的方案。该方案将图像分为参考图像和非参考图像两类，对其设置不同的测量率并分别进行重构。为保证非参考图像的重构质量，提出一种联合重构算法。该算法首先对非参考图像进行分块测量，依据与参考图像之间的相关性进行图像块分类，然后结合参考图像测量值信息构建新的测量矢量，利用新的测量矢量完成初次图像重构。为了进一步提升图像重构质量，对初次重构结果进行二次残差补偿重构，获得最终重构结果。最后通过设置不同的测量率进行了大量实验，实验结果表明，所提算法在测量率为0.25时，图像重构质量可以达到30 dB，测量率为0.4时，图像质量可以达到35 dB，算法性能具有一定的优越性。

Imaging-Based Versus Pathologic Survival Stratifications of Diffuse Glioma According to the 2021 WHO Classification System.

Imaging-based survival stratification of patients with gliomas is important for their management, and the 2021 WHO classification system must be clinically tested. The aim of this study was to compare integrative imaging- and pathology-based methods for survival stratification of patients with diffuse glioma. This study included diffuse glioma cases from The Cancer Genome Atlas (training set: 141 patients) and Asan Medical Center (validation set: 131 patients). Two neuroradiologists analyzed presurgical CT and MRI to assign gliomas to five imaging-based risk subgroups (1 to 5) according to well-known imaging phenotypes (e.g., T2/FLAIR mismatch) and recategorized them into three imaging-based risk groups, according to the 2021 WHO classification: group 1 (corresponding to risk subgroup 1, indicating oligodendroglioma, isocitrate dehydrogenase [IDH]-mutant, and 1p19q-co-deleted), group 2 (risk subgroups 2 and 3, indicating astrocytoma, IDH-mutant), and group 3 (risk subgroups 4 and 5, indicating glioblastoma, IDHwt). The progression-free survival (PFS) and overall survival (OS) were estimated for each imaging risk group, subgroup, and pathological diagnosis. Time-dependent area-under-the receiver operating characteristic analysis (AUC) was used to compare the performance between imaging-based and pathology-based survival model. Both OS and PFS were stratified according to the five imaging-based risk subgroups (P < 0.001) and three imaging-based risk groups (P < 0.001). The three imaging-based groups showed high performance in predicting PFS at one-year (AUC, 0.787) and five-years (AUC, 0.823), which was similar to that of the pathology-based prediction of PFS (AUC of 0.785 and 0.837). Combined with clinical predictors, the performance of the imaging-based survival model for 1- and 3-year PFS (AUC 0.813 and 0.921) was similar to that of the pathology-based survival model (AUC 0.839 and 0.889). Imaging-based survival stratification according to the 2021 WHO classification demonstrated a performance similar to that of pathology-based survival stratification, especially in predicting PFS.

"ИМПЕРСКИЙ ПОВОРОТ" В ИЗУЧЕНИИ РОССИЙСКОЙ ИСТОРИИ: СОВРЕМЕННЫЕ ИНТЕРПРЕТАЦИИ

The article analyzes a new direction in modern historiography, called the “imperial turn”. As a result of “imperial research”, an integral image of the Russian Empire is constructed throughout its historical existence, which, according to modern interpretations, covers the period from the second half of the 15th century until 1917. Researchers focus not only on the western outskirts, the Volga region, the Caucasus and Central Asia, traditional for imperial studies of Russia, but also on the Russian-Chinese borderlands and Russian America. The modern historiography of imperial Russia considers and analyzes such controversial issues as “Russia and the West”, “Russia and the East”, the degree of uniqueness of Russian imperialism, the concept of “internal colonization”, the role of rising nationalism in the collapse of empires during the First World War. The Russian Revolution in the “imperial” context is positioned as one of the results of the Great War: the revolution of 1917 in Russia became only a link in the global crisis of the twentieth century. As a result, in modern historiography “the threshold of the revolution” is of less and less interest to historians. Their attention is focused on previous centuries and on the Soviet era. They do not argue about the crisis of the Russian Empire, do not question it, do not look for alternatives or those responsible for it. The presence of a crisis is simply stated, believing that the fall of the monarchy could not be avoided, and this reality should be historicized.

СВЕРДЛОВСК ВОЕННЫХ ЛЕТ ГЛАЗАМИ ОЧЕВИДЦЕВ

Taking into account the experience of creating an image of the Urals in the war years’ literature, the article explores how not only consolidation but clarification and extending both general and specific moments of life and destiny of Sverdlovsk in the years of war took place in the following decades. The main methods of philological reconstruction of the changing image of Sverdlovsk are historic-functional and genre methods. It is shown that the genre palette changes significantly: publicist prose, dominant in the war years, is complemented by the genre of oral narrative, literally processed or present in the author’s version, as well as by а huge variety of memoirs and autobiographical literature. The main aims of these texts are imprinting and preservation of memory. It is noted that between the particular personal memory and the established system of state “politics of memory,” a complicated dialogical relationship is created. It can be based on the principles of complete understanding, when it comes to uniting around the slogan “All for the Victory”, or on the principles of important supplement, when witnesses of wartime everyday life in Sverdlovsk remember, what was the price for the Victory for them personally. Different genre optics, including variants of ego-documents, memoirs, fiction, and various generational and social identities of the actors create the multifaceted and integral image of Sverdlovsk, consisting at least of three components: appearance, way of life, and socio-psychological portrait of the city.

Semiosis of Political Action

Aristotle, calling man “political by nature,” predetermined the actual opportunity to consider politics through the prism of practical action, through specific ways of equitable arrangement of public life. Thrown into a digital existence, where the ambivalent task of realizing one’s vulnerable position arises, exposing oneself to risk, while simultaneously navigating the indefinite space of a dynamically developing community. The modern territory of politics is being mastered by actants with the help of a renewed arsenal of means, taking into account the meaning of design (de + signare), the signs of which acquire multiplication of ideas about complexly organized integrity of its image. Integration ties of semiosis “sew through” the heterotopy of the renewed territory of political action, putting down the chronological framework of events in sign expression (index, symbol, code, number), to compare and supplement possible transformational semiotic shifts and confusions, thus creating a plausible and recognizable semiotic image of the current state of affairs in society. Semiotic representation emphasizes the sign, symbolic nature of political action as a political event, realized by its subject in the process of normogenesis and anchored in the pragmatics of everyday activity. Conditional analytical dismemberment of the process of semiosis (syntactics, semantics, pragmatics) of political action initiates the synchronization of methodological synthesis, which leads to the co-creation of the subject and structure at the level of reflective analysis. This allows us to add the “included third”, traditional for the transdisciplinary methodological approach, into the agent-structure dichotomy, which is classic for the science of politics, serving as a target reason for creating integral image of political action. It should be noted that the “included third” as the target cause does not guarantee the unambiguity of the outcome of the formation of the specified action, but only adjusts the optics of tracking its possible configurations, taking into account both contextual and environmental conditionality.

VISUALIZATION OF ETHNICITY IN THE ARCHITECTURAL ENVIRONMENT OF SMALL AND MEDIUM-SIZED RUSSIAN CITIES

The article discusses the features of ethnicity visualization in the architectural environment of small and medium-sized Russian cities on the example of the analysis of materials of the All-Russian competition for the best projects for creating a comfortable urban environment in 2018-2021. The competition materials are in the public domain and represent a database that includes both textual and visual justification of projects, their architectural and design solutions. 58 projects were selected for analysis, the concept of which uses ethnicity. The analysis of visualization of ethnicity is carried out on the basis of a functional and semiotic approach: design solutions are considered as an integral information-sign structure, as a narrative that has a beginning, a culmination and an ending. The logic of the analysis of ways to visualize the ethnicity follows the logic of textual and graphic presentation of the thematic blocks of applications. The justification of any concept begins with revealing the identity, including ethnic one, the place and then determining the identity and specific design and architectural solutions designed to visualize the identified ethnic features in a material or figurative form. The basis for ethnic identification of both the place of improvement and its inhabitants is identification with the ethnic history and ethnic composition of the population, with local legends and myths, as well as with the natural, folklore and ethnographic features of the territory and its inhabitants. Depending on how ethnicity is understood, what place and role it is given in the concepts, as well as what elements of ethnicity are used in specific design solutions in textual and graphical form, four groups of projects and, accordingly, four conditional types of ethnicity visualization are identified and considered. The first type uses a complex of several ethnic characteristics that make up an integral complete ethno-cultural image, which is the basis of the whole concept. The second type refers to one or more ethnic characteristics that reinforce the main project-forming idea. In the third type, ethnic characteristics are used most effectively, from the point of view of the authors of the projects, representing the ethno-cultural diversity of the city. Finally, the fourth type uses visual images to a lesser extent, but also refers to ethnic identification through indirect associations with various ethnic and ethno-cultural characteristics.

Integral imaging 3D display with enhanced viewing angle using two tilted folding mirrors

We propose a viewing-angle-enhanced integral imaging (InI) 3D display using two tilted folding mirrors. The tilted folding mirror generates a corresponding additional virtual tilted micro lens array (MLA) adjacent to the real MLA, which is similar to a curved MLA structure. The two virtual tilted MLAs emit tilted light beams with larger tilt angles than conventional InI, which results in an enhanced viewing angle. A modified elemental image synthesis algorithm is proposed to match the proposed scheme. Visualization simulation and optical experiment are performed to verify the proposed method.