Audiovisual Objects Research Articles

The challenges of media and information literacy in the artificial intelligence ecology: deepfakes and misinformation

In the ecosystem of artificial intelligence (AI), generative models enable the creation of hyper-realistic manipulations that are extremely plausible due to the precision of the audiovisual objects. These deepfakes are undetectable thanks to their components, which heightens concerns about the distortion of reality in the information ecosystem and how the ability to distinguish between real and fake audiovisual content affects public trust and democratic systems. This is a major challenge for media and information literacy if it is to combat misinfor­mation effectively. In this context, this study presents the results of a quasi-experiment conducted with 80 young people from the Community of Madrid (Spain) to assess their ability to detect deepfakes in immersive environments and to establish whether the context-identifying elements that enable detection of the reputation of the media source shape the credibility of the images. The results show that the images take precedence over the context identifiers, preventing a critical reading of the information that would make it possible to detect visual forgeries, something that is reinforced by their exceptional verisimilitude. It is concluded that the new post-humanist biome of virtual reality and artificial intelligence requires a reorien­tation of media and information literacy to raise the public’s awareness and educate them to make them less susceptible to disinformation based on deepfakes created with generative models.

An Audiovisual Correlation Matching Method Based on Fine-Grained Emotion and Feature Fusion.

Most existing intelligent editing tools for music and video rely on the cross-modal matching technology of the affective consistency or the similarity of feature representations. However, these methods are not fully applicable to complex audiovisual matching scenarios, resulting in low matching accuracy and suboptimal audience perceptual effects due to ambiguous matching rules and associated factors. To address these limitations, this paper focuses on both the similarity and integration of affective distribution for the artistic audiovisual works of movie and television video and music. Based on the rich emotional perception elements, we propose a hybrid matching model based on feature canonical correlation analysis (CCA) and fine-grained affective similarity. The model refines KCCA fusion features by analyzing both matched and unmatched music-video pairs. Subsequently, the model employs XGBoost to predict relevance and to compute similarity by considering fine-grained affective semantic distance as well as affective factor distance. Ultimately, the matching prediction values are obtained through weight allocation. Experimental results on a self-built dataset demonstrate that the proposed affective matching model balances feature parameters and affective semantic cognitions, yielding relatively high prediction accuracy and better subjective experience of audiovisual association. This paper is crucial for exploring the affective association mechanisms of audiovisual objects from a sensory perspective and improving related intelligent tools, thereby offering a novel technical approach to retrieval and matching in music-video editing.

Interaction of spatial attention and the associated reward value of audiovisual objects

Reward value and selective attention both enhance the representation of sensory stimuli at the earliest stages of processing. It is still debated whether and how reward-driven and attentional mechanisms interact to influence perception. Here we ask whether the interaction between reward value and selective attention depends on the sensory modality through which the reward information is conveyed. Human participants first learned the reward value of uni-modal visual and auditory stimuli during a conditioning phase. Subsequently, they performed a target detection task on bimodal stimuli containing a previously rewarded stimulus in one, both, or neither of the modalities. Additionally, participants were required to focus their attention on one side and only report targets on the attended side. Our results showed a strong modulation of visual and auditory event-related potentials (ERPs) by spatial attention. We found no main effect of reward value but importantly we found an interaction effect as the strength of attentional modulation of the ERPs was significantly affected by the reward value. When reward effects were examined separately with respect to each modality, auditory value-driven modulation of attention was found to dominate the ERP effects whereas visual reward value on its own led to no effect, likely due to its interference with the target processing. These results inspire a two-stage model where first the salience of a high reward stimulus is enhanced on a local priority map specific to each sensory modality, and at a second stage reward value and top-down attentional mechanisms are integrated across sensory modalities to affect perception.

Multisensory processing impacts memory for objects and their sources.

Multisensory object processing improves recognition memory for individual objects, but its impact on memory for neighboring visual objects and scene context remains largely unknown. It is therefore unclear how multisensory processing impacts episodic memory for information outside of the object itself. We conducted three experiments to test the prediction that the presence of audiovisual objects at encoding would improve memory for nearby visual objects, and improve memory for the environmental context in which they occurred. In Experiments 1a and 1b, participants viewed audiovisual-visual object pairs or visual-visual object pairs with a control sound during encoding and were subsequently tested on their memory for each object individually. In Experiment 2, objects were paired with semantically congruent or meaningless control sounds and appeared within four different scene environments. Memory for the environment was tested. Results from Experiments 1a and 1b showed that encoding a congruent audiovisual object did not significantly benefit memory for neighboring visual objects, but Experiment 2 showed that encoding a congruent audiovisual object did improve memory for the environments in which those objects were encoded. These findings suggest that multisensory processing can influence memory beyond the objects themselves and that it has a unique role in episodic memory formation. This is particularly important for understanding how memories and associations are formed in real-world situations, in which objects and their surroundings are often multimodal.

The End of American Exceptionalism Through Two Family Sagas: Breaking Bad and Ozark in the Face of Neoliberal Collapse

When commenting on the politics of Breaking Bad (Gilligan, 2008-2013), on the capacity of this extremely popular TV series to capture the crisis of the American dream and of the heteropatriarchal family, Mark Fisher (2013) asked to imagine the events of the story to be set in a country with well-structured welfare, and specifically health-focused, institutions. In this hypothetical scenario, after the revelation that Walter White (Bryan Cranston), notable main character, was affected by a lethal lung cancer, the doctor would have only added that the free treatment was going to start soon; end of the story, problem solved (at least the most urgent one). No moral dilemma, no character’s arc describing a tragic trajectory of always bloodier moral compromises; Heisenberg, the drug kingpin acting as alter ego of the protagonist, and revelation of the multiple sides of his personality, would have never been born: no rise of his criminal status and success, fall, and final partial redemption would follow as well. This simple thought experiment shows us how easy is to connect fictional scenarios, dramatic situations, characters, and tropes with a larger social context, in order to map and identify the ways they may reflect contextual anxieties, fears, and affective tensions. At the same time, understanding and highlighting this link is also helpful for the purpose of evaluating the ways in which a specific audiovisual object dialogues with a larger ecology of emotions, concepts, social and political ideas, while contributing in changing the landscape where it operates.

INTERMEDIA NARRATIVE AND PERCEPTIO SENSATIO IN MUSIC CHOREOGRAPHY

The aim of the article is to consider the question: what do technological innovations bring to creative activities, so that we can see in them a new way of creating, and how does a work of multivariate nature affect the viewer, evoking in him/her a peculiar perceptio sensatio.The article presents an intermedia project based on distributed authorship, resulting from the collaboration of a music choreographer, a visual artist and a music theorist. Each of these people brings a different perspective and creation to the project, which integrates the guiding idea of "hearing and seeing" music, and even experiencing it multisensorially.Syncretic activities on the borderline of composition, improvisation and interpretation of music and its choreography, as well as the conscious use of audiovisual objects, expand the fields of artistic activity to reach the audience through multiple channels of sensory perception. The spectator does not perceive isolated fields, because the sensory world is a synthesis of different fields of perception. The same object that we see, we can touch, can be a source of sound and smell. In this constellation, the intermedia narration of the work is not only an experiment that influences the attractiveness of the musical choreography presented, but also an object of research into a new language, the use of which expands the concept of thinking about the form of the composition presented. The amplified dimensions of the work's reception make it an attractive form of expression, which at the same time becomes an artistic-cognitive hybrid.

Dissociable neural correlates of multisensory coherence and selective attention.

Previous work has demonstrated that performance in an auditory selective attention task can be enhanced or impaired, depending on whether a task-irrelevant visual stimulus is temporally coherent with a target auditory stream or with a competing distractor. However, it remains unclear how audiovisual (AV) temporal coherence and auditory selective attention interact at the neurophysiological level. Here, we measured neural activity using electroencephalography (EEG) while human participants (men and women) performed an auditory selective attention task, detecting deviants in a target audio stream. The amplitude envelope of the two competing auditory streams changed independently, while the radius of a visual disc was manipulated to control the audiovisual coherence. Analysis of the neural responses to the sound envelope demonstrated that auditory responses were enhanced independently of the attentional condition: both target and masker stream responses were enhanced when temporally coherent with the visual stimulus. In contrast, attention enhanced the event-related response (ERP) evoked by the transient deviants, independently of AV coherence. Finally, in an exploratory analysis, we identified a spatiotemporal component of ERP, in which temporal coherence enhanced the deviant-evoked responses only in the unattended stream. These results provide evidence for dissociable neural signatures of bottom-up (coherence) and top-down (attention) effects in AV object formation.Significance StatementTemporal coherence between auditory stimuli and task-irrelevant visual stimuli can enhance behavioral performance in auditory selective attention tasks. However, how audiovisual temporal coherence and attention interact at the neural level has not been established. Here, we measured EEG during a behavioral task designed to independently manipulate AV coherence and auditory selective attention. While some auditory features (sound envelope) could be coherent with visual stimuli, other features (timbre) were independent of visual stimuli. We find that audiovisual integration can be observed independently of attention for sound envelopes temporally coherent with visual stimuli, while the neural responses to unexpected timbre changes are most strongly modulated by attention. Our results provide evidence for dissociable neural mechanisms of bottom-up (coherence) and top-down (attention) effects on AV object formation.

From capture to texture: affective environments for theatre training in virtual reality (VR)

ABSTRACT The notion of ‘pre-expressivity' is central to the field of ‘theatre anthropology', explored by Eugenio Barba and his theatre group Odin Teatret. It refers to the elementary level of the energetic dynamics that render an actor's body scenically ‘alive' and 'present'. In the current study, we explore the potential of immersive technologies and bodily interaction interfaces for supporting the transmission of embodied knowledge. We begin by outlining a critical epistemological framework that calls for new accounts of knowledge distribution. We describe the process of mapping different training strands developed by Odin Teatret's actors, using motion capture technology. Further on, we approach the translation of such embodied practices into data and, consequently, into an immersive experience of archival navigation. In our study, we used audiovisual objects as environmental constraints, what we term as immersive archi-textures, and employ Laban efforts applied to motion capture data analysis as a model for qualifying movement patterns. We will base our writings on a particular experiment, which has captured Odin actress Roberta Carreri’s exercise Six States of Water within the virtual archive. In this exercise, the trainee is called to perform a specific score of actions with different qualities of energy, translated as different states of water.

Narrativa cuir, experiência estética e política na luta pela paz: notas sobre o curta-metragem Negrum3

The contemporary Brazilian context offers a growing artistic and cultural production, generated by LGBTQIA+ subjects, which disputes narratives and sensitivity, and suggests new ways of being in the social world. This article looks at how such artistic-cultural production can bring critiques and contributions on peacebuilding. The article questions how to think peacebuilding from queer perspectives: it confronts peacebuilding with dissident critiques, in order to think a possible idea of queer peace. This is proposed through the aesthetic experience, in articulations between affection and politics that mobilize relations of recognition and otherness, from a sensitive perception of the discourses of resistance and affirmation of existence. To conduct an analysis that values culture —and its aesthetic and sensitive character— as a relevant field for research in the social and political sciences, we discuss the short film Negrum3 by filmmaker Diego Paulino. This audiovisual object is analyzed through a brief historical incursion, which presents a picture of LGBTQIA+ public policies in Brazil and their possible bridges with an idea of peacebuilding, and a theoretical reflection that contrasts decolonial theories with figures from the European academia. Thus, we reflect on how a queer peace can be built in the dimension of aesthetic experience, which is also political, and allows us to imagine and enable new forms of life. Our conclusion is that queer peace is a challenging conception, which retains its challenges and is based on a critique of hegemonic and institutionalized apprehensions of peace. In this sense, the artistic-cultural production, with its aesthetic approaches, appears as an inventive path. The originality of the article consists in its articulation of queer theories and, above all, of aesthetic and political practices, to think about peacebuilding in Brazil’s social reality.

Performance in an Audiovisual Selective Attention Task Using Speech-Like Stimuli Depends on the Talker Identities, But Not Temporal Coherence.

Audiovisual integration of speech can benefit the listener by not only improving comprehension of what a talker is saying but also helping a listener select a particular talker's voice from a mixture of sounds. Binding, an early integration of auditory and visual streams that helps an observer allocate attention to a combined audiovisual object, is likely involved in processing audiovisual speech. Although temporal coherence of stimulus features across sensory modalities has been implicated as an important cue for non-speech stimuli (Maddox et al., 2015), the specific cues that drive binding in speech are not fully understood due to the challenges of studying binding in natural stimuli. Here we used speech-like artificial stimuli that allowed us to isolate three potential contributors to binding: temporal coherence (are the face and the voice changing synchronously?), articulatory correspondence (do visual faces represent the correct phones?), and talker congruence (do the face and voice come from the same person?). In a trio of experiments, we examined the relative contributions of each of these cues. Normal hearing listeners performed a dual task in which they were instructed to respond to events in a target auditory stream while ignoring events in a distractor auditory stream (auditory discrimination) and detecting flashes in a visual stream (visual detection). We found that viewing the face of a talker who matched the attended voice (i.e., talker congruence) offered a performance benefit. We found no effect of temporal coherence on performance in this task, prompting an important recontextualization of previous findings.

Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention.

It has been reported that attending to stimuli in visual modality can spread to task-irrelevant but synchronously presented stimuli in auditory modality, a phenomenon termed the cross-modal spread of attention, which could be either stimulus-driven or representation-driven depending on whether the visual constituent of an audiovisual object is further selected based on the object representation. The stimulus-driven spread of attention occurs whenever a task-irrelevant sound synchronizes with an attended visual stimulus, regardless of the cross-modal semantic congruency. The present study recorded event-related potentials (ERPs) to investigate whether the stimulus-driven cross-modal spread of attention could be modulated by audio-visual emotional congruency in a visual oddball task where emotion (positive/negative) was task-irrelevant. The results first demonstrated a prominent stimulus-driven spread of attention regardless of audio-visual emotional congruency by showing that for all audiovisual pairs, the extracted ERPs to the auditory constituents of audiovisual stimuli within the time window of 200–300 ms were significantly larger than ERPs to the same auditory stimuli delivered alone. However, the amplitude of this stimulus-driven auditory Nd component during 200–300 ms was significantly larger for emotionally incongruent than congruent audiovisual stimuli when their visual constituents’ emotional valences were negative. Moreover, the Nd was sustained during 300–400 ms only for the incongruent audiovisual stimuli with emotionally negative visual constituents. These findings suggest that although the occurrence of the stimulus-driven cross-modal spread of attention is independent of audio-visual emotional congruency, its magnitude is nevertheless modulated even when emotion is task-irrelevant.

Neuromorphic Time-Multiplexed Reservoir Computing With On-the-Fly Weight Generation for Edge Devices.

The human brain has evolved to perform complex and computationally expensive cognitive tasks, such as audio-visual perception and object detection, with ease. For instance, the brain can recognize speech in different dialects and perform other cognitive tasks, such as attention, memory, and motor control, with just 20 W of power consumption. Taking inspiration from neural systems, we propose a low-power neuromorphic hardware architecture to perform classification on temporal data at the edge. The proposed architecture uses a neuromorphic cochlea model for feature extraction and reservoir computing (RC) framework as a classifier. In the proposed hardware architecture, the RC framework is modified for on-the-fly generation of reservoir connectivity, along with binary feedforward and reservoir weights. Also, a large reservoir is split into multiple small reservoirs for efficient use of hardware resources. These modifications reduce the computational and memory resources required, thereby resulting in a lower power budget. The proposed classifier is validated for speech and human activity recognition (HAR) tasks. We have prototyped our hardware architecture using Intel's cyclone-10 low-power series field-programmable gate array (FPGA), consuming only 4790 logic elements (LEs) and 34.9-kB memory, making it a perfect candidate for edge computing applications. Moreover, we have implemented a complete system for speech recognition with the feature extraction block (cochlea model) and the proposed classifier, utilizing 15 532 LEs and 38.4-kB memory. By using the proposed idea of multiple small reservoirs along with on-the-fly generation of reservoir binary weights, our architecture can reduce the power consumption and memory requirement by order of magnitude compared to existing FPGA models for speech recognition tasks with similar complexity.

Distinct multisensory perceptual processes guide enhanced auditory recognition memory in older cochlear implant users

In naturalistic situations, sounds are often perceived in conjunction with matching visual impressions. For example, we see and hear the neighbor’s dog barking in the garden. Still, there is a good chance that we recognize the neighbor’s dog even when we only hear it barking, but do not see it behind the fence. Previous studies with normal-hearing (NH) listeners have shown that the audio-visual presentation of a perceptual object (like an animal) increases the probability to recognize this object later on, even if the repeated presentation of this object occurs in a purely auditory condition. In patients with a cochlear implant (CI), however, the electrical hearing of sounds is impoverished, and the ability to recognize perceptual objects in auditory conditions is significantly limited. It is currently not well understood whether CI users – as NH listeners – show a multisensory facilitation for auditory recognition. The present study used event-related potentials (ERPs) and a continuous recognition paradigm with auditory and audio-visual stimuli to test the prediction that CI users show a benefit from audio-visual perception. Indeed, the congruent audio-visual context resulted in an improved recognition ability of objects in an auditory-only condition, both in the NH listeners and the CI users. The ERPs revealed a group-specific pattern of voltage topographies and correlations between these ERP maps and the auditory recognition ability, indicating a different processing of congruent audio-visual stimuli in CI users when compared to NH listeners. Taken together, our results point to distinct cortical processing of naturalistic audio-visual objects in CI users and NH listeners, which however allows both groups to improve the recognition ability of these objects in a purely auditory context. Our findings are of relevance for future clinical research since audio-visual perception might also improve the auditory rehabilitation after cochlear implantation.

Digitale Musikedition und die Wissenschaft der Populären Musik

The term pop-music already claims to be artificial, just like "classical" western music. In this context, the article deals with the potentials of digital music edition, focusing on the necessity of a pop-music philology. In paying attention particularly to non-textual aspects of music, this seems one of the most important potentials of digital music edition in this area. Therefore, the need of a pop-music philology is emphasized here. This may include the edition of audiovisual objects, objects of cultural behavior and historical objects. We examine this using the example of the cover-version phenomenon, and recommend at least addressing copyright aspects.

Video game in the system of intellectual property: the concept and features of legal protection

Keywords: video game, intellectual property law, computer program, software, digitalinformation, electronic information, multimedia work, audiovisual work
 The article is devoted to thestudy of the legal understanding of video games as an object of intellectual propertyrights. The author concludes that video games constitute digital information, whichgreatly facilitates their development, however, complicates the protection of intellectualproperty rights. There is a contradictory connection between the concepts of«electronic (digital) information», «audiovisual work», «computer program» and «literarywork», which establishes some uncertainty in the protection of video games,namely, what should be understood by these concepts in terms of law.The author found that the use of the latest technologies to improve the visual componentbrings the video game even closer to the game audiovisual object, which increasesthe complexity of the process of protection of intellectual property rights. However, thecurrent situation with the use of the term «computer program» in the context of protectionof intellectual property rights to video games does not cover all features of the latter,covering only the main program among the software recording and operation of thegame, such as audiovisual content. Therefore, there is a need to use the generalized conceptof «software» as opposed to the narrower concept of «computer program». In thiscase, in the absence of at least one of the characteristics of the multimedia work, the computerprogram should be referred to the scope of legal regulation of software.The author proposed to understand the video game as object of intellectual propertylaw in the following manner: multimedia work expressed in the form of digital(electronic) information, the principle of which is determined by the algorithms of thesoftware provided for installation in the memory of computer devices.In general, the digital nature of video games presupposes a revision of existing approachesto the protection of intellectual property rights, which may be aimed atweakening the regulatory function of the law where it is possible to regulate the relationshipby more flexible means.

Audiovisual working memory and association with resting-state regional homogeneity

Multisensory processing is a prevalent research issue. However, multisensory working memory research has received inadequate attention. The present study aimed to investigate the behavioral performance of an audiovisual working memory task and its association with resting-state functional magnetic resonance imaging (fMRI) regional homogeneity (ReHo). A total of 128 healthy participants were enrolled in this study. The participants completed a modified Sternberg working memory task using complex auditory and visual objects as materials involved in different encoding conditions, including semantically congruent audiovisual, semantically incongruent audiovisual, and single modality of auditory or visual object encoding. Two subgroups received resting-state fMRI scans according to their behavioral performances. The results showed that the semantically congruent audiovisual object encoding sped up the later unisensory memory recognition in this task. Moreover, the high behavioral performance (response time, RT) group showed increased ReHo in the executive control network (ECN) and decreased ReHo in the default mode network (DMN) and saline network (SN). In addition, resting-state ReHo values in the ECN nodes (e.g., middle frontal gyrus and superior frontal gyrus) was correlated with RT. These findings suggested that semantically congruent audiovisual processing in working memory was superior to unisensory memory recognition and may be involved in the different functional networks such as ECN.

Comparer la réception des images par les Nord et les Sud dans le cadre d’un Partenariat Hubert Curien Tassili

Pascal Laborderie This paper relates the experience of a PHC Tassili cooperation project between the universities of Reims and Oran 2 entitled “Pictures, realities and fictions of the North-South Relations”. This research project proposes to compare different reception of a same audiovisual object on the various publics located on both sides of the Mediterranean Sea. This article explains the material and administrative modalities, the methodological difficulties as well as the philosophical and epistemological issues of the program.

Theta Oscillations and Source Connectivity During Complex Audiovisual Object Encoding in Working Memory.

Working memory is a limited capacity memory system that involves the short-term storage and processing of information. Neuroscientific studies of working memory have mostly focused on the essential roles of neural oscillations during item encoding from single sensory modalities (e.g., visual and auditory). However, the characteristics of neural oscillations during multisensory encoding in working memory are rarely studied. Our study investigated the oscillation characteristics of neural signals in scalp electrodes and mapped functional brain connectivity while participants encoded complex audiovisual objects in a working memory task. Experimental results showed that theta oscillations (4–8 Hz) were prominent and topographically distributed across multiple cortical regions, including prefrontal (e.g., superior frontal gyrus), parietal (e.g., precuneus), temporal (e.g., inferior temporal gyrus), and occipital (e.g., cuneus) cortices. Furthermore, neural connectivity at the theta oscillation frequency was significant in these cortical regions during audiovisual object encoding compared with single modality object encoding. These results suggest that local oscillations and interregional connectivity via theta activity play an important role during audiovisual object encoding and may contribute to the formation of working memory traces from multisensory items.

The hippocampal-entorhinal system represents nested hierarchical relations between words during concept learning.

A fundamental skill of an intelligent mind is that of being able to rapidly discover the structural organization underlying the relations across the objects or the events in the world. Humans, thanks to language, master this skill. For example, a child learning that dolphins and cats can also be referred to as mammals, not only will infer the presence of a hierarchical organization for which dolphins and cats are subordinate exemplars of the category mammals, but will also derive that dolphins are, at least at one conceptual level, more similar to cats than to sharks, despite their indisputable higher perceptual similarity to the latter. The hippocampal-entorhinal system, classically known for its involvement in relational and inferential memory, is a likely candidate to construct and hold these complex relational structures between concepts. To test this hypothesis, we trained healthy human adults to organize a novel audio-visual object space into categories labeled with novel words. Crucially, a hierarchical taxonomy existed between the object categories, and participants discovered it via inference during a simple associative object-to-word training. Using functional MRI after learning, and a combination of ROI-based multivariate analyses, we found that both the mid-anterior hippocampus and the entorhinal cortex represented the inferred hierarchical structure between words: subordinate-level words were represented more similarly to their related superordinate than to unrelated ones. This was paired, in the entorhinal cortex, by an additional signature of internalized structural representation of nested hierarchy: words referring to subordinate concepts belonging to the same superordinate category were represented more similarly compared with those not belonging to the same superordinate level: interestingly, this similarity was never directly taught to subjects nor it was made explicit during the task, but only indirectly derived through a logical inferential process and, crucially, contrasted the evidence coming from the definitional perceptual properties of the concepts. None of these results were observed before learning, when the same words were not yet semantically organized. A whole-brain searchlight revealed that the effect in the entorhinal cortex extends to a wider network of areas, encompassing the prefrontal, temporal, and parietal cortices, partially overlapping with the semantic network.

Grid-like and distance codes for representing word meaning in the human brain

Relational information about items in memory is thought to be represented in our brain thanks to an internal comprehensive model, also referred to as a “cognitive map”. In the human neuroimaging literature, two signatures of bi-dimensional cognitive maps have been reported: the grid-like code and the distance-dependent code. While these kinds of representation were previously observed during spatial navigation and, more recently, during processing of perceptual stimuli, it is still an open question whether they also underlie the representation of the most basic items of language: words. Here we taught human participants the meaning of novel words as arbitrary labels for a set of audiovisual objects varying orthogonally in size and sound. The novel words were therefore conceivable as points in a navigable 2D map of meaning. While subjects performed a word comparison task, we recorded their brain activity using functional magnetic resonance imaging (fMRI). By applying a combination of representational similarity and fMRI-adaptation analyses, we found evidence of (i) a grid-like code, in the right postero-medial entorhinal cortex, representing the relative angular positions of words in the word space, and (ii) a distance-dependent code, in medial prefrontal, orbitofrontal, and mid-cingulate cortices, representing the Euclidean distance between words. Additionally, we found evidence that the brain also separately represents the single dimensions of word meaning: their implied size, encoded in visual areas, and their implied sound, in Heschl's gyrus/Insula. These results support the idea that the meaning of words, when they are organized along two dimensions, is represented in the human brain across multiple maps of different dimensionality. Significant statementHow do we represent the meaning of words and perform comparative judgements on them in our brain? According to influential theories, concepts are conceivable as points of an internal map (where distance represents similarity) that, as the physical space, can be mentally navigated. Here we use fMRI to show that when humans compare newly learnt words, they recruit a grid-like and a distance code, the same types of neural codes that, in mammals, represent relations between locations in the environment and support physical navigation between them.