Spatial Information Research Articles

Stower-13: A Multi-View Inspection Image Dataset for the Automatic Classification and Naming of Tension Towers

In high-voltage transmission lines, the tension tower needs to withstand the tension load of the overhead power line for a long time, which is prone to damage, and it is an important part of the inspection in the circuit inspection. In the modern circuit inspection process, operation and maintenance personnel mostly use unmanned aerial vehicles (UAVs) to photograph various parts of the tension tower, obtain inspection images, and manually classify and name the massive inspection images, which is low in accuracy and efficiency. Based on the above problems, this paper collects a large number of real-life UAV inspection images of various parts of a tension tower, and proposes the Stower-13 inspection image dataset, which is used to train the classification model to achieve automatic classification and naming of inspection images. Based on this dataset, this paper also proposes an improved MobileViT model, in which the Scale-Correlated Pyramid Convolution Block Attention Block (SCPCbam) module is introduced, which adds the Convolution Block Attention Module (CBAM) to the four branches of the original Scale-Correlated Pyramid Convolution (SCPC) module, so as to strengthen the ability of image multi-scale information extraction and improve the classification accuracy. This paper discusses a number of experiments on the model, and the experimental results show that the dataset proposed in this paper helps the model to understand the feature information. At the same time, the improved MobileViT model has a strong ability to extract image spatial feature information, the classification accuracy is higher than that of other models of the same type, so it is able to cope with a wide range of problems that arise in the course of practice, and it meets the practical needs of automatically naming transmission line inspection images.

Building footprint extraction from aerial images using an edge-aware YOLO-v8 network

Abstract. Building footprint extraction is a critical indicator for assessing urban infrastructure, and extracting building footprints from remote sensing imagery can have significant practical applications. However, achieving rapid and accurate extraction of building footprints remains highly challenging, especially in scenarios with complex scenes, dense building distributions, and small targets. The instance segmentation models of the YOLO series offer strong real-time performance, reducing considerable time and effort in practical applications. Therefore, we propose building footprint extraction based on an enhance YOLO-v8 network. This study focuses on three enhancements to the YOLO-v8 network to improve extraction accuracy. Building upon the YOLO-v8 framework, we have incorporated the Feature Pyramid Network (FPN) module into feature maps at all scales to efficiently propagate high-level semantic information. Additionally, we introduce the Triple Feature Encoder (TFE) module, which integrates spatial detail information from feature maps at three different scales to enhance the network's ability to extract multi-scale information. Finally, we explore the integration of the Prewitt model, a conventional edge detection operator, to assist in extracting edge features in target regions of feature maps. This integration aims to reduce the jagged edges frequently seen in the outcomes of the original YOLO-v8. Furthermore, the Prewitt operator's noise suppression capability helps mitigate the influence of non-target areas in the feature maps. The proposed framework achieves an instance segmentation accuracy of mAP50 is 84.6% and mAP50:95 is 51.4% on public datasets, outperforming the original YOLO-v8 network.

Research on Sugarcane Recognition based on Joint Spatial and Spectral Information from Satellite-Based Hyperspectral Imagery

Abstract. The total amount of sugarcane planting in China ranks third in the world, and Guangxi is the largest sugarcane planting base in China. In order to help the Guangxi government and industry better understand the annual planting distribution and scale of sugarcane in the whole region, it is convenient to optimize the planting structure and improve the efficiency of resource utilization, so as to ensure the stable development of Guangxi sugar industry. Based on the satellite-based hyperspectral image data of ' Zhuhai No.1 ', this paper carries out sugarcane recognition and area extraction, which fills the application gap of satellite-based hyperspectral image data in extracting sugarcane area in China. A globally optimized extended random walk model was used to identify and extract sugarcane by combining the spatial-spectral information of hyperspectral imagery. Firstly, the Initial probability estimation is performed using the LOR classifier, and then use the data after MNF dimensionality reduction to construct a weighted graph, and finally the probability optimization and recognition are carried out based on the extended random walk model. The results show that the spatial-spectral joint method based on extended random walk can effectively identify sugarcane, and the sugarcane recognition accuracy of 2021 year image can reach 91.4%, the misrecognition rate is 2.8%; the sugarcane recognition accuracy of 2020 year image can reach 90.5 %, the misrecognition rate is 3.1%.

Research on power generation prediction of hydropower in river basin based on multi-head attention graph convolutional neural network

For the power generation prediction of traditional hydropower stations, most of them only use time series prediction and neglect to study the spatial topological relationship of hydropower stations in the river basin, so that it is difficult to fully explore the characteristic relationship of space power stations. In this paper, a research method for power generation prediction of hydropower in river basin hydropower stations based on multi-head attention map convolutional neural network is proposed. This method establishes a first-level node neighborhood feature map based on the spatial geographic distribution information of hydropower stations in the basin, and uses the method of graph convolution to carry out node feature mining and feature learning, so as to transform the power generation capacity evaluation problem of the hydropower station in the basin into the node prediction problem in the graph, which is different from the global normalization rule. the multi-head attention mechanism introduced further improves the information aggregation quality of the graph node, and uses the historical temperature, power generation, electricity price, unit status and other data of each hydropower station in the basin for training. The reasoning results show that the proposed method achieves higher accuracy than other schemes, and the power prediction method is conducive to the formulation of power plans of hydropower stations in the basin, and can also play a positive role in guiding the site selection of hydropower plants.

Research and application of land illegal behavior monitoring based on video image recognition

Abstract. Our country had increasingly high requirements for land management, especially for arable land, which was the most precious resource. Strict policies for protecting arable land are being implemented. The enforcement of satellite imagery in mega cities had certain limitations in terms of timeliness and accuracy. To meet the requirements of refined management, a high-altitude camera was constructed to form a near ground monitoring network covering the cultivated land area. Multi temporal image groups were obtained through video frame extraction. A monitoring sample library for typical behaviors of natural resources was established. Land objects closely related to illegal activities such as construction machinery and bulldozing areas were identified based on deep learning algorithms. By using the technology of bidirectional conversion between video spatial location and geographic coordinates, a fusion of spatial information video monitoring patterns was formed. Taking the 20000 acre permanent basic farmland area as an example, the recognition rate of illegal land related behaviors was about 81%. By combining approval information and conducting spatial analysis on the identified patterns, real-time warning information could be pushed. This application can effectively improve the timeliness of supervision and enhance the level of supervision.

Underground Target Extraction by Local Entropy Feature of Voxelized 3D Ground Penetrating Radar

Abstract. To solve the current problem of insufficient exploration of three-dimensional spatial information detected by 3D ground penetrating radar (3D GPR) and the data processing mainly based on the analysis and interpretation of two-dimensional slice images, a method is proposed to extract underground target based on the local entropy feature of discrete point clouds after the voxelization of 3D GPR data. First, the acquired 3D GPR data was voxelized into discrete three-dimensional point clouds. Then the local entropy feature of the voxelized point clouds over the entire region were calculated. The soil background and underground targets were distinguished by classifying them from multiple dimensions through Support Vector Machine (SVM). Finally, the urban road underground environment was taken as the research object, and this method was used for experimental analysis using measured data. The experimental results show that the accuracy of this method in extracting underground targets is as high as 90.1%, and the missing detection rate of missing underground targets is as low as 7.8%. The proposed method is accurate and effective, providing a new approach for 3D GPR to extract underground target.

Hyperspectral image classification based on superpixel merging and broad learning system

AbstractMost spectral–spatial classification methods for hyperspectral images (HSIs) can achieve satisfactory classification results. However, the common problem faced with these approaches is the need for a long training time and sufficient training samples. To address this issue, this study proposes an effective spectral–spatial HSI classification method based on superpixel merging, superpixel smoothing and broad learning system (SMS‐BLS). The newly introduced parameter‐free superpixel merging technique based on local modularity not only enhances the role of local spatial information in classification, but also maintains class boundary information as much as possible. In addition, the spectral and spatial information of HSIs is further fused during the superpixel smoothing process. As a result, with limited training samples, using merged and smoothed superpixels instead of pixels as input to the broad learning system significantly improves its classification performance. Moreover, the merged superpixels weaken the dependence of the classification results on the superpixel segmentation scale. The effectiveness of the proposed method was validated on three HSI benchmarks, namely Indian Pines, Pavia University and Salinas. Experimental and comparative results show the superiority of the method to other state‐of‐the‐art approaches in terms of overall accuracy and running time.

Preface: ISPRS Technical Commission I Midterm Symposium on “Intelligent Sensing and Remote Sensing Application”

Abstract. The ISPRS Technical Commission I Midterm Symposium on "Intelligent Sensing and Remote Sensing Application" was held in Changsha, China, during May 13–17, 2024, aiming to provide a platform to share the latest researches, advanced technologies and application experience, to discuss the future development and to seek international cooperation in various forms. The Symposium has received 229 full paper and abstract s, among them 45 double-blind peer-reviewed full papers were published in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information, and 165 papers accepted through abstract review were published in the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. These papers are mostly dedicated to topics of the 8 TC I Working Groups, 3 Inter-commission Working Groups, including Satellite Missions and Constellations for Remote Sensing, Mobile Mapping Technology, Multispectral, Hyperspectral and Thermal Sensors, LiDAR, Laser Altimetry and Sensor Integration, Microwave and InSAR Technology for Earth Observation, Orientation, Calibration and Validation of Sensors, Data Quality and Benchmark of Sensors, Multi-sensor Modelling and Cross-modality Fusion, Robotics for Mapping and Machine Intelligence, Autonomous Sensing Systems and their Applications, Digital Construction: Reality Capture, Automated Inspection and Integration to BIM, Point Cloud Generation and Processing, Artificial Intelligence Technology Related to Sensor Systems, Multi-sensor Remote Sensing Applications.. These papers presented the latest trends of sensor systems. The full papers and abstracts were reviewed by the members of the Symposium Scientific Committee comprised of Working Group officers and invited experts. We would like to take this opportunity to express our great gratitude to the Scientific Committee, Local Organizing Committee, Sponsors, Exhibitors and all those who have contributed to this successful Symposium. We also want to express our thanks to the authors for their excellent papers and presentations. Tang Xinming, Antonio Maria Garcia Tommaselli, Zhang Tao, Xie JunfengISPRS Technical Commission I on Sensor SystemsMay 2024, Changsha, China

Spectral Superresolution Using Transformer with Convolutional Spectral Self-Attention

Hyperspectral images (HSI) find extensive application across numerous domains of study. Spectral superresolution (SSR) refers to reconstructing HSIs from readily available RGB images using the mapping relationships between RGB images and HSIs. In recent years, convolutional neural networks (CNNs) have become widely adopted in SSR research, primarily because of their exceptional ability to extract features. However, most current CNN-based algorithms are weak in terms of extracting the spectral features of HSIs. While certain algorithms can reconstruct HSIs through the fusion of spectral and spatial data, their practical effectiveness is hindered by their substantial computational complexity. In light of these challenges, we propose a lightweight network, Transformer with convolutional spectral self-attention (TCSSA), for SSR. TCSSA comprises a CNN-Transformer encoder and a CNN-Transformer decoder, in which the convolutional spectral self-attention blocks (CSSABs) are the basic modules. Multiple cascaded encoding and decoding modules within TCSSA facilitate the efficient extraction of spatial and spectral contextual information from HSIs. The convolutional spectral self-attention (CSSA) as the basic unit of CSSAB combines CNN with self-attention in the transformer, effectively extracting both spatial local features and global spectral features from HSIs. Experimental validation of TCSSA’s effectiveness is performed on three distinct datasets: GF5 for remote sensing images along with CAVE and NTIRE2022 for natural images. The experimental results demonstrate that the proposed method achieves a harmonious balance between reconstruction performance and computational complexity.

A method for hierarchical weighted fitting of regular grid DSM with discrete points

Abstract. A Digital Surface Model (DSM) is a crucial spatial geographic information data used to describe the shape of the earth’s surface in Geographic Information Systems (GIS). DSM is the core data used in terrain analysis in GIS. A regular grid DSM is generally generated by interpolating a large number of discrete point clouds. This paper proposes a method of using a hierarchical weighted strategy to fit a regular grid DSM with discrete points. This method uses a pyramid hierarchical strategy to refine the target regular grid from one grid with finer parameters of 3*3, until the nth level (the interval of the grid is equal to the expected interval), and then gradually places the discrete point cloud into the corresponding grid by weighted averaging, and uses the result of this level as the initial value of the next level. This algorithm can avoid the problem of low efficiency in retrieving a large number of discrete point clouds, and the indirect interpolation method not considering the contribution of distant neighboring point clouds. The operation of point cloud data is a stream operation, which does not require consideration of the topological information of point clouds, and has simple operation and no additional memory consumption. It is especially suitable for the production of regular grid DSM with massive point clouds. To verify the effectiveness of this method, the article selected six typical terrain data such as high mountains, mountains, hills, plains, urban areas, and lakes for experiments. The results show that compared with the construct-TIN method for producing DSM, this method has very good processing accuracy and processing efficiency.

Mapping the exposure of tourism to weather extremes: the need for a spatially-explicit gridded dataset for disaster risk reduction

Abstract Tourism is a highly important economic sector worldwide, yet it is often less than optimally represented in terms of detailed spatial information. An accurate spatial representation of tourism can provide valuable insights into the spatial distribution of tourism vulnerabilities and exposure, allowing policymakers to make informed decisions and develop effective strategies for disaster risk reduction and climate change adaptation policies. Here, we stress the need for and propose a first prototype of an open-access spatially-explicit gridded database based on social media data for over 150 different tourism-related classes that depicts tourism density (supply and demand) and perceived satisfaction in Europe. We showcase the potential benefits of such database by mapping the exposure of specific tourism sectors to a range of weather extremes, including floods, windstorms, and heat stress. Based on these results, we argue that a homogeneous spatially-explicit database of tourism is essential to support efficient investments in preparedness and disaster resilience.

The well-worn route revisited: Striatal and hippocampal system contributions to familiar route navigation.

Classic research has shown a division in the neuroanatomical structures that support flexible (e.g., short-cutting) and habitual (e.g., familiar route following) navigational behavior, with hippocampal-caudate systems associated with the former and putamen systems with the latter. There is, however, disagreement about whether the neural structures involved in navigation process particular forms of spatial information, such as associations between constellations of cues forming a cognitive map, versus single landmark-action associations, or alternatively, perform particular reinforcement learning algorithms that allow the use of different spatial strategies, so-called model-based (flexible) or model-free (habitual) forms of learning. We sought to test these theories by asking participants (N = 24) to navigate within a virtual environment through a previously learned, 9-junction route with distinctive landmarks at each junction while undergoing functional magnetic resonance imaging (fMRI). In a series of probe trials, we distinguished knowledge of individual landmark-action associations along the route versus knowledge of the correct sequence of landmark-action associations, either by having absent landmarks, or "out-of-sequence" landmarks. Under a map-based perspective, sequence knowledge would not require hippocampal systems, because there are no constellations of cues available for cognitive map formation. Within a learning-based model, however, responding based on knowledge of sequence would require hippocampal systems because prior context has to be utilized. We found that hippocampal-caudate systems were more active in probes requiring sequence knowledge, supporting the learning-based model. However, we also found greater putamen activation in probes where navigation based purely on sequence memory could be planned, supporting models of putamen function that emphasize its role in action sequencing.

Delimitation and Prioritization of Climate-Affected Areas Using the Example of a Post-Industrial City

This study adapted and tested an approach to identifying areas that are particularly vulnerable to climate-related hazards using the example of the post-industrial city of Knurów in Poland. This study applied a multi-criteria method using the analytical hierarchy process based on GIS map data. The analysis was divided into statistical regions defined for the city. Fifteen attributes were defined for each statistical region. The applied methods provided verified spatial information related to specific climate change hazards. The results showed that the most vulnerable areas were the areas with intensive development in the city center and in the southwestern part of the city. Among the 15 attributes, the most significant were T1 (number of inhabitants in zones with a higher potential thermal risk index by statistical district) with a value of 0.163, G2 (percentage of the sum of tree-shaded areas in built-up areas within the territory of a given statistical district) with 0.143 and H3 (number of buildings in areas of drainless basins and 100-year water). This method effectively identified the most vulnerable areas. The use of such a method can help in the preparation of planning documents and urban adaptation plans by determining the thermally and hydrologically vulnerable areas with the least developed green infrastructure as an exposure-mitigating factor.

Deep Siamese Network for annual change detection in Beijing using Landsat satellite data

The detection of spatiotemporal changes in land use/land cover (LULC-SC) plays a paramount role in the analysis of smart cities, it can describe complex urban distribution, functions, and patterns. Chinas capital city has been developing rapidly in the past two decades, however, there are only few long-term studies on an annual scale of LULC-SC. To fill this research gap, we propose a remote sensing parallel framework for the detection of LULC-SC based on the combination of the Deep Siamese Network and long time series, which focuses on the spatial semantic information at the object level. A Landsat time series from 2002 to 2022 serves as input satellite data. First, we focus on building graph constructions at the object level and then use an autonomously constructed deeper-feature graph convolutional network (DF-GCN) to mine deeper features, spatial semantic, and relationships at the object level. Finally, the Siamese Network recognizes the changes in the spatial semantic tensors of long time series of Landsat images and quickly maps LULC-SC. The results prove that the proposed spatiotemporal change detection framework is effective in LULC-SC in Beijing. Compared with other networks, the optimal accuracy of semantic mining based on DF-GCN can reach about 90%. Over the past two decades, the LULC-SC of Beijing has changed in a complex way, with urbanization occurring primarily through the replacement of farmland. Consequently, the proposed framework can generate accurate LULC change maps at high temporal frequencies, which can contribute to a better comprehension of sustainable urban development and planning.

A joint feature refining and multi-resolution feature learning approach for bandwidth extension of speech coded by EVS codec

The bandwidth of the speech signals is often limited in speech communications due to the specifications of the standardized codecs or insufficient bitrates. So, we present a bandwidth extension (BWE) framework of speech signals coded by the enhanced voice services (EVS) codec. Previous studies on speech bandwidth extension based on convolutional neural network (CNN) which exist channel and spatial redundancy feature information. This work proposes an end-to-end architecture which combines novel channel and spatial reconstruction module. Specifically, the spatial reconstruction module utilizes a mask to distinguish high-frequency and low-frequency features. Group convolutions is then employed to enhance high-frequency features and suppress low-frequency features. The channel reconstruction module is introduced to reduce unnecessary feature information. Additionally, we introduce a novel time–frequency loss function, incorporating time-domain loss and frequency-domain loss based on Mel-spectrum and multi-resolution representation, to optimize the network. To assess the model and loss function’s performance, we conducted experiments on subdatasets encoded at rates of 6.6kbps, 7.2kbps, and 8kbps, respectively. The experimental results demonstrated that our proposed model surpassed other baseline models in terms of LSD, SNR, PESQ, and MOS scores.

Catalytic NIR chemiluminescence sensor with enhanced persistence and intensity for in vivo imaging

Chemiluminescence (CL) is a self-illumination phenomenon that involves the emission of light from chemical reactions, and it provides favorable spatial and temporal information on biological processes. However, it is still a great challenge to construct effective CL sensors that equip strong CL intensity, long emission wavelength, and persistent luminescence for deep tissue imaging. Here, we report a liposome encapsulated polymer dots (Pdots)-based system using catalytic CL substrates (L-012) as energy donor and fluorescent polymers and dyes (NIR 695) as energy acceptors for efficient Near-infrared (NIR) CL in vivo imaging. Thanks to the modulation of paired donor and acceptor distance and the slow diffusion of biomarker by liposome, the Pdots show a NIR emission wavelength (λ em, max = 720 nm), long CL duration (>24 h), and a high chemiluminescence resonance energy transfer efficiency (46.5 %). Furthermore, the liposome encapsulated Pdots possess excellent biocompatibility, sensitive response to H2O2, and persistent whole-body NIR CL imaging in the drug-induced inflammation and the peritoneal metastatic tumor mouse model. In a word, this NIR-II CL nanoplatform with long-lasting emission and high spatial-temporal resolution will be a concise strategy in deep tissue imaging and clinical diagnostics.

Precise immunofluorescence canceling for highly multiplexed imaging to capture specific cell states

Cell states are regulated by the response of signaling pathways to receptor ligand-binding and intercellular interactions. High-resolution imaging has been attempted to explore the dynamics of these processes and, recently, multiplexed imaging has profiled cell states by achieving a comprehensive acquisition of spatial protein information from cells. However, the specificity of antibodies is still compromised when visualizing activated signals. Here, we develop Precise Emission Canceling Antibodies (PECAbs) that have cleavable fluorescent labeling. PECAbs enable high-specificity sequential imaging using hundreds of antibodies, allowing for reconstruction of the spatiotemporal dynamics of signaling pathways. Additionally, combining this approach with seq-smFISH can effectively classify cells and identify their signal activation states in human tissue. Overall, the PECAb system can serve as a comprehensive platform for analyzing complex cell processes.

Multi-Scale Fusion Siamese Network Based on Three-Branch Attention Mechanism for High-Resolution Remote Sensing Image Change Detection

Remote sensing image change detection (CD) is an important means in remote sensing data analysis tasks, which can help us understand the surface changes in high-resolution (HR) remote sensing images. Traditional pixel-based and object-based methods are only suitable for low- and medium-resolution images, and are still challenging for complex texture features and detailed image detail processing in HR images. At present, the method based on deep learning has problems such as inconsistent fusion and difficult model training in the combination of the difference feature information of the deep and shallow layers and the attention mechanism, which leads to errors in the distinction between the changing region and the invariant region, edge detection and small target detection. In order to solve the above problems of inconsistent fusions of feature information aggregation and attention mechanisms, and indistinguishable change areas, we propose a multi-scale feature fusion Siamese network based on attention mechanism (ABMFNet). To tackle the issues of inconsistent fusion and alignment difficulties when integrating multi-scale fusion and attention mechanisms, we introduce the attention-based multi-scale feature fusion module (AMFFM). This module not only addresses insufficient feature fusion and connection between different-scale feature layers, but also enables the model to automatically learn and prioritize important features or regions in the image. Additionally, we design the cross-scale fusion module (CFM) and the difference feature enhancement pyramid structure (DEFPN) to assist the AMFFM module in integrating differential information effectively. These modules bridge the spatial disparity between low-level and high-level features, ensuring efficient connection and fusion of spatial difference information. Furthermore, we enhance the representation and inference speed of the feature pyramid by incorporating a feature enhancement module (FEM) into DEFPN. Finally, the BICD dataset proposed by the laboratory and public datasets LEVIR-CD and BCDD are compared and tested. We use F1 score and MIoU values as evaluation metrics. For AMBMFNet, the F1 scores on the three datasets are 77.69%, 81.57%, and 77.91%, respectively, while the MIoU values are 84.65%, 85.84%, and 84.54%, respectively. The experimental results show that ABMFNet has better effectiveness and robustness.

ReconU-Net: a direct PET image reconstruction using U-Net architecture with back projection-induced skip connection

Objective. This study aims to introduce a novel back projection-induced U-Net-shaped architecture, called ReconU-Net, based on the original U-Net architecture for deep learning-based direct positron emission tomography (PET) image reconstruction. Additionally, our objective is to visualize the behavior of direct PET image reconstruction by comparing the proposed ReconU-Net architecture with the original U-Net architecture and existing DeepPET encoder–decoder architecture without skip connections. Approach. The proposed ReconU-Net architecture uniquely integrates the physical model of the back projection operation into the skip connection. This distinctive feature facilitates the effective transfer of intrinsic spatial information from the input sinogram to the reconstructed image via an embedded physical model. The proposed ReconU-Net was trained using Monte Carlo simulation data from the Brainweb phantom and tested on both simulated and real Hoffman brain phantom data. Main results. The proposed ReconU-Net method provided better reconstructed image in terms of the peak signal-to-noise ratio and contrast recovery coefficient than the original U-Net and DeepPET methods. Further analysis shows that the proposed ReconU-Net architecture has the ability to transfer features of multiple resolutions, especially non-abstract high-resolution information, through skip connections. Unlike the U-Net and DeepPET methods, the proposed ReconU-Net successfully reconstructed the real Hoffman brain phantom, despite limited training on simulated data. Significance. The proposed ReconU-Net can improve the fidelity of direct PET image reconstruction, even with small training datasets, by leveraging the synergistic relationship between data-driven modeling and the physics model of the imaging process.

Spatial transcriptomics in health and disease.

The ability to localize hundreds of macromolecules to discrete locations, structures and cell types in a tissue is a powerful approach to understand the cellular and spatial organization of an organ. Spatially resolved transcriptomic technologies enable mapping of transcripts at single-cell or near single-cell resolution in a multiplex manner. The rapid development of spatial transcriptomic technologies has accelerated the pace of discovery in several fields, including nephrology. Its application to preclinical models and human samples has provided spatial information about new cell types discovered by single-cell sequencing and new insights into the cell-cell interactions within neighbourhoods, and has improved our understanding of the changes that occur in response to injury. Integration of spatial transcriptomic technologies with other omics methods, such as proteomics and spatial epigenetics, will further facilitate the generation of comprehensive molecular atlases, and provide insights into the dynamic relationships of molecular components in homeostasis and disease. This Review provides an overview of current and emerging spatial transcriptomic methods, their applications and remaining challenges for the field.