High Resolution Optical Satellite Imagery Research Articles

An Efficient Ship Detection Method Based on YOLO and Ship Wakes Using High-Resolution Optical Jilin1 Satellite Imagery.

In this study, we propose a practical and efficient scheme for ship detection in remote sensing imagery. Our method is developed using both ship body detection and ship wake detection and combines deep learning and feature-based image processing. A deep convolutional neural network is used to achieve ship body detection, and a feature-based processing method is proposed to detect ship wakes. For better analysis, we model the sea region and evaluate the quality of the image. Generally, the wake detection result is used to assist ship detection and obtain the sailing direction. Conventional methods cannot detect ships that are covered by clouds or outside the image boundary. The method proposed in this paper uses the wake to detect such ships, with a certain level of confidence and low false alarm probability in detection. Practical aspects such as the method's applicability and time efficiency are considered in our method for real applications. We demonstrate the effectiveness of our method in a real remote sensing dataset. The results show that over 93.5% of ships and over 70% of targets with no visible ship body can be successfully detected. This illustrates that the proposed detection framework can fill the gap regarding the detection of sailing ships in a remote sensing image.

High-resolution regional sea-ice model based on the discrete element method with boundary conditions from a large-scale model for ice drift

Abstract Understanding sea-ice dynamics at the floe scale is crucial to comprehend polar climate systems. While continuum models are commonly used to simulate large-scale sea-ice dynamics, they have limitations in accurately representing sea-ice behaviour at small scales. DEMs, on the other hand, are well-suited for modelling the behaviour of individual ice floes but face limitations due to computational constraints. To address the limitations of both approaches while combining their strengths, we explored the feasibility of using a DEM within a continuum model, where the latter provides boundary conditions for a rectangular high-resolution DEM domain. This paper presents a feasibility study where a discrete model of a 100 × 100 km2 icefield was created using high-resolution optical satellite imagery. Sea-ice dynamics were simulated in the DEM considering environmental forces and integrating large-scale ice-drift velocities as boundary conditions. Model predictions were compared with satellite observations for ice drift and deformation parameters. This numerical approach showed potential for offering accurate, high-resolution predictions of sea ice, particularly in coastal areas and near islands, and may find applications in ice navigation and climate studies. However, further development of the DEM, along with upgrades to the coupled ocean models providing data for the ice component, may be necessary. Additionally, challenges remain to develop a two-way coupling between the DEM and a continuum model, which may be needed to improve the accuracy of large-scale simulations.

Leveraging Deep Learning for High-Resolution Optical Satellite Imagery From Low-Cost Small Satellite Platforms

Leveraging Deep Learning for High-Resolution Optical Satellite Imagery From Low-Cost Small Satellite Platforms

Summer sea ice floe perimeter density in the Arctic: high-resolution optical satellite imagery and model evaluation

Abstract. Size distribution of sea ice floes is an important component for sea ice thermodynamic and dynamic processes, particularly in the marginal ice zone. Recently processes related to the floe size distribution (FSD) have been incorporated into sea ice models, but the sparsity of existing observations limits the evaluation of FSD models, thus hindering model improvements. In this study, perimeter density has been applied to characterise the floe size distribution for evaluating three FSD models – the Waves-in-Ice module and Power law Floe Size Distribution (WIPoFSD) model and two branches of a fully prognostic floe size-thickness distribution model: CPOM-FSD and FSDv2-WAVE. These models are evaluated against a new FSD dataset derived from high-resolution satellite imagery in the Arctic. The evaluation shows an overall overestimation of floe perimeter density by the models against the observations. Comparison of the floe perimeter density distribution with the observations shows that the models exhibit a much larger proportion for small floes (radius <10–30 m) but a much smaller proportion for large floes (radius >30–50 m). Observations and the WIPoFSD model both show a negative correlation between sea ice concentration and the floe perimeter density, but the two prognostic models (CPOM-FSD and FSDv2-WAVE) show the opposite pattern. These differences between models and the observations may be attributed to limitations in the observations (e.g. the image resolution is not sufficient to detect small floes) or limitations in the model parameterisations, including the use of a global power-law exponent in the WIPoFSD model as well as too weak a floe welding and enhanced wave fracture in the prognostic models.

Prediction of Unpaved Road Conditions Using High-Resolution Optical Satellite Imagery and Machine Learning

Rural roads play a crucial role in fostering economic and social development in Africa. Local Road Authorities (LRAs) struggle to collect road condition data using conventional means due to logistical and resource issues. Poor road conditions and restricted mobility have severe economic consequences for the transport of goods and services. Lack of maintenance can increase costs three-fold. In this work, a novel framework is proposed in which earth observations using high-resolution optical satellite imagery are applied to measure the condition of unpaved roads, providing a vital input to maintenance planning and prioritisation. A trial was conducted using this method on 83 roads in Tanzania totalling 131.7 km. The experimental results demonstrate that, by analysing variations in pixel intensity of the road surface, the condition can be estimated with an accuracy of 71.9% when compared to ground truth information. Machine Learning techniques are applied to the same network to test the performance of the system in predicting road conditions. A blended classifier approach achieves an accuracy of 88%. The proposed framework enables LRAs to define the information they receive based on their specific priorities, offering a rapid, objective, consistent and potentially cost-effective system that overcomes the current challenges faced by LRAs.

Windthrow damage detection in Nordic forests by 3D reconstruction of very high-resolution stereo optical satellite imagery

ABSTRACT We tested whether windthrow damage to Nordic conifer forest stands could be reliably detected as canopy height decrease between a pre-storm LiDAR (Light Detection and Ranging) digital surface model (DSM) and a photogrammetric DSM derived from a post-storm WorldView-3 stereo pair. The post-storm ground reference data consisted of field and unmanned aerial vehicle (UAV) observations of windthrow combined with no-damage areas collected by visual interpretation of the available very high resolution (VHR) satellite imagery. We trained and tested a thresholding model using canopy height change as the sole predictor. We undertook a two-step accuracy assessment by (1) running k-fold cross-validation on the ground reference dataset and examining the effect of the potential imperfections in the ground reference data, and (2) conducting rigorous accuracy assessment of the classified map of the study area using an extended set of VHR imagery. The thresholding model produced accurate windthrow maps in dense, productive forest stands with a sensitivity of 96%, specificity of 71%, and Matthews correlation coefficient (MCC) over 0.7. However, in sparse and high elevation stands, the classification accuracy was poor. Despite certain collection challenges during the winter months in the Nordic region, we consider VHR stereo satellite imagery to be a viable source of forest canopy height information and sufficiently accurate to map windthrow disturbance in forest stands of high to moderate density.

GPU-Accelerated PCG Method for the Block Adjustment of Large-Scale High-Resolution Optical Satellite Imagery Without GCPs

The precise geo-positioning of high-resolution satellite imagery (HRSI) without ground control points (GCPs) is an important and fundamental step in global mapping, three-dimensional modeling, and so on. In this paper, to improve the efficiency of large-scale bundle adjustment (BA), we propose a combined Preconditioned Conjugate Gradient (PCG) and Graphic Processing Unit (GPU) parallel computing approach for the BA of large-scale HRSI without GCPs. The proposed approach consists of three main components: 1) construction of a BA model without GCPs ; 2) reduction of memory consumption using the Compressed Sparse Row sparse matrix format; and 3) improvement of the computational efficiency by the use of the combined PCG and GPU parallel computing method. The experimental results showed that the proposed method: 1) consumes less memory consumption compared to the conventional full matrix format method; 2) demonstrates higher computational efficiency than the single-core, Ceres-solver and multi-core central processing unit computing methods, with 9.48, 6.82, and 3.05 times faster than the above three methods, respectively; 3) obtains comparable BA accuracy with the above three methods, with image residuals of about 0.9 pixels; and 4) is superior to the parallel bundle adjustment method in the reprojection error.

Pre-collapse motion of the February 2021 Chamoli rock–ice avalanche, Indian Himalaya

Abstract. Landslides are a major geohazard that cause thousands of fatalities every year. Despite their importance, identifying unstable slopes and forecasting collapses remains a major challenge. In this study, we use the 7 February 2021 Chamoli rock–ice avalanche as a data-rich example to investigate the potential of remotely sensed datasets for the assessment of slope stability. We investigate imagery over the 3 decades preceding collapse and assess the precursory signs exhibited by this slope prior to the catastrophic collapse. We evaluate monthly slope motion from 2015 to 2021 through feature tracking of high-resolution optical satellite imagery. We then combine these data with a time series of pre- and post-event digital elevation models (DEMs), which we use to evaluate elevation change over the same area. Both datasets show that the 26.9×106 m3 collapse block moved over 10 m horizontally and vertically in the 5 years preceding collapse, with particularly rapid motion occurring in the summers of 2017 and 2018. We propose that the collapse results from a combination of snow loading in a deep headwall crack and permafrost degradation in the heavily jointed bedrock. Despite observing a clear precursory signal, we find that the timing of the Chamoli rock–ice avalanche could likely not have been forecast from satellite data alone. Our results highlight the potential of remotely sensed imagery for assessing landslide hazard in remote areas, but that challenges remain for operational hazard monitoring.

Characterizing the sea-ice floe size distribution in the Canada Basin from high-resolution optical satellite imagery

Abstract. The sea-ice floe size distribution (FSD) characterizes the sea-ice response to atmospheric and oceanic forcing and is important for understanding and modeling the evolving ice pack in a warming Arctic. FSDs are evaluated from 78 floe-segmented high-resolution (1 m) optical satellite images capturing a range of settings and sea-ice states during spring through fall from 1999 to 2014 in the Canada Basin. For any given image, the structure of the FSD is found to be sensitive to a classification threshold value (i.e., to specify an image pixel as being either water or ice) used in image segmentation, and an approach to account for this sensitivity is presented. The FSDs are found to exhibit a single power-law regime between floe areas 50 m2 and 5 km2, characterized by exponents (slopes in log-log space) in the range −2.03 to −1.65. A distinct linear relationship between slopes and sea-ice concentrations is found, with steeper slopes (i.e., a larger proportion of smaller to larger floes) corresponding to lower sea-ice concentrations. Further, a seasonal variation in slopes is found for fixed sites in the Canada Basin that undergo a seasonal cycle in sea-ice concentration, while sites with extensive sea-ice cover year-round do not exhibit any seasonal change in FSD properties. Our results suggest that sea-ice concentration should be considered in any characterization of a time-varying FSD (for use in sea-ice models, for example).

Satellite Imagery Application for Searching Buried Intrusive Structures

Introduction. At the current stage of information technology development, methods for remote sensing have been increasingly used for mineral exploration.Problem Statement. Significant capital intensity of geological works for intrusive bodies search when the crystalline basement is overlapped by a thin sedimentary cover requires the implementation of advanced methods that, on the one hand, allow reducing the costs of exploration and, on the other hand, enable increasing theaccuracy of objects identification.Purpose. The development of methodological framework for the application of remote sensing data to identify prospective areas in search of buried intrusive bodies.Materials and Methods. Medium (Landsat, Sentinel) and high (WorldView) resolution optical satellite imagery data in the thermal infrared and visible ranges of the electromagnetic radiation spectrum; radar satellite data (SRTM), multispectral aerial survey data obtained by unmanned aerial vehicles; methods for structuralinterpretation, digital terrain model analysis, results of field thermometry have been used in this research.Results. A few prospective sites for the search for buried intrusions within the Hubkivska and AnastasivskoBolyarska squares of the Novohrad-Volynskyi block of the Ukrainian Shield, regardless of the geophysical data, have been identified. These objects were later confirmed by detailed geomagnetic surveying and drilling. Withinthe detected thermal anomalies, several small (60—120 m long and 30—50 m wide) dikes have been detected. Four of the 5 wells drilled have confirmed the presence of dike bodies, and 1 well enters the fracture zone. In other areas, where detailed geophysical survey was carried out within the detected thermal anomalies, new dike bodieshave been discovered.Conclusions. The developed technique may be used as an additional tool in geological prospecting.

AOSVSSNet: Attention-Guided Optical Satellite Video Smoke Segmentation Network

Smoke is more observable than open fires. Optical satellite video has the advantages of a wide monitoring range, fast response speed, and good economy in large-scale surface smoke monitoring tasks. It can be used in wide-area forest wildfire monitoring, battlefield dynamic monitoring, disaster relief decision-making. The smoke segmentation method based on traditional handcrafted features is easily limited by the scene and data. This paper introduces the deep learning method to the optical satellite video smoke target segmentation. However, due to the lack of real smoke images and the blurred edges of smoke, there are currently few labeled datasets for smoke segmentation in high-resolution optical satellite imagery scenes, which cannot provide sufficient training data for deep learning models. The smoke image from the satellite perspective also has the characteristics of multi-scale features and ground object background interference. To solve the above problems, we construct a set of high-resolution optical satellite imagery smoke synthesis datasets based on the optical imaging process of smoke targets, which saves the cost of manual labeling. In addition, we design an attention-guided optical satellite video smoke segmentation network model (AOSVSSNet), which can effectively suppress the ground object background's false alarm and extract the smoke's multi-scale features. Synthetic data faces the transferability problem in real-world applications, so the physical constraints of the smoke imaging process are introduced into the loss function to improve the generalization of the model in real smoke data. The comprehensive evaluation results show that the method outperforms representative semantic segmentation networks.

A Generic Bundle Adjustment Methodology for Indirect RPC Model Refinement of Satellite Imagery

This article describes a generic bundle adjustment methodology for multi-view stereo pipelines for 3D reconstruction from high-resolution optical satellite imagery. The Rational Polynomial Camera (RPC) model of each input view is refined by composing it with a rotation that compensates errors related to the attitude angles encoding the satellite orientation. A set of tie points, derived from feature tracks detected across the input images, is used to find the optimal corrective rotations by minimization of the reprojection error. We evaluate the performance of our method using time series of SkySat acquisitions over two different areas of interest. As an internal evaluation metric we compute the standard deviation between corresponding height estimations derived from different stereo pairs, before and after the bundle adjustment correction. Lastly, the results are also compared to an alternative solution for multi-view stereo pipelines that eludes any explicit correction of the camera models by directly registering independent dense surface models.

Forest Aboveground Biomass Estimation and Mapping through High-Resolution Optical Satellite Imagery—A Literature Review

This paper provides a comprehensive literature review on forest aboveground biomass (AGB) estimation and mapping through high-resolution optical satellite imagery (≤5 m spatial resolution). Based on the literature review, 44 peer-reviewed journal articles were published in 15 years (2004–2019). Twenty-one studies were conducted in Asia, eight in North America and Africa, five in South America, and four in Europe. This review article gives a glance at the published methodologies for AGB prediction modeling and validation. The literature review suggested that, along with the integration of other sensors, QuickBird, WorldView-2, and IKONOS satellite images were most widely used for AGB estimations, with higher estimation accuracies. All studies were grouped into six satellite-derived independent variables, including tree crown, image textures, tree shadow fraction, canopy height, vegetation indices, and multiple variables. Using these satellite-derived independent variables, most of the studies used linear regression (41%), while 30% used linear multiple regression and 18% used non-linear (machine learning) regression, while very few (11%) studies used non-linear (multiple and exponential) regression for estimating AGB. In the context of global forest AGB estimations and monitoring, the advantages, strengths, and limitations were discussed to achieve better accuracy and transparency towards the performance-based payment mechanism of the REDD+ program. Apart from technical limitations, we realized that very few studies talked about real-time monitoring of AGB or quantifying AGB change, a dimension that needs exploration.

An Object-Based Approach for Mapping Tundra Ice-Wedge Polygon Troughs from Very High Spatial Resolution Optical Satellite Imagery

Very high spatial resolution commercial satellite imagery can inform observation, mapping, and documentation of micro-topographic transitions across large tundra regions. The bridging of fine-scale field studies with pan-Arctic system assessments has until now been constrained by a lack of overlap in spatial resolution and geographical coverage. This likely introduced biases in climate impacts on, and feedback from the Arctic region to the global climate system. The central objective of this exploratory study is to develop an object-based image analysis workflow to automatically extract ice-wedge polygon troughs from very high spatial resolution commercial satellite imagery. We employed a systematic experiment to understand the degree of interoperability of knowledge-based workflows across distinct tundra vegetation units—sedge tundra and tussock tundra—focusing on the same semantic class. In our multi-scale trough modelling workflow, we coupled mathematical morphological filtering with a segmentation process to enhance the quality of image object candidates and classification accuracies. Employment of the master ruleset on sedge tundra reported classification accuracies of correctness of 0.99, completeness of 0.87, and F1 score of 0.92. When the master ruleset was applied to tussock tundra without any adaptations, classification accuracies remained promising while reporting correctness of 0.87, completeness of 0.77, and an F1 score of 0.81. Overall, results suggest that the object-based image analysis-based trough modelling workflow exhibits substantial interoperability across the terrain while producing promising classification accuracies. From an Arctic earth science perspective, the mapped troughs combined with the ArcticDEM can allow hydrological assessments of lateral connectivity of the rapidly changing Arctic tundra landscape, and repeated mapping can allow us to track fine-scale changes across large regions and that has potentially major implications on larger riverine systems.

Significant contribution of small icebergs to the freshwater budget in Greenland fjords

Icebergs represent nearly half of the mass loss from the Greenland Ice Sheet and provide a distributed source of freshwater along fjords which can alter fjord circulation, nutrient levels, and ultimately the Meridional Overturning Circulation. Here we present analyses of high resolution optical satellite imagery using convolutional neural networks to accurately delineate iceberg edges in two East Greenland fjords. We find that a significant portion of icebergs in fjords are comprised of small icebergs that were not detected in previously-available coarser resolution satellite images. We show that the preponderance of small icebergs results in high freshwater delivery, as well as a short life span of icebergs in fjords. We conclude that an inability to identify small icebergs leads to inaccurate frequency-size distribution of icebergs in Greenland fjords, an underestimation of iceberg area (specifically for small icebergs), and an overestimation of iceberg life span.

Automatic silage maize detection based on phenological rules using Sentinel-2 time-series dataset

ABSTRACT Recently, availability of valuable high spatial and temporal resolution optical satellite imagery such as Sentinel-2 has provided a great opportunity for a wide variety of crop-related studies including crop phenology detection, crop biophysical and biochemical parameter estimation, and crop-type mapping. Most current crop mapping methods focus on supervised classification, demanding a large number of field sampling points to feed the classifier. In this paper, we propose an automatic method for silage maize mapping based on Sentinel-2 time-series data in three agricultural areas in Iran (namely Marvdasht, Abyek, and Mashhad) and an individual area in USA (Tulare County, California). We considered Marvdasht as the training site and other three sites as the test sites. After the preprocessing step, temporal profiles of the Normalized Difference Vegetation Index (NDVI) were computed from Sentinel-2 time-series images in 2017 and 2018. Then, the Savitzky–Golay filter was applied to the NDVI profile for noise reduction. Linear interpolation was also used for the construction of continuous NDVI time-series during the maize growing season. Then, phenological parameters were extracted in Marvdasht, for maize and other crops. After comprehensive analyses, the ratio of the slope from the peak of the greenness to the harvest (SPGH) to the length of the growing season (LOS) was suggested as an appropriate variable for automatic maize detection. Evaluation of this variable in the study sites confirmed its feasibility for automatic maize mapping, with the kappa coefficient values of 0.89, 0.8, 0.9, and 0.8 in Abyek, Marvdasht, Mashhad, and Tulare in 2017, respectively. The performance of the suggested method for the second year (2018) is close to those of 2017 which means that maize detection algorithm results are consistent and robust across years. Moreover, to ascertain high potential of the proposed variable, the results were compared with those of the maximum likelihood (ML) and support vector machine (SVM) classifiers in the test sites. The performance of SVM (with a large number of training samples) was analogous to that of the suggested automatic method in terms of accuracy; however, inferior performance of ML was evident. The results of this research demonstrated the great potential of our proposed phenological method in automatic silage maize mapping.

Integration of high-resolution optical and SAR satellite remote sensing datasets for aboveground biomass estimation in subtropical pine forest, Pakistan.

In this study, we investigate stand-alone and combined Pleiades high-resolution passive optical and ALOS PALSAR active Synthetic Aperture Radar (SAR) satellite imagery for aboveground biomass (AGB) estimation in subtropical mountainous Chir Pine (Pinus roxburghii) forest in Murree Forest Division, Punjab, Pakistan. Spectral vegetation indices (NDVI, SAVI, etc.) and sigma nought HV-polarization backscatter dB values are derived from processing optical and SAR datasets, respectively, and modeled against field-measured AGB values through various regression models (linear, nonlinear, multi-linear). For combination of multiple spectral indices, NDVI, TNDVI, and MSAVI2 performed the best with model R2/RMSE values of 0.86/47.3 tons/ha. AGB modeling with SAR sigma nought dB values gives low model R2 value of 0.39. The multi-linear combination of SAR sigma nought dB values with spectral indices exhibits more variability as compared with the combined spectral indices model. The Leave-One-Out-Cross-Validation (LOOCV) results follow closely the behavior of the model statistics. SAR data reaches AGB saturation at around 120-140 tons/ha, with the region of high sensitivity around 50-130 tons/ha; the SAR-derived AGB results show clear underestimation at higher AGB values. The models involving only spectral indices underestimate AGB at low values (< 60 tons/ha). This study presents biomass estimation maps of the Chir Pine forest in the study area and also the suitability of optical and SAR satellite imagery for estimating various biomass ranges. The results of this work can be utilized towards environmental monitoring and policy-level applications, including forest ecosystem management, environmental impact assessment, and performance-based REDD+ payment distribution.

Building Extraction in Multitemporal High-Resolution Remote Sensing Imagery Using a Multifeature LSTM Network

Inspired by recent promising developments by deep learning networks, this letter presents a novel approach based on a multifeature long short-term memory (LSTM) network with an optimal unit number for extracting buildings from multitemporal high-resolution optical satellite imagery. The algorithm first extracts specified multifeature data of buildings, including spectral, shape, texture, and indices from multitemporal high-resolution imagery. Next, a designed LSTM network architecture with an optimal unit number is trained using the multifeature data to extract buildings at the pixel level. The proposed network is compared with popular deep learning-based networks, including VGG, U-Net, and ResNet. Finally, postprocessing (e.g., morphological algorithm) is employed to optimize the classification results produced by deep learning. The approach is validated on a newly created data set using Gaofen-2 (GF-2) imagery that contains various buildings on a campus with different materials, shapes, sizes, heights, and directions. Experimental results indicate that the proposed approach outperforms current deep learning-based methods for building extraction and has a potential for practical applications.

Filtering DSM extraction from Worldview-3 images to DTM using open source software

Today, the Indonesia one map policy has encouraged for producing maps up to scale 1/5.000 – 1/10.000. Therefore, all efforts to accelerate large-scale map production are still needed. One of the challenges is for producing DEM (Digital Elevation Model). DEM data extraction from high-resolution optical satellite imagery is an efficient choice for the production of large-area DEM. This study uses Worldview 3 stereo ready images for DSM (Digital Surface Model) Extraction. Although the DSM data have a high resolution 30cm x 30cm, unfortunately, the DEM extraction techniques from optical images produce DSM (Digital Surface Model) data instead of DTM. While topographic maps generally use DTM data instead of DSM. So, the goal of this study is to use an appropriate procedures method in Open-Source (OS) software towards the generation of Bare-Earth data by filtering DSM. The OS software is SAGA-GIS that it is can be used for any point cloud data. The quality of DTM generated by SAGA-GIS is evaluated by visual interpretation from Worldview 3 orthoimage itself. A good filtering result will remove the non-terrain point. Some independent check point used to evaluate the error in elevation. The error in elevation still less than 2 pixels. Final product is a high resolution DTM which has 30cm × 30cm grid spacing.

The Impact of Urban Renewal on Land Surface Temperature Changes: A Case Study in the Main City of Guangzhou, China

To improve land use efficiency, urban renewal must also consider urban microclimates and heat islands. Existing research has depended on manual interpretation of high-resolution optical satellite imagery to resolve land surface temperature (LST) changes caused by urban renewal; however, the acquired ground time series data tend to be uneven and unique to specific frameworks. The objective of this study was to establish a more general framework to study LST changes caused by urban renewal using multi-source remote sensing data. Specifically, urban renewal areas during 2007–2017 were obtained by integrating Landsat and yearly Phased Array type L-band Synthetic Aperture Radar (PALSAR) images, and LST was retrieved from Landsat thermal infrared data using the generalized single-channel algorithm. Our results showed that urban renewal land (URL) area accounted for 1.88% of urban land area. Relative LST between URL and general urban land (GUL) of Liwan, Yuexiu, Haizhu, and Tianhe districts dropped by 0.88, 0.42, 0.43, and 0.10 K, respectively, whereas those of Baiyun, Huangpu, Panyu, and Luogang districts presented opposite characteristics, with a rise in the LST of 0.98, 1.03, 1.63, and 2.11 K, respectively. These results are attributable to population density, building density, and landscape pattern changes during the urban renewal process.