Optoelectronic Surveillance Research Articles

Modeling and analysis of fractal transformation of distorted images of the Earth's surface obtained by optoelectronic surveillance systems

Modeling and analysis of fractal transformation of distorted images of the Earth's surface obtained by optoelectronic surveillance systems

Аналіз стану і тенденції розвитку орбітальних угруповань малих космічних апаратів дистанційного зондування Землі для вирішення завдань землероб-ства

The goal of this paper is to assess the existing capabilities of orbital constellations of agriculture-oriented Earth remote sensing spacecraft and the prospects for their development in the nearest future. The paper analyzes the state of the art and the trends in the development of modern orbital constellations of private companies’ small Earth remote sensing satellites used in solving agricultural problems. Important sources of information in the space industry, such as NewSpace Index, Gunter's Space Page, and WMO OSCAR, were analyzed. 52 constellations of spacecraft for optical multispectral and hyperspectral, thermal, and microwave (radar) imaging are considered. It is shown that they provide a survey frequency of several times a day. The minimum spatial resolution of optoelectronic surveillance sensors is 1 m (in the panchromatic channel). This allows one to solve problems at an intrafield level, quasi-continuously monitor the plant condition, and use spectral patterns and texture features in solving applied agricultural problems. All the constellations of radar satellites use the X-band, except for the radars of the Spacety constellation (China), which use the C-band. It is shown that the number of constellations of small remote sensing spacecraft in the period 2021–2025 is to be increased by more than three times compared to the period 2016–2020. The number of countries developing constellations of Earth remote sensing satellites has increased significantly. The leading countries and companies in the number and size of constellations are the United States and China and Planet (USA) and Chang Guang Satellite Technology Corporation (China), respectively. Private developers are particularly interested in thermal infrared imaging and hyperspectral optical imaging data. A new line in the private space industry, which is expected to facilitate the solution of agricultural problems, is the deployment of constellations of small meteorological satellites.

Development of a two-stage method for segmenting the color images of urban terrain acquired from space optic-electronic observation systems based on the ant algorithm and the hough algorithm

The object of this study is the high level of errors of the first and second kind in the segmentation of images of urbanized areas acquired from space optoelectronic surveillance systems. The method of image segmentation of urbanized areas implies two stages and, unlike known ones: – takes into account each channel of brightness of the color space of the original image; – at the first stage, an ant algorithm is used; – image segmentation at the first stage is reduced to the calculation of the objective function, the areas of movement of ants, and the concentration of pheromone on the routes of ant movement. – at the second stage, the brightness and geometric shape of the elements of objects are taken into account; – contours and geometric primitives are defined in the Hough parameter space; – the objects of interest of the urbanized area in the space of the original image are determined. An experimental study into the segmentation of images of urbanized terrain acquired from space optoelectronic observation systems was carried out based on the ant algorithm and the Hough algorithm. The quality of image segmentation of the urbanized area was assessed. It was found that the error of the first kind when using the improved method of segmentation is reduced by 2.75 %. The error of the second kind is reduced by 3.91 % when using the improved method of segmentation. This reduction became possible due to the use of an improved method of segmenting the image of an urbanized area by the ant algorithm at the first stage. Compared to Canny's algorithm, the error of the first kind decreased by 8.9 %, and the error of the second kind decreased by 11.0 %. Methods for segmenting images of urbanized areas acquired from space optoelectronic surveillance systems can be implemented in software and hardware systems of image processing

МЕТОДИ АНАЛІЗУ ЗОБРАЖЕНЬ МІСЦЕВОСТІ В НАВІГАЦІЙНИХ СИСТЕМАХ БПЛА

The paper analyzes modern methods of terrain image analysis in UAV navigation systems and presents experimental results of UAV navigation method research based on the use of spatial-spectral portraits of objects in terrain areas. In the conditions of radio-electronic suppression of the UAV navigation system by EW means, there is an urgent need for the development and application of new jam-proof UAV navigation methods. The purpose of the work is to substantiate the method of terrain image analysis in UAV technical vision systems. To achieve this goal, the following tasks were announced in the work: an analysis of the possible use of existing methods and systems of technical vision on UAVs was carried out; the substantiation of the method of image analysis using spatial-spectral terrain portraits in UAV technical vision systems was carried out. The method of calculating the traveled path based on the analysis of the flow of video data coming from the optoelectronic surveillance devices, the method of accurate mapping on the terrain based on the stereo effect that occurs during camera movement, and the method of accurate mapping based on reference photographs are analyzed. In order to improve the efficiency of the UAV technical vision system, it is proposed to use spatial-spectral portraits of objects in areas of the terrain. At the same time, the video frames are compared with embedded spectral portraits of the route sections, in the case of "recognition", the exact coordinates and orientation of the UAV are determined. The application of this method is connected with the need to take into account the impact of lighting changes on the spectral indicators of objects and areas of the terrain. The research examines existing techniques for correcting lighting changes for various cameras in laboratory and field conditions. It is proposed to use experimentally obtained dependencies for specific brands of sensor equipment to carry out corrections for changes in natural lighting. When organizing navigation systems based on spectral portraits of the terrain, it is recommended to use objects and areas with the most stable optical characteristics in relation to changes in lighting.

Devising a method for segmenting images acquired from space optical and electronic observation systems based on the Sine-Cosine algorithm

The object of this study is the process of segmentation of images acquired from space optoelectronic surveillance systems. The method to segment images from space optoelectronic surveillance systems based on the Sine-Cosine algorithm involves determining the threshold level; unlike the known ones, the following is carried out in it: – preliminary selection of red-green-blue color space brightness channels in the original image; – calculation of the maximum distance of movement of agents in the image in each brightness channel; – calculation of the values that determine the movement of agents in the image in each brightness channel; – determining the position of agents in the image using trigonometric functions of the sine and cosine in each brightness channel. An experimental study into segmenting images acquired from space optoelectronic surveillance systems based on the Sine-Cosine algorithm was carried out. It was found that the improved method of image segmentation based on the Sine-Cosine algorithm makes it possible to segment the images. In this case, objects of interest, snow-covered objects of interest, background objects, and undefined areas of the image (anomalous areas) are identified. The quality of image segmentation was assessed using the Sine-Cosine algorithm-based method. It was found that the improved segmentation method based on the Sine-Cosine algorithm reduces the segmentation error of the first kind by an average of 21 % and the segmentation error of the first kind by an average of 17 %. Methods of image segmentation can be implemented in software and hardware systems that process images acquired from space optoelectronic surveillance systems. Further studies may involve comparing the quality of segmentation by the method based on the Sine-Cosine algorithm with segmentation methods based on evolutionary algorithms (for example, genetic ones).

Features of the Application of the Detection Algorithm Based on the Background Subtraction Method in the Scanning Optoelectronic Surveillance System

The article considers the approach developed by the authors to adapt the detection algorithm based on the background subtraction method to work in a scanning optoelectronic surveillance system. This algorithm is the basis of the developed image processing method applied to the problem of detecting moving objects by an optoelectronic thermal imaging surveillance system. At the same time, this method provides a solution to the tasks of protecting a critical object with an optoelectronic surveillance system, which must function both in stationary and scanning mode. The use of an improved mixture of Gaussian distributions to build a background model makes it possible to adapt to periodic changes in pixel brightness from dynamic background elements of the observed scene. However, the application of this detection algorithm in a scanning optoelectronic system requires the solution of the following problematic issues: the exclusion of false highlighting of the areas of the processed image in the foreground when transferring the sensor field of view; the elimination of errors in the initial values of the parameters of a mixture of Gaussian distributions. The application of the approach proposed by the authors to solving these issues is implemented in a specialized optoelectronic surveillance system and allows achieving the same quality of the detector based on the background subtraction method in scanning mode as in stationary mode.

Evaluating the Effectiveness of Image Processing in the Task of Detecting Moving Objects by an Optoelectronic Surveillance System

The article considers the approach proposed by the authors to evaluate the effectiveness of image processing in detecting moving objects by an optoelectronic surveillance system. The variety of indicators currently used by researchers to assess the quality of image processing suggests that common approaches have not yet been developed. The application of specific indicators is determined by the features of the implemented approaches to the image processing, as well as the specifics of the task in the interests of which the processing is carried out. The problem considered by the authors, assessing the effectiveness of the developed image processing method in relation to the problem of detecting moving objects by an optoelectronic surveillance system, determines the need for its consideration in two directions. The first is from the point of view of the effectiveness of the implemented approaches to image processing in order to increase the peak signal-to-noise ratio. The second is, in terms of increasing the efficiency of the automatic detector, by reducing the level of its false alarm. At the same time, the need for additional determination of the probability of correct detection and the construction of detection curves is mandatory, since in their entirety they are generally accepted indicators of the quality of detection. The application of the proposed approach will allow further comparison of the quality of the developed image processing method with other similar methods, as well as evaluation of the work of newly developed ones.

PERFORMANCE EVALUATION OF DUAL CHANNEL OPTOELECTRONIC SURVEILLANCE SYSTEM WITH NEURAL NETWORK INFORMATION FUSION

Optoelectronic surveillance systems are widely used in many areas of human activity: in agriculture, medicine, military systems, in search and rescue operations. These systems are designed for space, airborne, ground and maritime applications. They have to work under all climate conditions with absolute certainty under all light and weather conditions. And on the other hand, they have to be cost effective. That’s why optoelectronic surveillance systems use channels which provide complimentary information about the object and background. And for the most applications channels that operate in visible and thermal ranges of optical spectrum are indispensable element of such systems. Optoelectronic surveillance systems have to continuously meet and even exceed today’s performance and reliability requirements. That’s why there is a need to use not only cutting-age technology, but also adaptive signal processing. Information fusion is state-of-the-art technic to improve overall system performance. Numerous image fusion methods have been proposed during several decades but the most promising are neural networks. Television system, which work in visible range of optical spectrum, and thermal system, which work in long-wave infrared range where chosen for the modeling. Probability of target detection, recognition and identification was used for performance evaluation. Probability of target detection, recognition and identification for separate long-wave infrared and television channels were modeled. Also, probabilities were estimated for the fused data. Information fusion was done with the help of convolutional neural networks. Simulation results showed that probability of target detection, recognition and identification are almost for 6% higher for fused data compared to separate channels.

Обзор современного состояния орбитальных группировок космических аппаратов дистанционного зондирования Земли и космических ретрансляторов

Currently in the USA and Western European countries there are many spacecrafts for Earth remote sensing in the interests of obtaining very high-resolution radio monitoring data with various types of target load: optoelectronic surveillance, radar surveillance, radio- and radio en-gineering reconnaissance. In this review article, most modern foreign optoelectronic surveillance spacecrafts are considered, including the families with the best resolution on the ground: Worldview, QuickBird, GeoEye, Keyhole, Pleiades, Spot, Eros, Cartosat; radar surveillance: Ra-darsat, SAR-Lupe, Lacrosse, ERS, Terrasar, Envisat, IGS; radio- and radio engineering recon-naissance: TacSat, Jumpseat, Orion, Vortex, Mentor, Magnum, Mercury, and Intruder. The article also discusses modern space systems for relaying information in high orbits: TDRSS, SDS, EDRS, DRTS, CTDRSS, which provide the possibility of instantaneous transmission of informa-tion to its recipients, with account for the characteristics of transponders and the frequency ranges used. The main technical characteristics of remote sensing spacecraft and satellite repea-ters, through which the target information is reset to remote information reception and processing points, have been analyzed, summarized, and systematized. This structured review will eventually allow specialists in the aviation and rocket and space industry, dealing with issues of radio monitoring of radiated radio signals, to assess the efficiency of obtaining target information with the required quality based on the results of real-time radio monitoring.

КЛАСИФІКАЦІЯ АВТОМАТИЗОВАНИХ ПРИЛАДОВИХ КОМПЛЕКСІВ СТАБІЛІЗАЦІЇ

The article is devoted to automated instrument stabilization systems. The authors systematized and presented the classification of modern stabilizers. High-precision automated instrument stabilization systems are used in light armoured vehicles, performing the functions of search acceleration, determining the coordinates of moving objects in extreme conditions; observation of ground, air and surface targets. Also promising is the use of automated instrumentation stabilization systems in aviation gravimetry for the exhibition of the axes of sensitivity of navigation sensing elements (gravimeters). A characteristic feature of the development of modern technology is the improvement of technical characteristics of all instrumentation systems that are part of the product management system, including stabilizers. This process is due to the transition to a digital element base, the use of new information sensors, new optoelectronic surveillance devices and the development of new circuit design solutions, which, in turn, increases the speed of equipment and its manoeuvrability due to greater automation. The article reveals the principle of classification of stabilizers: by object of stabilization, by number of stabilization planes, by type of measured coordinate, by gyroscope function, by type of actuator, by type of regulation, by type of circuit design. The functioning of the digital instrumental system for measuring mechanical parameters and stabilization by means of functional and structural diagrams of the channel of the automated instrumental stabilization complex is shown. The above is a new, more detailed classification of automated instrumentation stabilization systems, which systematizes the principles of construction of modern stabilizers.

Effect of laser interference on the detection capabilities of an infrared optoelectronic surveillance system

Effect of laser interference on the detection capabilities of an infrared optoelectronic surveillance system

ОСНОВНІ ПОЛОЖЕННЯ, ЩО ПОТРЕБУЮТЬ УРАХУВАННЯ ПРИ СТВОРЕННІ СИСТЕМИ ПІДТРИМКИ ПРИЙНЯТТЯ РІШЕНЬ НА РОЗПОДІЛ СИЛ І ЗАСОБІВ ДЛЯ ЗАБЕЗПЕЧЕННЯ ДОСТАТНЬОГО РІВНЯ ЕФЕКТИВНОСТІ ОХОРОНИ КОРДОНУ НА ДІЛЯНЦІ ЗАСТОСУВАННЯ СИСТЕМИ ОПТИКО-ЕЛЕКТРОННОГО СПОСТЕРЕЖЕННЯ

The article is devoted to the substantiation of the choice of the basic methodology for assessing the effectiveness of the optoelectronic surveillance system, which could be taken as the basic model of this system for the distribution of forces and means to ensure a sufficient level of border protection efficiency. taking into account in the specified basic methodology for assessing the effectiveness of the system. As a result of the study it was found that as a basic method of assessing the effectiveness of the optoelectronic surveillance system, it is advisable to adopt a method based on a probabilistic approach to describe the processes that accompany the functioning of the optoelectronic surveillance system. It is also substantiated that the main provisions that need to be taken into account when creating a decision support system for the distribution of forces and means to ensure a sufficient level of border protection in the field of optoelectronic surveillance are: homogeneous in terms of features of technical means of border protection time periods; adequate integrated laws of distribution of time periods, which determine the probability of non-detection of the target to its approach to a given distance by certain technical means of border protection, which are part of the studied system of optoelectronic surveillance; points of "stitching" of various integral laws of distribution at the ends of the specified periods; the impact of weather changes over a period of time, which characterizes the period of the service organization, on the functioning of the system; "Dead" zones, which are dynamically variable depending on the natural and man-made conditions that arise in the area of responsibility.

METHOD OF IMAGE PROCESSING IN THE PROBLEM OF DETECTING MOVING OBJECTS IN OPTICAL-ELECTRONIC SURVEILLANCE SYSTEMS OF THERMAL IMAGING TYPE

The article considers the method of image processing proposed by the author in relation to the problem of automatic detection of moving objects in optoelectronic thermal imaging systems. Moving objects on the observed scene are subject to investigation, so it is advisable to use algorithms based on background subtraction methods to solve the detection problem. However, the observed objects may include objects of interest (a person, a vehicle), as well as other objects and background elements that increase the noise component of the observed situation. Also, the increase in the noise component is greatly influenced by false segmentation in the foreground of the areas of processed images when transferring the field of view of the sensor of the optical-electronic surveillance system. The purpose of this article is to prove the reduction of the probability of false alarm of an automatic detector due to the author's proposed approaches to image processing. The research uses the mathematical apparatus of probability theory and simulation with subsequent statistical processing of data. The article shows that the probability of a false alarm of an automatic detector based on the background subtraction method increases significantly after the transfer of the field of view of the sensor of the optical-electronic surveillance system and decreases after the movement stops as the areas of the processed image that are falsely highlighted in the foreground are automatically segmented. The simulation showed that the approaches proposed by the author can increase the peak signal-to-noise ratio of processed images and reduce the probability of a false alarm of the automatic detector of objects of interest. The results obtained show the feasibility of adapting detection algorithms based on background subtraction methods to work in scanning optoelectronic surveillance systems.

Методика оценивания эффективности применения орбитальных систем малых космических аппаратов оптико-электронного наблюдения

The paper presents the results of analysing existing approaches to estimating how efficient small orbital spacecraft systems are for the purpose of optoelectronic surveillance, including determining their shortcomings. We simulated employing an orbital system required to ensure surveying the earth surface at various latitudes, accounting for sunrise and sunset time on the winter and summer solstice days, and discovered that the following parameters show low sensitivity: average daily object sighting number at a preset latitude and maximum time delay between object sightings at a preset latitude. We propose a new efficiency factor reflecting a confidence interval regarding the object sighting time delay. We developed a procedure utilising the factor proposed, expanding the scientific methodology in terms of estimating how efficient small orbital spacecraft systems are for optoelectronic surveillance. We obtained object sighting time delays at a preset latitude as functions of the probability of these delays occurring. We recommend using this procedure to estimate the efficiency of jointly employing several small orbital spacecraft systems and incomplete composition systems, as well as to state and solve the problem of synthesising the ballistic structure of an orbital system intended to improve the efficiency of earth surveillance.

МЕТОД БАГАТОМАСШТАБНОГО ОБРОБЛЕННЯ ЗОБРАЖЕНЬ З БОРТОВИХ СИСТЕМ ОПТИКО-ЕЛЕКТРОННОГО СПОСТЕРЕЖЕННЯ ДЛЯ ВИЗНАЧЕННЯ ЕЛЕМЕНТІВ МІСЬКОЇ ІНФРАСТРУКТУРИ

Предметом вивчення в статті є метод багатомасштабного оброблення зображень з бортових систем оптикоелектронного спостереження для визначення елементів міської інфраструктури. Метою є розробка методу багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження для визначення елементів міської інфраструктури. Завдання: аналіз відомих методів оброблення багатомасштабної послідовності зображень, розробка методу багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження для визначення елементів міської інфраструктури, проведення оброблення зображення з бортової системи оптико-електронного спостереження. Використовуваними методами є: методи теорії імовірності, математичної статистики, методи оптимізації, математичного моделювання та цифрової обробки зображень, методи математичної логіки. Отримані такі результати. Встановлено, що відомі методи оброблення багатомасштабної послідовності зображень не можуть бути напряму застосовані до багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження. Запропоновано метод багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження для визначення елементів міської інфраструктури. В основі методу покладений двоетапний метод виділення об’єктів міської забудови на зображеннях бортових систем оптикоелектронного спостереження з використанням перетворення Хафа. Проведено оброблення зображення з бортової системи оптико-електронного спостереження методом багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження для визначення елементів міської інфраструктури. Висновки. Наукова новизна отриманих результатів полягає в наступному. Запропоновано метод багатомасштабного оброблення зображень з бортових систем оптико-електронного спостереження для визначення елементів міської інфраструктури. На відміну від відомих, передбачається використання двоетапного методу визначення елементів міської інфраструктури на зображеннях з різним значення масштабного коефіцієнта, перемасштабування оброблених зображень з різним значенням масштабного коефіцієнта до вихідного розміру та розрахунок зображення-фільтру, а результуюче оброблене зображення є попіксельним добутком вихідного зображення та зображення-фільтру.

Software and algorithmic complex of simulation modeling for research and development of optoelectronic surveillance systems

Software and algorithmic complex of simulation modeling for research and development of optoelectronic surveillance systems

МОДУЛЬНЫЕ КОМПЛЕКСЫ НА БАЗЕ ЛАЗЕРНЫХ ДАЛЬНОМЕРОВ

The article discusses the main trends in the improvement of modern optoelectronic surveillance tools created on the basis of laser rangefinders.

Helmet-Mounted Attitude Control Algorithms of the Opto-Electronic Surveillance System for Aircraft Search and Rescue Actions

Abstract This article presents selected results of work concerning the errors modeling of helmet-mounted cueing systems used for guided weapon and opto-electronic surveillance systems target homing (for realizing aircraft search and rescue actions). There were described algorithms of helmet angular position determination on the basis of inertial and magnetic methods, moreover, the possibilities of their modification. On this background there were presented the authorial method of pilot’s helmet angular position determination dedicated for helmet-mounted cueing systems for fighter helicopters. The method is based on the pilot’s helmet and aircraft body linear accelerations measurements, which then are used for the current quaternion evaluation to describe the helmet position relatively to the aircraft. Simulation models were tested in Matlab-Simulink and Borland C++ computational packages for various pilot’s helmet space orientation using specialized rotation test stands.

EVALUATING THE EFFECTIVENESS OF THE OPTICAL-ELECTRONIC SURVEILLANCE SYSTEM

Context. In the protection of the state border of Ukraine used the new system of optical-electronic observation (SOEO). However, its potential is not fully realized. One of the reasons for this is the lack of scientific and methodological apparatus of evaluation of the effectiveness of its functioning in various factors of natural and technogenic character. The latter makes it relevant to conduct appropriate research. Objective. The aim of this work is to develop a methodology for assessing the efficiency of SOEO. Method. The proposed indicators of efficiency of functioning of individual surveillance technology and their integrated use with one tower system opto-electronic surveillance. The work also proposed a new indicator of efficiency of functioning of system of optical-electronic observation. The indicator takes into account features of conducting observations with the comprehensive use of various technical means of border protection in various conditions of natural and technogenic character, and given the terrain. Substantiation of expediency of their application involved the use of probabilistic-statistical methods. Results. On the basis of information about digital characteristics of the topography of the investigated area carried out determining unobservable areas, the so-called “dead zones”. The proposed method of calculating the index of efficiency of functioning of system of opticalelectronic observation. The description of algorithmic and software implementation of this technique. Using the developed software the analysis of the functioning of the current system optical-electronic surveillance, identified key problematic aspects and directions of improving the efficiency of SOEO. Conclusions. Modern building of SOEO is not optimal. Possible directions of increase of efficiency of its functioning can be optimization of the placement of the towers system on the ground, adjusting the height placement on the towers of surveillance technology and a good selection of the technical means of observation

Segmentation of the images obtained from onboard optoelectronic surveillance systems by the evolutionary method

The essence of the simpler evolutionary method of image segmentation which relates to ant methods was set forth. The image segmentation process was presented as a set of areas in which agents (ants) move. Probability of transition from one turning point of the route to another was determined taking into account attractiveness of the route and concentration of pheromones on it. A timely convergence of decisions (choice of the same route by the agents) is processed by the use of feedback, i.e. evaporation of pheromones. The parameters setting pheromone weight and attractiveness of the area were calculated. The routes which are the most attractive according to the selected criteria (with the maximum concentration of pheromone) were determined. Unattractive routes disappear with a gradual drying of pheromone on such routes. When checking function ability of the simpler evolutionary segmentation method, it was found that implementations of this method with obviously unsuccessful results are possible. Essence of the advanced evolutionary method of image segmentation as improvement of the simpler evolutionary method was outlined. In the improved method, only the best agents increase the level of pheromone on their routes. The level of pheromone on the routes is limited. An expression has been obtained for renewal of pheromone levels. The best route may be either the iteration best or the best-so-far (found since the start of the method) route. In contrast to the simpler evolutionary method, an optimal route of agent movement was found during segmentation of images in all implementations with the use of the advanced evolutionary method. Experimental studies of segmentation of the images obtained from the onboard systems of optoelectronic surveillance using the evolutionary method have been carried out. As an example, possible objects of interest were defined in the segmented image and it was established that the outlined contours of the main objects of interest coincide with the boundaries of the objects in the original image. Presence of a large number of outlined contours of small-sized objects in the segmented image was pointed out and an example of such area was given. Visual estimation of efficiency of application of the evolutionary method was made