Low Earth Orbit Satellite Research Articles

A simplified GNSS/LEO joint orbit determination method

Joint orbit determination (JOD) of Global Navigation Satellite Systems (GNSS) satellites and low Earth orbit (LEO) satellites has been substantiated as an efficacious approach to compensate for the ground station geometry. In the traditional JOD, the precise orbit determination (POD) of LEO satellite is mainly processed by the reduced-dynamic approach, however, this approach involves complex calculations and the credibility of the determined positions diminishes when LEO satellites undergo orbital maneuvers. Therefore, a simplified JOD method is designed that employs kinematic approach to determine the LEO satellites orbit. To verify the effectiveness of the proposed method, the orbit of GPS satellites and LEO satellites are jointly estimated utilizing the regional and global networks. 8 LEO satellites, including GRACE-C/D, SWARM-A/B/C, SENTINEL-3A/B, and JASON-3, are chosen for JOD. The comparative analysis between the proposed method and traditional method are achieved in terms of GPS orbit accuracy, LEO orbit accuracy, computation time and the JOD performance during LEO maneuvers. Under regional station scenario, the GPS orbit accuracy determined using the proposed method and the traditional method is 3.64 cm and 2.52 cm, respectively. In the case of global station scenario, the accuracies are 1.71 cm and 1.64 cm. Additionally, the traditional method yields superior enhancement and higher accuracy of the LEO orbits. However, it exhibits a noticeable increase in computation time compared to the proposed method and the performance of JOD declines significantly when LEO satellites undergo orbital maneuvers. Alternatively, although the accuracy of the LEO orbits using the proposed method is comparatively lower, it offers a substantial reduction in the overall network computation time compared to traditional method. Moreover, the proposed method based on LEO kinematic precise orbit determination (KPOD) is nearly unaffected by orbital maneuvers of LEO satellites, presenting unique advantages in practical data processing.

Spreading code optimization for low-earth orbit satellites via mixed-integer convex programming

Optimizing the correlation properties of spreading codes is critical for minimizing inter-channel interference in satellite navigation systems. By improving the codes’ correlation sidelobes, we can enhance navigation performance while minimizing the required spreading code lengths. In the case of low-earth orbit (LEO) satellite navigation, shorter code lengths (on the order of a hundred) are preferred due to their ability to achieve fast signal acquisition. Additionally, the relatively high signal-to-noise ratio in LEO systems reduces the need for longer spreading codes to mitigate inter-channel interference. In this work, we propose a two-stage block coordinate descent (BCD) method which optimizes the codes’ correlation properties while enforcing the autocorrelation sidelobe zero property. In each iteration of the BCD method, we solve a mixed-integer convex program over a block of 25 binary variables. Our method is applicable to spreading code families of arbitrary sizes and lengths, and we demonstrate its effectiveness for a problem with 66 length-127 codes and a problem with 130 length-257 codes.

Caching Policy in Low Earth Orbit Satellite Mega-Constellation Information-Centric Networking for Internet of Things.

Information-Centric Networking (ICN) is the emerging next-generation internet paradigm. The Low Earth Orbit (LEO) satellite mega-constellation based on ICN can achieve seamless global coverage and provide excellent support for Internet of Things (IoT) services. Additionally, in-network caching, typically characteristic of ICN, plays a paramount role in network performance. Therefore, the in-network caching policy is one of the hotspot problems. Especially, compared to caching traditional internet content, in-networking caching IoT content is more challenging, since the IoT content lifetime is small and transient. In this paper, firstly, the framework of the LEO satellite mega-constellation Information-Centric Networking for IoT (LEO-SMC-ICN-IoT) is proposed. Then, introducing the concept of "viscosity", the proposed Caching Algorithm based on the Random Forest (CARF) policy of satellite nodes combines both content popularity prediction and satellite nodes location prediction, for achieving good cache matching between the satellite nodes and content. And using the matching rule, the Random Forest (RF) algorithm is adopted to predict the matching relationship among satellite nodes and content for guiding the deployment of caches. Especially, the content is cached in advance at the future satellite to maintain communication with the current ground segment at the time of satellite switchover. Additionally, the policy considers both the IoT content lifetime and the freshness. Finally, a simulation platform with LEO satellite mega-constellation based on ICN is developed in Network Simulator 3 (NS-3). The simulation results show that the proposed caching policy compared with the Leave Copy Everywhere (LCE), the opportunistic (OPP), the Leave Copy down (LCD), and the probabilistic algorithm which caches each content with probability 0.5 (prob 0.5) yield a significant performance improvement, such as the average number of hops, i.e., delay, cache hit rate, and throughput.

Comparing Statistical, Analytical, and Learning-Based Routing Approaches for Delay-Tolerant Networks

In delay-tolerant networks (DTNs) with uncertain contact plans, the communication episodes and their reliabilities are known a priori. To maximise the end-to-end delivery probability, a bounded network-wide number of message copies are allowed. The resulting multi-copy routing optimization problem is naturally modelled as a Markov decision process with distributed information. In this paper, we provide an in-depth comparison of three solution approaches: statistical model checking with scheduler sampling, the analytical RUCoP algorithm based on probabilistic model checking, and an implementation of concurrent Q-learning. We use an extensive benchmark set comprising random networks, scalable binomial topologies, and realistic ring-road low Earth orbit satellite networks. We evaluate the obtained message delivery probabilities as well as the computational effort. Our results show that all three approaches are suitable tools for obtaining reliable routes in DTN, and expose a trade-off between scalability and solution quality.

Modeling and simulation of earth coverage of a low earth orbit (LEO) satellite

Efficient management of operations in near space, just beyond the Earth’s atmosphere, relies on the precise control of satellites positioned relatively close to our planet. Satellite systems, serving critical functions in telecommunications, observation, exploration, and more, have demonstrated their prowess as a transformative technology, consistently delivering high-precision data over numerous years. Among satellite systems, Low Earth Orbit (LEO) technology is gaining prominence due to its advantages, including lower power requirements for transmission, reduced propagation delays, and heightened coverage for polar regions. Achieving optimal efficiency from LEO satellites necessitates a thorough understanding of their fundamental orbital parameters and precise control over them. This study explores the orbital analysis and Earth coverage considerations of LEO satellites, scrutinizing orbital parameters in detail to compute coverage areas across various scenarios. Through this investigation, the potential benefits of data exchange with ground stations facilitated by LEO satellites are explored. In addition, the implications are discussed regarding the adjustment of data exchange topologies according to geographical locations and country borders.

Investigation of the Doppler frequency shift effect on inter-channel switching time of free-space optically switched communication networks with distributed feedback laser array technique

To assess the impact of Doppler frequency shift and channel crosstalk on the performance of a four-channel free-space optically switched communication network, particularly in scenarios involving low Earth orbit satellites, we derived a bit error rate model under the influence of satellite-ground Doppler frequency shift and channel crosstalk in atmospheric turbulence. This model focuses on studying a four-channel distributed feedback (DFB) laser array through numerical simulation. We initially analyzed the effect of crosstalk on the system's switching time in the absence of Doppler frequency shift. Our research revealed that as the channel spacing increased, the impact of crosstalk on the system's optical switching time decreased. We utilized a primary power compensation solution, adjusting the output optical power for different channel spacings, to mitigate the influence of crosstalk on the system's switching time. After eliminating the effects of crosstalk, we further examined the impact of Doppler frequency shift on the system's switching time for different channel spacings. We proposed a secondary power compensation solution to mitigate the effects of both crosstalk and Doppler frequency shift on the system's switching time. Finally, through simulation experiments, we set the output optical power of the laser to 10.42mw when switching from channel 1 to channel 2, 9.05mw when switching from channel 1 to channel 3, and 8.68mw when switching from channel 1 to channel 4, ensuring a uniform switching time of 10ns. Our research results provide a solid theoretical foundation for enhancing the performance of free-space optically switched communication networks and for mitigating the impact of Doppler frequency shift on system switching time.

PCO and hardware delay calibration for LEO satellite antenna downlinking navigation signals

Augmentation of the Global Navigation Satellite System by low earth orbit (LEO) satellites is a promising approach benefiting from the advantages of LEO satellites. This, however, requires errors and biases in the satellite downlink navigation signals to be calibrated, modeled, or eliminated. This contribution introduces an approach for in-orbit calibration of the phase center offsets (PCOs) and code hardware delays of the LEO downlink navigation signal transmitter/antenna. Using the satellite geometries of Sentinel-3B and Sentinel-6A as examples, the study analyzed the formal precision and bias influences for potential downlink antenna PCOs and hardware delays of LEO satellites under different ground network distributions, and processing periods. It was found that increasing the number of tracking stations and processing periods can improve the formal precision of PCOs and hardware delay. Less than 3.5 mm and 3 cm, respectively, can be achieved with 10 stations and 6 processing days. The bias projections of the real-time LEO satellite orbital and clock errors can reach below 3 mm in such a case. For near-polar LEO satellites, stations in polar areas are essential for strengthening the observation model.

LEO satellites selection-based computation offloading algorithm in aircraft–satellite multi-access edge computing networks

The emergence of sixth-generation (6G) mobile networks and non-terrestrial networks (NTNs) has led to increased interest in low Earth orbit (LEO) satellite-based communication networks for their potential to provide global coverage and ubiquitous connectivity. In this paper, we investigate the LEO satellites selection-based computation offloading problem in the aircraft–satellite multi-access edge computing (ASMEC) network, where LEO satellites and edge computing processors are integrated to provide ubiquitous and low-latency communication and computation services for aircraft during flights. In contrast to most existing works, which directly assume a fixed number of satellites or orbits in satellite-based MEC networks, we investigate the problem of how many satellites and which satellites to select in the ASMEC network. Our objective is to minimize the average total time delay of tasks during aircraft–satellite computation offloading. To achieve this, we formulate a nonlinear integer programming (NLIP) problem and propose the LEO satellites selection-based computation offloading (LSSBCO) algorithm to solve it, which includes the shortest aircraft–satellite distance based access satellite selection (ASS-SD) algorithm and the nearest k(t) neighboring satellites selection (NSS-k(t)) algorithm. We evaluate the performance of the LSSBCO algorithm in terms of the average total time delay, the maximum throughput, the average aircraft–satellite distance, the average connection duration, and the number of satellite handovers. Numerical results show that the proposed algorithm outperforms the benchmark algorithms with a lower average total time delay.

Provably secure optimal homomorphic signcryption for satellite-based internet of things

Satellites have long been reliable and widely used mediums for communication. With recent advancements in the Internet of Things (IoT), satellite-based IoT has emerged, enhancing global connectivity by enabling real-time communication between remote sensing devices and central hubs through satellite links. However, secure and authenticated communication between Low Earth Orbit (LEO) satellites and resource-constrained ground devices remains underexplored. This paper introduces a novel homomorphic signcryption scheme designed for satellite IoT environments. Our scheme employs hyperelliptic curve cryptography and homomorphic encryption to facilitate the privacy-preserving transmission of aggregated data from multiple IoT devices to LEO satellites. We benchmark our homomorphic signcryption scheme against several established schemes tailored for different network environments, including for satellite networks, Identity-based Signcryption for Smart Grids, 3-Factor Authentication schemes and heterogeneous Vehicular Ad-hoc Networks (VANETs) encryption schemes. Our scheme demonstrates substantial improvements in computational efficiency, communication overhead, and storage capacity. It reduces computational costs by 90% to 99%, communication overhead by 41% to 92%, and storage demands by 62% to 93% compared to existing methods. These quantitative findings demonstrate the practical viability of our approach for satellite IoT deployments with limited resources. Additionally, the robustness of our approach is confirmed through formal security validation using BAN Logic and Scyther, which verifies its strong security, optimal performance, and privacy preservation capabilities, making it ideally suited for real-world satellite IoT systems.

LEO-Enhanced GNSS/INS Tightly Coupled Integration Based on Factor Graph Optimization in the Urban Environment

Precision point positioning (PPP) utilizing the Global Navigation Satellite System (GNSS) is a traditional and widely employed technology. Its performance is susceptible to observation discontinuities and unfavorable geometric configurations. Consequently, the integration of the Inertial Navigation System (INS) and GNSS makes full use of their respective advantages and effectively mitigates the limitations of GNSS positioning. However, the GNSS/INS integration faces significant challenges in complex and harsh urban environments. In recent years, the geometry between the user and the satellite has been effectively improved with the advent of lower-orbits and faster-speed Low Earth Orbit (LEO) satellites. This enhancement provides more observation data, opening up new possibilities and opportunities for high-precision positioning. Meanwhile, in contrast to the traditional extended Kalman filter (EKF) approach, the performance of the LEO-enhanced GNSS/INS tightly coupled integration (TCI) can be significantly improved by employing the factor graph optimization (FGO) method with multiple iterations to achieve stable estimation. In this study, LEO data and the FGO method were employed to enhance the GNSS/INS TCI. To validate the effectiveness of the method, vehicle data and simulated LEO observations were subjected to thorough analysis. The results suggest that the integration of LEO data significantly enhances the positioning accuracy and convergence speed of the GNSS/INS TCI. In contrast to the FGO GNSS/INS TCI without LEO enhancement, the average enhancement effect of the LEO is 22.16%, 7.58%, and 10.13% in the north, east, and vertical directions, respectively. Furthermore, the average root mean square error (RMSE) of the LEO-enhanced FGO GNSS/INS TCI is 0.63 m, 1.21 m, and 0.85 m in the north, east, and vertical directions, respectively, representing an average improvement of 41.91%, 13.66%, and 2.52% over the traditional EKF method. Meanwhile, the simulation results demonstrate that LEO data and the FGO method effectively enhance the positioning and convergence performance of GNSS/INS TCI in GNSS-challenged environments (tall buildings, viaducts, underground tunnels, and wooded areas).

Enhanced UV photodetection in SnO2 microwire arrays (MWAs) thin films by γ-ray irradiation

In this study, the gamma ray irradiation-induced photoelectric responses of SnO2 microwire arrays (MWAs) UV photodetectors were investigated and compared with the unirradiated state. The corresponding surface morphology, crystal structure, and XPS spectrum were analyzed. Results indicated that low doses (≤500krad) of gamma ray irradiation led to enhanced photocurrent and responsivity, whereas high doses resulted in significant degradation of the photoelectric response. At a radiation dose of 300krad, a photocurrent of 264 μA and a responsivity of 1.83 A/W were realized under 365 nm UV light illumination at a bias voltage of 5 V. These values represent an increase of 34.6 % and 44.1 %, respectively, compared with the unirradiated sample. Surprisingly, the fabricated SnO2 MWAs UV photodetectors demonstrated resilience to gamma ray irradiation doses up to 500krad, which is equivalent to the radiation dose accumulated by satellites in low-Earth orbit over 20 years. Our findings suggested that the fabricated SnO2 microwire arrays (MWAs) UV detector has the potential to be used for long-term space missions.

BRDF-Based Photometric Modeling of LEO Constellation Satellite from Massive Observations

BRDF-Based Photometric Modeling of LEO Constellation Satellite from Massive Observations

Bandit approach for unmanned aerial vehicle-centric low earth orbit satellite selection

In this paper, the problem of optimal low earth orbit satellite (LEO-Sat) selection by unmanned aerial vehicle (UAV) in space air ground integrated networks (SAGINs) will be investigated. The primary objective is to maximize the UAV's achievable data rate while ensuring a prolonged remaining visible time for the selected LEO-Sat. This problem poses significant challenges due to the highly dynamic nature caused by the substantial relative velocity between UAV and LEO-Sats, making LEO-Sats' features, e.g., elevation angle, remaining visible time, and the available bandwidth strongly time-dependent. Moreover, some LEO-Sats will appear/disappear from UAV visibility within short time intervals. An online learning approach will be proposed to efficiently address this highly dynamic problem, where it will be modeled as contextual multi-armed bandit (MAB) with dynamic arms. Through this modeling, the time varying LEO-Sats' features as well as their dynamic appearance/disappearance will be taken into account while selecting the best LEO-Sat. Through extensive numerical analysis, the performance of the proposed approach nearly matches that of the highly complex optimal performance based on exhaustive searching with negligible time complexity, and it outperforms conventional schemes that individually maximize one of the LEO-Sats' features.

A DRL-Based Satellite Service Allocation Method in LEO Satellite Networks

Satellite computing represents a recent computational paradigm in the development of low Earth orbit (LEO) satellites. It aims to augment the capabilities of LEO satellites beyond their current transparent relay functions by enabling real-time processing, thereby providing low-latency computational services to end users. In LEO constellations, a significant deployment of computationally capable satellites is orchestrated to offer enhanced computational resources. Challenges arise in the optimal allocation of terminal services to the most suitable satellite due to overlapping coverage among neighboring satellites, compounded by constraints on satellite energy and computational resources. The satellite service allocation (SSA) problem is recognized as NP-hard, yet assessing allocation methods through results allows for the application of deep reinforcement learning (DRL) to obtain improved solutions, partially addressing the SSA challenge. In this paper, we introduce a satellite computing capability model to quantify satellite computational resources. A DRL model is proposed to address service demands, computational resources, and resolve service allocation conflicts, strategically placing each service on appropriate servers. Through simulation experiments, numerical results demonstrate the superiority of our proposed method over baseline approaches in service allocation and satellite resource utilization, showcasing advancements in this field.

Signal design and performance analysis for LEO high dynamic navigation application

Abstract With the development of GNSS (Global Navigation Satellite System), LEO (Low Earth Orbit) systems are adopted to enhance the system performance of GNSS. The signal Doppler of the LEO satellite is seven to nine times that of GNSS signals, which benefits positioning performance but leads to high acquisition complexity. This paper proposes the combination of a CSS (Chirp Spread Spectrum) marker and the main body of traditional modulation methods for high dynamic application. The acquisition calculation complexity and mean acquisition time of the proposed signal are analysed and compared with the traditional signal. The result shows that the acquisition calculation complexity is just 26 % of the traditional signal under the parameters considered and the mean acquisition time of the proposed signal is also lower than the traditional signal. Hence, the proposed signal is able to decrease the mean acquisition time of the receiver under the constraint of calculation complexity and should be adopted for LEO high dynamic application.

LEO satellite constellations configuration based on the Doppler effect in laser intersatellite links

SummaryThis paper presents low Earth orbit (LEO) satellite constellation configuration based on the performance of Doppler effect in laser intersatellite links (LISLs). It studies the impact of the LEO constellation's parameters on the performance of the Doppler effect in LISLs. The paper aims to develop LEO satellite constellation configurations that evolve LISLs with minimal Doppler shift. It evaluates the impact of the variation of the relative distance, the inclination angle of the LEO constellation orbital planes, the orbital planes number in the LEO constellation, and the altitude on the performance of Doppler wavelength shift (DWS) in LISLs, for different operating laser wavelengths (OLWs) with respect to two possible intersatellite links (ISL) connection modes within the constellation, straight ISL (n‐to‐n) and inclined ISL (n‐to‐n − 1). n is the order of the satellite in the orbital plane. Simulations are conducted to evaluate the performance of these configurations in terms of altitude, OLW, inclination angle, and the number of orbital planes. In addition, both OneWeb and Starlink constellations are studied to evaluate DWS performance. The study demonstrates that DWS decreases either with the diminution of the relative distance between linked LEO satellites, the inclination of LEO constellation, and the OLW, or with the augmentation of the orbital planes number and altitude. Moreover, the overall DWS between two LEO satellites in the proposed constellation is at least 50% lower than the constellation configuration in other literature. The paper proposes the LEO constellation's configurations that perform LISLs with less possible Doppler effect by optimizing the LEO constellation parameters that impact the Doppler effect. The result of this study helps in the early stage of LEO satellite constellation designing in terms of payload simplicity and cost.

Multi-agent reinforcement learning based computation offloading and resource allocation for LEO Satellite edge computing networks

Due to the limitations caused by geographical conditions and economic requirements, it is difficult to provide computing services by terrestrial networks for mobile terminals in remote areas. To address this issue, mobile edge computing (MEC) servers can be deployed in the low earth orbit (LEO) satellites to act as a complement and accommodate the unserved terminals. However, offloading computing tasks to servers in satellites may increase the energy consumption of ground terminals. Considering the limited battery capacity of ground terminals, how to perform the computation offloading and resource allocation are key challenges in the LEO satellite edge computing networks. Therefore, in this paper, we investigate the energy minimization problem for LEO satellite edge computing networks, where a multi-agent deep reinforcement learning algorithm with global rewards is proposed to optimize the transmit power, CPU frequency, bit allocation, offloading decision and bandwidth allocation via a decentralized method. Simulation results show that our proposed algorithm can converge faster. Most importantly, compared with the random algorithm, the proximal policy optimization (PPO) algorithm, and the deep deterministic policy gradient (DDPG) algorithm, the ground terminals’ energy consumption can be effectively reduced by our proposed algorithm.

Joule Heating rate at high-latitudes by Swarm and ground-based observations compared to MHD simulations

We compare Joule Heating rates as derived from ground-based magnetic field and all-sky camera data, from Low Earth Orbit satellite data (ESA Swarm) and from a MHD simulation (GUMICS-5) with each other in a case study of an auroral arc system. The observational estimates of Joule Heating rates provide information on regional scales and with high spatial resolution (10–100 km). Their comparison with global MHD results is conducted for a quiet time interval of a few minutes, just before a magnetic substorm. Analysis of the ground-based observations yields electric field with dominating North-South component pointing towards the arcs and having maxima values in the range 20–35 V/km. Combining these values with Pedersen conductance estimates from optical data (5–10 S) yields Joule Heating rates in the range 2.5–3.5 mW/m2. Swarm electric field measurements are consistent in their direction and intensity with the ground-based estimates. They also show that heating is increased particularly in the region where the conductance is low. The total amount of Joule heating in the area between the Swarm A and C satellite footprints while crossing the all-sky camera field of view is estimated to be 46 MW and the total amount energy dissipation during the 80 s overflight is around 3.6 GJ (1000 kWh). GUMICS-5 estimate of the peak Joule Heating in the magnetic local time sector of the arc system is smaller than that from the ground-based data with a factor of 2.9. Comparisons of GUMICS-5 results with Space Weather Modeling Framework (SWMF), shows that the latter gives on average larger heating rates being thus more consistent with our regional observations. However, both MHD-codes yield smaller Joule Heating rates around the time of the arcs and during the following substorm than the CTIP-e code. CTIP-e has a more detailed description of ionosphere-thermosphere interactions than the MHD-codes and its convection electric field is enhanced with a randomly varying additional component mimicking small scale structures. GUMICS-SWMF comparisons of global Joule Heating patterns in the Northern polar area reveal that the two simulations have significant differences in their spatial distribution of heating rates. Main cause for these deviations is the difference in the derivation of ionospheric Pedersen conductance. Our results emphasize the fact that future estimates of the global energetics in the magnetosphere–ionosphere–thermosphere system require better knowledge on ionospheric conductivities, both by new measurement concepts and by better understanding on the background physics controlling conductivity variations.

Energy‐efficient physical layer security schemes for low Earth orbit satellite systems

SummaryThis paper introduces four proposals to enhance physical layer security (PLS) in low Earth orbit (LEO) satellite systems. The first proposal leverages the Alamouti code aided by artificial noise (AN) and involves the collaborative use of two LEO satellites, ensuring secure downlink transmission. Its efficiency is further enhanced when implementing a power‐balanced Alamouti code. The second PLS proposal capitalizes on an reconfigurable intelligent surface (RIS) to introduce interference to potential eavesdroppers. As the RIS manages the reflected channel, this security measure is achieved without necessitating additional transmit power or receiver operations. The third proposal integrates the first and second solutions, resulting in improved secrecy rates compared to the individual proposals, nearly reaching the maximum achievable rate. The fourth proposal is based on a relay‐based method, securing all transmission links from the satellite to the relay and from the satellite and relay to the legitimate user. The secrecy performance simulation results presented in the paper demonstrate the remarkable effectiveness of the proposed solutions.

An online integrated satellite–terrestrial IoT task offloading and service deployment strategy

As a core component of 6G networking, low earth orbit (LEO) satellite networks are considered a promising solution for providing network services in remote areas and have received considerable attention in recent years. Meanwhile, with the rapid development of IoT terminals and applications, an increasing emphasis has been placed on task offloading for real-time tasks. However, most existing works on task offloading for integrated satellite–terrestrial IoT (IST-IoT) applications are based on the assumption that the global task and network information is known, an assumption that is obviously not met in online real-time task offloading. In addition, current studies rarely consider the tradeoff among the task offloading volume, satellite endurance and wholesale cost of terrestrial resources, which are precisely the holistic issues that satellite network operators must confront. To address such issues, this study considers task offloading, service deployment and resource allocation in highly dynamic online task offloading scenarios with the goal of maximizing the average task offloading volume. Moreover, virtual queues are constructed in this study to account for the impacts of long-term satellite endurance and terrestrial network resource costs on task offloading. We first decouple the original problem to obtain a single-time-slot optimization problem within the Lyapunov optimization framework, and we then propose a 2-stage optimization approach based on deep reinforcement learning (DRL) to solve the complex single-time-slot mixed integer nonlinear programming (MINLP) problem. Simulation experiments demonstrate that our proposed algorithm can yield near-optimal solutions that show superior performance compared to existing results.