Exploring Optimization Algorithms: A Review of Methods and Applications

Abstract

This article review focuses on feature selection as the main parameter that plays a major role in tuning machine learning models. Several algorithms of optimization such as MFO (Moth-Flame Optimization), the GA-GSA algorithm’s hybrid type, SOA (Seagull Optimization Algorithm), WOA (Whale Optimization Algorithm), GOA (Grasshopper Optimization Algorithm), HGSO (Henry Gas Solubility Optimization), and SafeOpt are widely used in engineering design, power systems scheduling, The paper stresses the importance of optimization in improving efficiency, lessening mistakes and increasing understandability of machine learning models. The literature addresses the widest directions in the usage of optimization for the following fields of science such as structural engineering, additive manufacturing, and landslide susceptibility mapping. A comprehensive summary table is generated, which shows an overview of each study, algorithm, focus, and methodology and has a stoke of key findings. The conclusions reveal the adaptiveness, competitiveness and compossibility of the optimization algorithms applied to a wide range of domains. The summary shows how optimization has the potential to change decision-making processes and activities by being a decisive factor that determines the future of branches of various industries. The main objective of this work is to direct researchers and practitioners by providing them with some innovative ideas and approaches and offering insights on the existing cutting-edge approaches while laying the groundwork for future innovations in optimization.