Abstract

Lasso-type models are a popular approach for analysing high-dimensional data. The size of modern data sets can be quite large, so developing efficient algorithms is important. Feature screening techniques have proven to be effective at increasing efficiency, as they allow for considerable dimension reduction during the optimization process. In this paper, we develop an adaptive hybrid screening framework where screening is carried out adaptively along the path of tuning parameter values, reusing previous solutions to reduce heavy screening computations if they fail to significantly reduce dimensionality. We focus on the standard lasso model and sparse logistic model, but the proposed framework is flexible and can be easily extended to different types of lasso models. Through experiments involving a wide variety of simulated and real data sets, we show that the adaptive hybrid methods significantly outperform other state-of-the-art methods, with the greatest speedup occurring in the most challenging scenarios.

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.