Abstract
Wisdom of the crowd, the collective intelligence from responses of multiple human or machine individuals to the same questions, can be more accurate than each individual and improve social decision-making and prediction accuracy. Crowd wisdom estimates each individual’s error level and minimizes the overall error in the crowd consensus. However, with problem-specific models mostly concerning binary (yes/no) predictions, crowd wisdom remains overlooked in biomedical disciplines. Here we show, in real-world examples of transcription factor target prediction and skin cancer diagnosis, and with simulated data, that the crowd wisdom problem is analogous to one-dimensional unsupervised dimension reduction in machine learning. This provides a natural class of generalized, accurate and mature crowd wisdom solutions, such as PCA and Isomap, that can handle binary and also continuous responses, like confidence levels. They even outperform supervised-learning-based collective intelligence that is calibrated on historical performance of individuals, e.g. random forest. This study unifies crowd wisdom and unsupervised dimension reduction, and extends its applications to continuous data. As the scales of data acquisition and processing rapidly increase, especially in high-throughput sequencing and imaging, crowd wisdom can provide accurate predictions by combining multiple datasets and/or analytical methods.
Highlights
Introduction and approachThe concept of wisdom of the crowd was originated in social sciences [1] well before Fisher established meta-analysis quantitatively [2]
We applied dimension reductions methods that are non-parametric (PCA, factor analysis (FA), and multi-dimensional scaling (MDS)) or nearest neighbour based (locally linear embedding (LLE), Hessian LLE, local tangent space alignment (LTSA), Isomap, and spectral embedding) to estimate the class probability ranking from the individual classifications (§3)
principal component analysis (PCA) and FA were superior to most individual dermatologists and were among the top crowd wisdoms
Summary
Introduction and approachThe concept of wisdom of the crowd was originated in social sciences [1] well before Fisher established meta-analysis quantitatively [2]. P (survival | all data) crowd wisdom method combined prediction better estimate seeing a wider range of applications of the crowd wisdom or meta-analysis in [7,8,9,10]. As long as the group or ensemble of individuals remain unbiased as a whole, aggregating individual estimators for the same predictive variables would strengthen the signal and cancel out their errors. This can be regarded as a more complex version of averaging multiple measurements of the same variable
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.