Abstract

As we enter the digital age, new methods of personality testing-namely, machine learning-based personality assessment scales-are quickly gaining attraction. Because machine learning-based personality assessments are made based on algorithms that analyze digital footprints of people’s online behaviors, they are supposedly less prone to human biases or cognitive fallacies that are often cited as limitations of traditional personality tests. As a result, machine learning-based assessment tools are becoming increasingly popular in operational settings across the globe with the anticipation that they can effectively overcome the limitations of traditional personality testing. However, the provision of scientific evidence regarding the psychometric soundness and the fairness of machine learning-based assessment tools have lagged behind their use in practice. The current paper provides a brief review of empirical studies that have examined the validity of machine learning-based personality assessment, focusing primarily on social media text mining method. Based on this review, we offer some suggestions about future research directions, particularly regarding the important and immediate need to examine the machine learning-based personality assessment tools’ compliance with the practical and legal standards for use in practice (such as inter-algorithm reliability, test-retest reliability, and differential prediction across demographic groups). Additionally, we emphasize that the goal of machine learning-based personality assessment tools should not be to simply maximize the prediction of personality ratings. Rather, we should explore ways to use this new technology to further develop our fundamental understanding of human personality and to contribute to the development of personality theory.

Highlights

  • Majority of research on social media text mining for personality assessment has focused on examining the convergent validity of scales derived from social media text mining on self(or observer-) reported measures of personality

  • Research efforts for empirically examining the convergent validity of social media text mining approaches for predicting personality traits is still at a very early stage, these results suggest that personality prediction from social media text data is certainly possible

  • In addition to understanding the validity and psychometric soundness, for social media text mining personality assessments to be used in applied settings, there is an important need for research demonstrating that they comply with the legal standards for use in personnel selection

Read more

Summary

Method for Literature Review

We searched prominent journals in applied psychology, psychometrics, personality, and research methods (e.g., Journal of Applied Psychology, Journal of Personality and Social Psychology, Organizational Research Methods, Psychological Assessment, Psychological Methods) for relevant references to include in our review using multiple combinations of keywords like “social media text mining,” “machine learning,” “natural language processing,” and “personality assessment.” These search terms returned 127 articles. We searched prominent journals in applied psychology, psychometrics, personality, and research methods (e.g., Journal of Applied Psychology, Journal of Personality and Social Psychology, Organizational Research Methods, Psychological Assessment, Psychological Methods) for relevant references to include in our review using multiple combinations of keywords like “social media text mining,” “machine learning,” “natural language processing,” and “personality assessment.”. We examined recent reviews on the topic of machine learning approach to personality assessment (e.g., Tay et al, 2020) and text mining (Kern et al, 2016) for relevant

Machine Learning Approach to Personality Assessment
Social Media Text Analysis Methods
Validity Evidence for Personality Assessment Using Social Media Text Mining
Open vocabulary
Text Preprocessing for Conducting Text Analysis Research
Questions for Future Research
Findings
Concluding Comments
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call