Programme For The International Assessment Of Adult Competencies Research Articles

Unsupervised Anomaly Detection in Sequential Process Data

Abstract: In this study, we present three types of unsupervised anomaly detection to identify anomalous test-takers based on their action sequences in problem-solving tasks. The first method relies on the use of the Isolation Forest algorithm to detect anomalous test-takers based on raw action sequences extracted from process data. The second method transforms raw action sequences into contextual embeddings using the Bidirectional Encoder Representations from Transformers (BERT) model and then applies the Isolation Forest algorithm to detect anomalous test-takers. The third method follows the same procedure as the second method, but it includes an intermediary step of dimensionality reduction for the contextual embeddings before applying the Isolation Forest algorithm for detecting anomalous cases. To compare the outcomes of the three methods, we analyze the log files from test-takers in the US sample ( n = 2,021) who completed the problem-solving in technology-rich environments (PSTRE) section of the Programme for the International Assessment of Adult Competencies (PIAAC) 2012 assessment. The results indicated that different groups of test-takers were flagged as anomalous depending on the representation (raw action sequences vs. contextual embeddings) and dimensionality of action sequences. Also, when the contextual embeddings were used, a larger number of test-takers were flagged by the Isolation Forest algorithm, indicating the sensitivity of this algorithm to the dimensionality of input data.

Alignment of University Competencies With Global Skill Measures

This study analysed two internationally recognised measurements of professional skills: the Programme for the International Assessment of Adult Competencies (PIAAC) and the Digital Competence Framework for Citizens (DigComp 2.2). This analysis aimed to establish a baseline and reference point for a comprehensive understanding of these two scales with the objective of exploring the most relevant competencies and assessing their potential benefits in fostering a technology-driven environment in higher education institutions in Saudi Arabia. The research yielded significant findings regarding the essential competencies that university students should possess, drawing insights from the two assessments and identifying gaps in existing manuals. The research outcomes include valuable insights and best practices that can empower a new generation of university learners to effectively engage with the requirements of Education 4.0.

Organizational Capital, Skills and Productivity

This paper studies how industries' investment in organizational capital (OC) and workforce skills relate to productivity, building on OECD estimates of OC, output data from the OECD Structural Analysis (STAN) database, and skill indicators from the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The paper finds that, at the industry level, workers' numeracy and Science, Technology, Engineering and Mathematics (STEM) skills correlate positively with productivity, and that the positive correlation of STEM skills with productivity is generally larger for OC workers. Moreover, dispersion in Information and Communication Technology (ICT) skills harms industry performance. In fact, a gap between the ICT skills of OC and non‐OC workers seems to trigger a “lost in translation” type of mechanism, whereby communication and information flows become less fluid and impinge upon the economic performance of sectors, correlating negatively with productivity.

Are general skills important for vocationally educated?

In this paper, we examine the effect of general skills on wages for vocationally educated workers with a qualification at upper secondary level. While general skills are considered crucial for labour market success of workers in general, it is not clear whether this also holds for the vocationally educated workers. We use the recently developed concept of effective skills to identify the relationship between general skills and wages for this group. Using data from the Programme for the International Assessment of Adult Competencies (PIAAC) in 25 countries with advanced economies, we show that general skills strongly affect wages of vocationally educated workers and are just as important a factor as they are for generally educated workers. For vocationally educated males, the effect is especially salient for older workers (aged 45 and above). For vocationally educated females, general skills are most important in the beginning of their career (aged 20 to 35) and at prime age (aged 36 to 45).

Associations between education, information-processing skills, and job automation risk in the United States

Job automation is a topical issue in a technology-driven labor market. However, greater amounts of human capital (e.g., often measured by education, and information-processing skills, including adult literacy) are linked with job security. A knowledgeable and skilled labor force better resists unemployment and/or rebounds from job disruption brought on by job automation. Therefore, the purpose of this study was to advance understanding of the association between educational attainment and literacy, and job automation risk. Using the 2012/2014/2017 Program for the International Assessment of Adult Competencies (PIAAC) data, survey-weighted linear regression was used to model the risk of job automation as a function of education, and literacy proficiency. Higher educational attainment (college or higher vs. less than high school: b = −18.23, p < .05) and greater literacy proficiency (score 0–500 points: b = −.038, p < .05) were associated with a decrease in job automation risk among the U.S. workforce.

Routinization and Employment: Evidence for Latin America

We study changes in employment by occupations characterized by different degree of exposure to routinization in the six largest Latin American economies over the last two decades. We combine our own indicators of routine task content based on information from the Programme for the International Assessment of Adult Competencies (PIACC) with labor market microdata from harmonized national household surveys. We find that the increase in jobs was decreasing in the automatability of the tasks typically performed in each occupation, and increasing in the initial wage, a pattern more consistent with the traditional skill-biased technological change than with the polarization hypothesis.

Identifying literacy and numeracy skill mismatch in OECD countries using the job analysis method

Abstract The Programme for the International Assessment of Adult Competencies (PIAAC) is currently the most important data source that provides information on the key skills possessed by workers, including literacy and numeracy. However, to assess skill mismatch, we also need information on the required skills in those domains, measured in the same metric and scale. In this article, we use the Job Analysis Method (JAM) to determine the required skill levels of literacy and numeracy for all four-digit International Standard Classification of Occupations (ISCO) 2008 unit groups. JAM is often considered the ‘gold standard’ in estimating required levels but has never been used in the context of PIAAC. This article thus presents the first results on the prevalence of skill mismatches using JAM comparing different OECD (Organisation for Economic Co-operation and Development) countries and different occupations. We compare our results with alternative methods and show some advantages of using JAM. We discuss some of the limitations as well.

Reliance on Social Networks and Health Professionals for Health Information in the U.S. Adult Population.

The subpopulation of adults depends on non-online health information sources including their social networks and health professionals, to the exclusion of online sources. In view of the digital divide and health information disparities, the roles of race/ethnicity and digital skills are yet to be explored. A nationally representative sample of 6,830 adults from the Program for the International Assessment of Adult Competencies (PIAAC) was analyzed, using binary logistic regression. Black adults and adults with higher digital skills were less likely to be reliant on non-online health information sources, compared to White adults and those with lower digital skills, respectively. Differences in non-online health information source reliance by race/ethnicity and digital skills might be further nuanced by the relevant demographic and socioeconomic characteristics. Increasing digital skills may expand one's health information sources to include reliable online sources and empower adults to promote their health.

Social functioning and personal development among individuals with low literacy skills; the role of active labour market policy

Abstract Even as education becomes increasingly important for functioning in society, and many welfare states have taken responsibility for providing education, many individuals have insufficient skill levels to fully participate in society. This paper investigates the relationship between literacy skills and basic functioning and participation in society, focusing on the role of the welfare state, and whether individuals with low literacy skills are better off in terms of labour market outcomes, quality of life, digital participation and adult learning in countries with higher investments in active labour market policies (ALMPs), and three underlying spending categories: 1) public employment services, 2) training and 3) private sector employment incentives. Through multi-level analysis of 25 Economic Co-operation and Development (OECD) countries and 139,449 individuals, using individual-level data from the Programme for the International Assessment of Adult Competencies (PIAAC) and country-level data from the OECD, our results show that while low literacy is associated with less favourable conditions related to all outcome variables investigated, ALMPs do not always moderate these negative associations. This is especially true for labour market participation, health and on-the-job training. However, higher ALMP spending is associated with more favourable conditions among low-literate individuals when it comes to job satisfaction, digital participation and life-long learning.

The Role of the Welfare State for NEETs: Exploring the Association Between Public Social Spending and NEET in European Countries

This study explores the role of the welfare state in reducing young people not being in education, employment, or training (NEET)s across 15 European countries. Using data from the Survey of Adult Skills in the Program for the International Assessment of Adult Competencies (PIAAC) in combination with the Social Expenditure Database, we conducted cross-national analysis to reveal whether the increase in public social spending moderates the risk of being NEET at a young adult age, especially for socially disadvantaged young people. Our results highlighted that the rise of one percentage point of public social spending per gross domestic product, including social expenditure on education, active labor market, and unemployment, is significantly associated with decreasing the odds of being NEET. Furthermore, these social expenditures appeared to lower the NEET risk given socially disadvantaged backgrounds suggesting that young people with low educational levels, whose parents have low educational attainment levels, non-immigrant families, and females are likely to benefit given the robust social protection system. These findings suggest that public social spending may be an effective investment in promoting the social involvement of young people from socially disadvantaged background.

Exploring the Complexities of Social Engagement Among Young Adults

This study aims to enhance understanding of young adults’ social outcome. The existence of large multinational Program for the International Assessment of Adult Competencies (PIAAC) data provides the opportunity to explore the relationship between young adults' propensity to volunteer and various background data in several countries. The focus of this study was on investigating the relationship between young adults volunteering and their educational attainment, social trust, gender, participation in lifelong learning, and cognitive skills in numeracy. The findings suggest that while significant characteristic differences exist among millennials who engage in volunteering activities, only a few of these characteristics such as their numeracy skills, participation in lifelong learning, and social trust influenced their propensity to engage in civic activities. These findings contribute to our understanding of the factors that influence millennials' participation in civic activities.

Literacy, numeracy, and problem-solving skills of adults with disabilities in STEM fields

To aid in the development of a globally competitive workforce, federal policymakers have expressed the priority of preparing students and adults with disabilities to succeed in science, technology, engineering, and mathematics (STEM) fields. Yet, no research has examined the extent to which information-processing, literacy, numeracy, and problem-solving skills in technologically rich environments may associate with having a STEM degree for various disability populations. This study analyzed the United States nationally representative data from the Programme for the International Assessment of Adult Competencies (PIAAC) to examine associations between adult skills and having a STEM degree for people with and without disabilities. No direct associations were found between adult skills and having a STEM degree for people with learning disabilities or for people without disabilities. These groups’ information processing, literacy, numeracy, and problem-solving skills were not determining factors in STEM degree attainment. However, findings suggest a significant association between problem-solving skills and having a STEM degree for people with visual and/or hearing impairments. Policy implications are discussed.

Rule-based process indicators of information processing explain performance differences in PIAAC web search tasks

BackgroundA priori assumptions about specific behavior in test items can be used to process log data in a rule-based fashion to identify the behavior of interest. In this study, we demonstrate such a top-down approach and created a process indicator to represent what type of information processing (flimsy, breadth-first, satisficing, sampling, laborious) adults exhibit when searching online for information. We examined how often the predefined patterns occurred for a particular task, how consistently they occurred within individuals, and whether they explained task success beyond individual background variables (age, educational attainment, gender) and information processing skills (reading and evaluation skills).MethodsWe analyzed the result and log file data of ten countries that participated in the Programme for the International Assessment of Adult Competencies (PIAAC). The information processing behaviors were derived for two items that simulated a web search environment. Their explanatory value for task success was investigated with generalized linear mixed models.ResultsThe results showed item-specific differences in how frequently specific information processing patterns occurred, with a tendency of individuals not to settle on a single behavior across items. The patterns explained task success beyond reading and evaluation skills, with differences across items as to which patterns were most effective for solving a task correctly. The patterns even partially explained age-related differences.ConclusionsRule-based process indicators have their strengths and weaknesses. Although dependent on the clarity and precision of a predefined rule, they allow for a targeted examination of behaviors of interest and can potentially support educational intervention during a test session. Concerning adults’ digital competencies, our study suggests that the effective use of online information is not inherently based on demographic factors but mediated by central skills of lifelong learning and information processing strategies.

Measuring Intellectual Curiosity across Cultures: Validity and Comparability of a New Scale in Six Languages

Intellectual curiosity—the tendency to seek out and engage in opportunities for effortful cognitive activity—is a crucial construct in educational research and beyond. Measures of intellectual curiosity vary widely in psychometric quality, and few measures have demonstrated validity and comparability of scores across multiple languages. We analyzed a novel, six-item intellectual curiosity scale (ICS) originally developed for cross-national comparisons in the context of the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). Samples from six countries representing six national languages (U.S. Germany, France, Spain, Poland, and Japan; total N = 5,557) confirmed that the ICS possesses very good psychometric properties. The scale is essentially unidimensional and showed excellent reliability estimates. On top of factorial validity, the scale demonstrated strict measurement invariance across demographic segments (gender, age groups, and educational strata) and at least partial scalar invariance across countries. As per its convergent and divergent associations with a broad range of constructs (e.g., Open-Mindedness and other Big Five traits, Perseverance, Sensation Seeking, Job Orientations, and Vocational Interests), it also showed convincing construct validity. Given its internal and external relationships, we recommend the ICS for assessing intellectual curiosity, especially in cross-cultural research applications, yet we also point out future research areas.

Engaging Low-Skilled Adults in Education and Training: Exploring Participation Rates, Challenges, and Strategies

The need for non-formal education (NFE), which does not result in a formal degree or certificate, is substantial as labour markets often require adult workers to take an initiative in advancing their jobrelated skills. Yet, NFE opportunities are more often pursued by highincome and high-skilled adults than their low-income and low-skilled counterparts. For this study, we used data from the 2012 Programme for the International Assessment of Adult Competencies (PIAAC) for Canada, the Netherlands, Norway, Sweden and the US, to compare participation rates in NFE by medium/high and low-skilled adults. Additionally, to gain insights of adult education and training policies that promote NFE, international key informant interviews (n = 33) and document reviews were conducted. Findings include (a) as compared to high-skilled adults, low-skilled adults are less likely to participate in NFE (b) as compared to the US, low-skilled adults in Norway and the Netherlands are more likely to participate in NFE, and (c) NFE is often more acceptable to low-skilled adults, possibly due to previous negative experiences with formal education. These findings are especially relevant to the increased need for retraining and reskilling as a result of the COVID-19 pandemic, which has negatively impacted low-skilled workers more than their higher skilled counterparts (OECD, 2020a).

Beyond human capital: how does parents’ direct influence on their sons’ earnings vary across eight OECD countries?

Abstract This article asks to what degree the association between parents’ education and sons’ earnings is mediated by various forms of sons’ human capital across eight large OECD countries. We exploit the OECD Program for the International Assessment of Adult Competencies (PIAAC) database, which provides information on four dimensions of human capital (educational attainment, field of study, cognitive skills, and proxies of non-cognitive skills). We find that the intergenerational transmission process is wholly mediated just by sons’ formal educational attainment in Germany, Norway, and the USA. By contrast, in France, Italy, Spain, Poland, and the UK, a significant residual association remains after we control for all dimensions of sons’ human capital. While we cannot exclude that this residual association is due to unobservable background-related skills sons might have, this also points to family origin factors unrelated to human capital accumulation—such as social ties—that might play a role in the intergenerational transmission of labour market advantages in these countries.

O Programa Internacional para a Avaliação das Competências dos Adultos (PIAAC) e o estudo das desigualdades sociais e educativas

The Programme for the International Assessment of Adult Competencies (PIAAC) is a leading international multi-cycle study promoted by the Organization for Economic Co-operation and Development (OECD). Portugal's participation in PIAAC’s Cycle 2 will make available, from December 2024 on, very detailed information on literacy, numeracy and problem-solving competencies of adults residing in the country, which will allow for the clarification, among many other issues, of the relations between social inequalities and the possession and use of those competencies, opening very promising perspectives for their promotion and development, in a socially fair way. The availability, in open access form, of the data resulting from PIAAC represents a significant opportunity for researchers, who will be able to broaden and deepen the use of a source of information that has been intensively mobilized since data from Cycle 1 was made available. This article presents the main characteristics of PIAAC and explores some possibilities the Programme’s data brings to the study of social inequalities.

Características das empresas e demandas dos empregadores por competências resultados preliminares da aplicação em Portugal do “Módulo de Empregadores” do PIAAC

Currently in its second cycle, the Programme for the International Assessment of Adult Competencies(PIAAC) includes, besides its main component, the“Survey of Adult Skills”, an “Employer Module on Skill Gaps” containing several questions designed to measure the imbalances between the supply and the demand for the skills needed in workplaces.A small group of European countries, which Portugal integrated, added this additional inquiry to the data collection process that was developed within the “Survey of Adult Skills”. The aim was to enlarge the available information on employers’ perspectives on skill gaps and how they relate to companies’ business strategies, and hiring, training and human resource practices.This article presents the goals, methodology and main technical features of the implementation of PIAAC’s “Employer Module” in Portugal, and discusses in preliminary terms some of its results, thus seeking to instigate further research carried out using the data that was recently made available.

Assessed Numeracy Skills and Skill Use of Adults With Learning Disabilities in PIAAC

Adults with learning disabilities (LD) face educational and employment challenges and may also have other disabilities and health conditions. Little is known about these adults’ numeracy skills and how they use numeracy at work or home. The article’s objective was to investigate numeracy skills and skill use for U.S. adults with LD. The author conducted descriptive and regression analyses of the data from the 2012/2014/2017 U.S. Program for the International Assessment of Adult Competencies (PIAAC). Findings are presented on assessed numeracy skills and skill use, relationships of use and skills, and skill use among seven groups of adults with LD. Compared with the general population, adults with LD have lower mean numeracy scores. Skill use at home adds to the variance explained in numeracy skills, which suggests that using numeracy skills matters in gaining skills. Knowing the relationships of assessed numeracy skills with skill use helps educators implement strategies to support adult program completion. Implications of findings are discussed for adult educators and policymakers.

DETERMINANTS OF RETIREMENT-AGE WOMEN’S LABOR FORCE PARTICIPATION: A RUSSIA AND THE US COMPARISON

Abstract Factors such as one’s health, education, marital status, and family caregiving were found to be associated with people’s retirement timing. Few studies looked at those factors separately for men and women and few cross-cultural studies were conducted on the topic. Women tend to accumulate less income and retirement savings throughout their working careers compared to men due to having more intermittent careers and lower paying jobs. Women, in general, live longer than men and are more likely to be divorced or widowed at older ages. Thus, they must spend fewer financial resources over a longer time in retirement. One possible solution is to continue employment after reaching pensionable age. Therefore, it is important to know factors that affect women’s labor force participation at or after pensionable age.This quantitative study examines the relationship between women’s personal and family factors and their labor force participation after reaching pensionable age in Russia and the U.S. Using data from the Background Questionnaire of the Program for the International Assessment of Adult Competencies (PIAAC) survey, we analyzed a sample of Russian women ages 55 and older and American women ages 66 and older.For retirement-age Russian women, having highest level of education, living in a larger household, and having spouse or partner in the labor force were positively associated with women’s labor force participation. Likewise, American women of pensionable age with more education and a working spouse were more likely to be in the labor force. Implications for policy and future research are discussed.