Early Childhood Environment Rating Scale-Revised Research Articles

Expert practitioner's views about the Chinese early childhood environment rating scale

ABSTRACTThis study aims to examine the views of 176 expert practitioners on the relevance and feasibility of applying the Chinese Early Childhood Environment Rating Scale (CECERS), which is developed based on the Chinese version of Harms, Clifford, and Cryer's (2005) world renowned Early Childhood Environment Rating Scale-revised (ECERS-R). The CECERS measures the quality of Chinese kindergartens, in which teachers have traditionally utilised whole-group teaching as the main approach to curriculum planning and delivery as well as organisation of learning environment. What constitutes quality kindergarten practice in the Chinese contexts and tension between ‘objective’ quality and culturally-appropriate quality will be discussed. Using a five-point Likert Scale, reviewers rated and provided comments for: (1) the quality of the instrument overall; (2) the appropriateness of the major changes made in CECERS in comparison to the ECERS-R; and (3) feedback for each quality dimension. Results, organised by the predetermined survey questions, show that, overall, reviewers highly support CECERS as a much needed, valuable, quality measure. They also support all the suggested changes to make the instrument culturally relevant and contextually meaningful. Meanwhile, they offer helpful suggestions for future revisions and pose some issues and concerns about the applicability of the instrument to measure quality practice in rural areas of China which are worth debating.

Identifying baseline and ceiling thresholds within the Qualistar Early Learning Quality Rating and Improvement System

Increasingly, states are implementing quality rating and improvement systems (QRIS) as a means of improving the availability of high-quality child care and children's school readiness skills. A fundamental design decision under QRIS is where to set the thresholds on the quality measures used in the program assessment component of the QRIS. This study applied generalized additive modeling (GAM) on data from Colorado's QRIS in order to identify thresholds on several components of Colorado's QRIS, including the Early Childhood Environment Rating Scale-Revised (ECERS-R), classroom ratios, and staff credentials. We found evidence of baseline thresholds that needed to be surpassed before significant relationships between quality and outcomes could be observed. In addition, there were ceiling thresholds, such that beyond certain cut-points, gains in quality were associated with little to no improvements in outcomes. Based on this work, it appears that GAM can be used to empirically identify thresholds, but more research is needed to understand the applicability of the GAM-derived thresholds in other early care contexts and settings.

Comparing cultural differences in two quality measures in Chinese kindergartens: the Early Childhood Environment Rating Scale-Revised and the Kindergarten Quality Rating System

This study examined the degrees of congruence between two early childhood evaluation systems on various quality concepts: the Early Childhood Environment Rating Scale-Revised (ECERS-R) and Zhejiang’s Kindergarten Quality Rating System (KQRS). Analysis of variance and post hoc least significant difference tests were employed to show the extent to which the ECERS-R ratings predict a kindergarten’s placement on the KQRS. Results found two quality dimensions (Language-reasoning and Interaction) that did not distinguish the quality between any levels of kindergartens, whereas one dimension (Space and furnishing) successfully distinguished the quality between all levels of kindergartens. Activities and Programme structure only distinguished the quality differences between Level-2 and Level-3 kindergartens, whereas Personal care and Routines only distinguished the quality differences between Level-1 and Level-3 kindergartens. Findings based on item-level analysis provided further insights into underlying cultural and contextual reasons for differences found in the concepts of quality in the two evaluation systems.

Reliability and validity of the Early Childhood Environment Rating Scale, Revised Edition, ECERS-R in Arabic

The aim of this study was to test reliabilities and validations for the Arabic translation of the Early Childhood Environment Rating Scale, Revised (ECERS-R) scale [Harms, T., Clifford, R. M., & Cryer, D. (1998). Early childhood environment rating scale, revised edition. New York: Teachers College Press]. ECERS-R mean scores were tested for reliability at the indicator, item and total score levels. Test–retest, inter-rater and internal consistency correlation agreements were used on a sample of 50 childcare centres randomly sampled, representing category (national or private), region, type of childcare provision and classroom level (3–6 years) in Bahrain. High agreement levels (Cohen's kappas) between raters for mean total (0.797), item (0.78) and indicator (0.91) scores and internal consistency, 0.95 (Cronbach alpha) support ECERS-R as a reliably translated measure of quality identifiable in Arabic. Content, concurrent and predictive measures of validity included the Caregiver Interaction Scale significantly related with the ECERS-R (r = .56 Pearson product moment) and higher staff qualification levels which predicted higher ECERS-R scores, ANOVA F(1, 49) = 3.81, p = .05. Factor analyses identified high item loadings (>.69) for the total ECERS-R scale and also with the two factors: teaching and interaction and provisions and learning (Clifford, R., Reszka, S. and Rossbach, H. (2010). Reliability and validity of the early childhood environment rating scale. Chapel Hill: FPG Child Development Institute, University of North Carolina), demonstrating the ECERS-R in Arabic to be a reliable and valid instrument. Further research evidence using the Arabic scale is needed.

An assessment of the validity of the ECERS-R with implications for measures of child care quality and relations to child development.

The Early Childhood Environment Rating Scale-Revised (ECERS-R) is widely used to associate child care quality with child development, but its validity for this purpose is not well established. We examined the validity of the ECERS-R using the multidimensional Rasch partial credit model (PCM), factor analyses, and regression analyses with data from the Early Childhood Longitudinal Study Birth Cohort. The PCM identified rating category disordering, indicating previously unrecognized problems with the scale's response process validity. Factor analyses identified neither a single factor nor the ECERS-R six subscales, replicating prior research regarding the scale's structural validity. Criterion validity results were mixed, with small effect sizes for regressions predicting child outcomes and moderate effect sizes for regressions predicting teacher-reported quality. Our results lend empirical support to recent critiques of the ECERS-R, and we discuss implications for its future use and for the development of future measures.

Preschool Education in Belize: Research on the Current Status and Implications for the Future

Early childhood education is the foundation of a child's education. Belize is a developing country and is striving towards the development of its educational system. This study describes the status of preschool education in Belize using three methods of collecting data: survey, observations, and interviews. A national survey described the education, qualifications, and experience of preschool teachers and directors/principals. Three instru ments, Early Ch ildhood Environment Rating Scale-Revised (ECERS-R), Early Childhood Environ ment Rating Scale-Extension (ECERS-E), and the Careg iver Interaction Scale (CIS), were scored in 41 preschools to describe the physical environment, curricu lu m implementation, and teacher-child interaction, respectively. A modification of the ECERS-R and ECERS-E, named the Early Childhood Environ ment Rating for Belize (ECERS-B), was created. The modified version is an instrument that is compatible with the culture of Belize. The quality of preschools environments were at the min imal with evidence of positive teacher-child interaction. A one-way ANOVA indicated significant differences with teacher education level, suggesting that teachers with education qualifications higher than a high school diplo ma had higher scores on the ECERS-B. Finally, four major stakeholders were interviewed to find out their perception of early childhood education in Belize. Belize has implemented initiatives to imp rove the quality of early childhood education. Recommendations for policy, practice, and future research are suggested.

Parental conceptions of quality in Greek early childhood education

The aim of the current study was to examine the assessments of parents of the quality of early childhood education (ECE) in Greece. Five hundred and fifty three preschoolers' parents participated in this study providing quality and importance ratings based on the Early Childhood Environment Rating Scale Parent Questionnaire (ECERSPQ) for the aspects of ECE. The same aspects were evaluated with Early Childhood Environment Rating Scale-Revised (ECERS-R) by trained observers. Results suggested that parent ratings overestimate the quality of ECE provided to their children, compared to those of trained observers. Yet, both parent and observer ratings appeared to have a constant variance. Moreover, observers' results indicated that the provision of ECE quality in Greece has to be improved in order to reach acceptable standards as in other developed countries.

A Multi-Instrument Examination of Preschool Classroom Quality and the Relationship Between Program, Classroom, and Teacher Characteristics

Research Findings: A statewide study of preschool classroom quality was conducted using 3 distinct classroom observation measures in order to inform a statewide quality rating system. Findings suggested that Tennessee preschool classrooms were approaching “good” quality on the Early Childhood Environment Rating Scale–Revised (ECERS-R) and provided a mid-to-high emotional and engaging climate as indicated by the Classroom Assessment Scoring System (CLASS) domains of Emotional Support and Student Engagement. However, classrooms were only minimal on the Early Childhood Environment Rating Scale–Extension and the CLASS Instructional Support domain. Past performance on a state quality rating assessment consistently predicted the current quality of preschool classrooms as assessed by all 3 measures. Lead teachers' education in early childhood and experience were also predictors across quality measures. Practice or Policy: Tennessee preschool classrooms scored higher on the ECERS-R, which is the measure utilized in the statewide Quality Rating and Improvement System. However, classrooms generally performed poorly on measures of instructional support and curriculum. This finding illuminates the importance of the tool selected to measure quality in state quality rating and improvement systems and has implications for policy as states work to build systems that enhance quality in early care and education.

The impact of preprimary school on primary school achievement in Bangladesh

Abstract Evidence was collected regarding changes over 3 years in the quality of a preprimary program in rural Bangladesh and differences in school achievement of children who did and did not attend. The quality of 30 preprimary schools was evaluated using the ECERS-R (Early Childhood Environment Rating Scale – Revised) and ECERS-E (– Extension). Results indicated that the quality improved overall from 3.50 in 2006 to 5.24 in 2008. Samples of 180 graduates of these schools were annually followed into first and second grades and tested for five competencies: speaking, writing, reading, oral mathematics and written mathematics. Their achievement scores were compared with students in their classrooms and students in neighboring schools who did not have the opportunity to attend preprimary schools. First graders in 2008 performed significantly better than comparisons in all competencies, and better than earlier graduates. Second graders performed significantly better than comparisons on all but Reading. Qualities of the math preprimary program correlated with math achievement in Grade 1 only. Consequently the quality of the preprimary program improved over time along with higher achievement for its graduates. The findings support efforts to expand high-quality programs in developing countries to help children succeed in the early primary grades.

Using the ACEI Global Guidelines Assessment to Evaluate the Quality of Early Child Care in Greek Settings

In recent years, there has been a significant growth of interest in ensuring that child care provision for children is of a high quality. This interest has been stimulated by research evidence according to which good quality child care has a positive influence on children’s overall development. The global quality in Greek preschool and infant/toddler classrooms was assessed with ACEI Global Guidelines Assessment (GGA), Early Childhood Environment Rating Scale-Revised (ECERS-R) and Infant Toddler Environment Rating Scale (ITERS). Our research data, confirm previous research results from Greece, and suggest that Greek child care centers provide low quality care and education. Comparisons between the tools employed revealed great similarity between the ACEI GGA and ECERS-R ratings on issues relating to environment and physical space, program evaluation, communication with families, opportunities for family and community participation, recognition of diversity, curriculum and activities, etc. On the other hand the ACEI GGA and ITERS seem to measure different aspects of process quality, as far as infant care and education are concerned. Research results indicate the need for immediate improvement and revision of the policies employed by Greek state, as far as young children’s education and care are concerned.

Individual Experiences of Children With and Without Disabilities in Early Childhood Settings

This study examined the global quality of early care and education settings and individual children's experiences in those settings. Sixty 4- to 5-year-old children (30 with disabilities and 30 without disabilities) were observed using the Early Childhood Environment Rating Scale—Revised (ECERS-R) and items from the ECERS-R adapted to focus on individual children's experiences. Early childhood global quality had the largest effect on individual children's experiences, after controlling for maternal education and child problem behavior. This relationship varied by children's problem behavior but not by disability status. When parents reported more problem behavior in children in classrooms of higher global quality (ECERS-R score), individualized ECERS-R experience ratings were lower.

Are the indicators for the Language and Reasoning Subscale of the Early Childhood Environment Rating Scale‐Revised psychometrically appropriate for Caribbean classrooms?

Evaluating the psychometric properties of the indicators that comprise the Early Childhood Environment Rating Scale‐Revised (ECERS‐R) language‐reasoning scale from an item response theory (IRT) perspective on a sample of observations from 334 Caribbean classrooms, Stout’s procedure revealed that all indicators on this dimension are not part of a single essentially unidimensional construct. IRT‐based factor analyses on the indicator scores yielded two factors – named Language‐Reasoning Activities and Language‐Reasoning Materials. IRT analyses conducted on these two factors revealed that their indicators provide adequate psychometric information and have no floor effects – although they demonstrate evidence for ceiling effects. IRT also revealed that at least within the Caribbean context: (a) the ECERS‐R authors have ordered the indicators inappropriately; (b) administration of all indicators is unnecessary; and (c) equally weighting indicators might yield spurious results. IRT‐based scoring might improve the psychometric soundness of indicators on this ECERS‐R scale.

Towards a predictive model of quality in Canadian child care centers

This paper reports on the design, methodology, and results of a study of quality in 326 classrooms in 239 Canadian child care centers. This study, the largest and most extensive ever undertaken in Canada, used the Caregiver Interaction Scale (CIS) to rate the adult–child interactions in the classrooms and the Infant–Toddler Environment Rating Scale (ITERS) and the Early Childhood Environment Rating Scale-Revised (ECERS-R) to measure the quality of classroom learning environments. The observed staff members completed questionnaires on wages, working conditions, and satisfaction levels, and the center directors also completed questionnaires on center operations and finances. Path analyses revealed that in the infant/toddler rooms the number of adults in the observed classroom and the education level of the observed staff member were direct predictors of quality. In addition, there were three indirect predictors: parent fees, adult:child ratio, and use of the center as a student teacher practicum site. There were five significant direct predictors in the preschool classrooms: wages, education level, number of staff in the observed room, staff satisfaction, and whether the center received free or subsidized rent or utilities. The three indirect predictors were auspice, adult:child ratio, and parent fees. The interaction of distal and proximal factors is interpreted and applied to the development and implementation of public policy initiatives that can provide much-needed improvement to the overall mediocre levels of child care quality in Canada.

Parent involvement in child care settings: conceptual and measurement issues

This paper discusses the conceptualization and measurement of Parent Child Care Involvement (PCCI) and questions whether PCCI should be included in high‐stakes quality ratings. It presents data on several PCCI measures, including one used by the National Association for the Education of Young Children, the Parent Caregiver Relationship Scale (Elicker et al., 1997) and PCCI items from the National Longitudinal Survey of Youth and the Early Childhood Environment Rating Scale—Revised (ECERS‐R). Across these measures parents uniformly describe child care providers as welcoming and supportive even when other quality measures reveal significant problems. Providers display similar positivity when reporting their own PCCI efforts. A new author‐devised measure, Family–Provider Partnership, produces similar positivity bias. Nevertheless, Family–Provider Partnership scores were strongly associated with other measures of child care quality, including the ECERS‐R Infant‐Toddler Environment Rating Scale (ITERS), ratios and staff credentials. Such relationships justify inclusion of PCCI in child care quality ratings.

Revisiting the Two Faces of Child Care Quality: Structure and Process

While child care quality has been examined in numerous studies, the definition of quality and specifically, the concepts of structural and process quality, have not been adequately explored. In this qualitative analysis of the constructs of process and structural quality, a content analysis of the Early Childhood Environment Rating Scale-Revised (ECERS-R), a commonly used measure of process quality, was conducted to investigate its use as a measure of process quality. Through constant comparative analysis of the ECERS-R at the indicator level, definitions of structure and process were formulated. Results show that over half of the indicators of the ECERS-R are measuring structural quality rather than process quality. Further examination of quality as a dynamic exchange between individuals and context is needed to advance research in the area of early childhood program quality.

Measurement of quality in preschool child care classrooms: An exploratory and confirmatory factor analysis of the early childhood environment rating scale-revised

The purpose of the current study was to examine the psychometric properties of the Early Childhood Environment Rating Scale-Revised (ECERS-R) with a large sample (1313 classrooms). We explored both the seven subscales and the possibility of fewer distinct aspects of quality being measured by the scale. The large sample size allowed both exploratory and confirmatory factor analyses to be performed. The results showed two distinct factors, Activities/Materials (nine items) and Language/Interaction (seven items), which accounted for 69% of the variance. High internal consistency scores, a moderate correlation between the factor-based scales, and a strong correlation between the combined factor-based scales and the overall ECERS-R score suggested these were distinct factors that could serve as a proxy for the larger scale. Structural aspects of quality and teacher education were examined in relation to the new factor-based scales and the overall score. Implications for practitioners and future research suggestions are provided.

Examining the psychometric properties of the Early Childhood Environment Rating Scale-Revised (ECERS-R)

The psychometric properties of the revised Early Childhood Environment Rating Scale (ECERS-R) were examined using 202 Colorado child care centers. A factor analysis revealed that the ECERS-R does not measure seven distinct aspects of quality, as asserted by the developers of the ECERS-R, but instead measures one global aspect of quality. This suggests high redundancy among the 43 items in the ECERS-R. We selected subgroups of items randomly, by identifying easy-to-administer items, and by having practitioners select items they deemed to be especially important to child-care provider quality. Comparison of scores on these different subgroups of items to the overall ECERS-R scores revealed that the subgroups provided highly similar measures of quality. Relationships between scores based on each of the subgroups of items and the overall ECERS-R scores to staff credentials and staff-to-child ratios were comparable. Results suggest that much smaller subgroups of items provide information that is very similar to information generated by administering the full ECERS-R. Findings are interpreted in light of growing use of the ECERS-R in high-stakes settings.