Momentary Time Sampling Procedure Research Articles

Adding to the Evidence Base: Effects of I-Connect in a Secondary Special Education Rural Classroom

The purpose of this study was to examine the effects of a technology-based self-monitoring application, I-Connect, to enhance the on-task behavior of five secondary students (ages 15–16) with autism spectrum disorder, intellectual disability, and specific learning disability during Biology instruction in a rural special education classroom. We used an A-B-A-B withdrawal design with a generalization condition. The primary dependent variable was percent of intervals with on-task behavior as measured by momentary time sampling procedures. Results indicated overall higher levels of on-task behavior for all students when using I-Connect to monitor their behavior. However, there were also high percentages of overlapping data, and student satisfaction with the application was relatively low. Students used I-Connect in an employability seminar offered at their school as a means to generalize to a different setting. We provide implications for practice in rural settings and suggestions for future research related to I-Connect. We also provide recommendations for enhancing the social validity of technology-based self-monitoring for secondary students with disabilities.

The influence of coaching behaviors, experience, and training on children's physical activity levels during youth sport practices

The purpose of this study was to examine how coaching behaviors, coaching experience, and coach training relate to physical activity (PA) levels of children during their participation in a youth sport program. Youth soccer teams (N = 27) serving children ages 6–11 years were directly observed during one practice using momentary time-sampling procedures consisting of 30-s intervals (10-s observation, 20-s recording). Team coaches reported prior coaching experience, training, and demographic characteristics. Multilevel logistic regression was conducted to describe associations between coaching behaviors and intensity of children's PA. Interaction terms were added to the models to determine if the associations differed across girls-only, boys-only, and coed teams. ANOVAs were used to describe associations between coaching experience, coach training, and team PA level. Children were more likely to engage in moderate or vigorous PA when coaches were watching without verbal feedback (Odds Ratio [OR], 3.2, 95% CI = 1.70–5.83) or watching with verbal feedback (OR, 2.1, 95% CI = 1.27–3.59), compared to when the coach was disengaged, regardless of team sex composition. The number of prior seasons coached was positively related to team PA levels. These findings can be used to inform coaching strategies for promoting increased PA during youth sport practices.

Factors Associated with Children’s Physical Activity During Youth Soccer Practices

ABSTRACT Purpose: To identify practice and social contextual factors that associate with physical activity (PA) levels of children during their participation in a youth soccer program. Methods: Twenty-seven youth soccer teams serving children ages 6–11 years participated. Research staff directly observed and recorded PA intensity and practice and social contextual factors using momentary time-sampling procedures. Each team was observed for 1 practice, during which approximately 6 children were each observed for twenty 30-s observation blocks (10-s observation, 20-s recording). In total, children were observed for 3,102 intervals. Multilevel logistic regression analyses were conducted to describe associations between PA intensity and practice and social contexts. Interaction terms were introduced into the models to determine if the associations differed across girls-only, boys-only, and coed teams. Results: A total of 158 children were observed across the 27 teams. Children were more likely to engage in moderate or vigorous PA while performing fitness (Odds Ratio [OR], 9.9, 95% CI = 5.34–18.04), game (OR, 4.0, 95% CI = 2.88–5.66), warm-up (OR, 2.8, 95% CI = 1.85–4.11), and drill (OR, 1.9, 95% CI = 1.41–2.67) activities compared to tactic/instructional activities. The associations between PA intensity levels and practice and social contexts did not differ across girls-only, boys-only, and coed teams. Conclusions: Fitness activities and full-team game play were associated with higher PA intensity levels during children’s participation in youth soccer practices. Youth sport practice protocols can be modified to increase children’s physical activity.

Effect of a Time-Efficient Physical Activity Intervention on Senior School Students’ On-Task Behaviour and Subjective Vitality: the ‘Burn 2 Learn’ Cluster Randomised Controlled Trial

Despite well-established benefits, the majority of young people around the globe are not sufficiently active. In many countries, including Australia, physical activity (i.e. physical education and school sport) is not mandatory in the final two years of high school (i.e. senior school years). The aim of this study was to assess the impact of a time-efficient physical activity intervention on senior school students’ on-task behaviour and subjective vitality. This was a sub-study of the Burn 2 Learn (B2L) cluster randomised controlled trial, which included two cohorts. Participants for this sub-study (N = 221) were from 10 secondary schools (23 classes) located in New South Wales, Australia (Cohort 2). Teachers allocated to the B2L intervention group were provided with training, resources and support to facilitate the delivery of two high-intensity activity breaks per week during lesson time for five weeks. A wait-list control was used as comparison group. On-task behaviour was assessed at baseline and post-test, using a momentary time sampling procedure and expressed as a percentage of lesson time. At post-test, subjective vitality was assessed at the start and end of the lesson using a validated questionnaire. Significant group-by-time effects were observed for students’ on-task behaviour in favour of the B2L group [adjusted mean difference = 19.3% of lesson time (95% CI, 0.8 to 37.8), p = 0.042, d = 0.43]. At post-test, significant group-by-time effects were observed for students’ subjective vitality favouring the B2L group [adjusted mean difference = 0.67 units (95% CI, 0.3 to 1.0), p < 0.001, d = 0.36]. The B2L intervention was successful in improving senior school students’ on-task behaviour and their subjective vitality. These findings highlight the potential academic benefits of re-allocating curriculum time to physical activity during the senior school years.

Quantifying false positives in simulated events using partial interval recording and momentary time sampling with dual‐criteria methods

The dual‐criteria (DC) and conservative dual‐criteria (CDC) methods allow clinicians and researchers to quantify the occurrence of false‐positive outcomes within single‐case experimental designs. The purpose of the current study was to use these DC and CDC methods to measure the incidence of false positives with simulated data collected via discontinuous interval methods (i.e., momentary time sampling, partial‐interval recording) as a function of data series length. We generated event data to create 316,800 unique simulated data series for analysis. In Experiment 1, we evaluated how changes in relevant parameters (i.e., interval sizes, event durations, IRT‐to‐event‐run ratios) produced false positives with momentary time sampling procedures. We also assessed the degree that the CDC method produced fewer false positives than the DC method with simulated interval data. In Experiment 2, we used similar procedures to quantify the occurrence of false positives with partial‐interval recording data. We successfully replicated outcomes from previous research in the current study, though such results only highlight the generality of the procedures relating to false positive (and not false negative) outcomes. That is, these results indicate MTS and PIR may adequately control for false positives, but our conclusions are limited by a lack of data on power.

Gross Motor Skills Predict Classroom Behavior in Lower-Income Children.

Children from lower income families tend to have low levels of on-task behavior in the academic classroom. The purpose of this study was to examine the associations of gross motor skills and classroom behavior in a sample of lower-income children. Participants were a sample of 1,135 school-aged children (mean age = 8.3 ± 1.8 years) recruited from three low-income US schools. A reduced version of the Test for Gross Motor Development 2nd Edition (TGMD-2) was used to assess gross motor skills. Total TGMD-2 scores, locomotor subtest scores, and object control subtest scores were stratified into quintiles for analysis. Students' classroom behavior was recorded 1 year later using a Planned Activity Check (PLACHECK) 5-s momentary time sampling procedure. Classrooms were dichotomized into those that had students at least 80% on-task and those that did not. Multilevel generalized mixed models were employed to examine the relationship between gross motor skills and meeting at least 80% classroom behavior, adjusting for age, sex, and change in BMI, and aerobic fitness. Children in the highest TGMD-2 quintile had 4.17 higher odds of being in an on-task classroom 1 year later (95%CI [2.25–7.76], p < 0.001). This relationship was primarily driven by the relationship between object control quintile scores and classroom behavior, as children within the higher quintile for object control had 3.81 higher odds of being in an on-task classroom 1 year later (95%CI [2.67–5.46], p < 0.001). There was a significant relationship between individual gross motor skills, specifically object control skills, and group level on-task classroom behavior in lower-income children.

Self-determination at a Career and Technical School: Observations of IEP Meetings

The purpose of this study was to conduct observations of Individualized Education Program (IEP) meetings at a Career and Technical Education (CTE) high school to determine who spoke during the IEP meetings, how IEP team members rate their IEP meeting behaviors and perceptions, and if there any differences in how behaviors and perceptions of the IEP meetings are rated. A 10-s momentary time sampling procedure was used to determine which IEP team members spoke the most and least during 10 IEP meetings. A post-IEP meeting survey was used to determine how IEP team members rated their IEP meeting behaviors and perceptions. Descriptive statistics and multivariate analysis of variance (MANOVA) were computed. IEP team members who spoke the most were the special education coordinator, special education teacher, and student. Students rated their meeting behaviors the highest. Students, parents, and educators had positive perceptions of the IEP meetings. A statistically significant difference (F(3, 86) = 3.43, p = 0.012; Wilks’ lambda = 0.74; partial eta squared = 0.13) was found indicating educators had a lower mean rating on composite meeting behavior. Educators seem to be seeking input from students and parents during IEP meetings, yet there remains a need for increased student leadership during IEP meetings. Educators, parents, and students seem to lack knowledge about the availability of post-high school adult services, resulting in an increased need to provide information about agencies to students, teachers, and parents.

Examining the Influence of Interval Length on the Dependability of Observational Estimates

Systematic direct observation is a tool commonly employed by school psychologists to investigate student behavior. As these data are used for educational decision-making, ensuring the psychometric adequacy of the obtained data is an important consideration. Given that procedural aspects of systematic direct observation have been shown to influence the psychometric properties of obtained data, this study was designed to explore how interval length influences the dependability of academic engagement data when using a momentary time sampling procedure. Twenty seventh-grade students were each observed for two 15-min sessions during math instruction. A series of generalizability studies were conducted to examine how manipulations to interval length influenced reliability-like coefficients. In general, shorter interval lengths (i.e., 10 s, 15 s) were shown to produce higher levels of dependability. For example, an acceptable level of dependability (i.e., ϕ = .70) required twice as many 30-min observations when utilizing 20- or 30-s sampling as were required when utilizing 10- or 15-s sampling. Furthermore, whereas an acceptable level of dependability (i.e., ϕ = .70) could not be obtained using any interval length when conducting a single observation, this criterion was met using either 10- or 15-s sampling across two 30-min observations.

Preliminary Evidence on the Efficacy of Mindfulness Combined with Traditional Classroom Management Strategies.

The current case study combined mindfulness-based strategies with a classroom behavior management treatment package, to assist teachers with managing 3rd grade student behaviors. Two teachers (Classroom teacher and Specials teacher) and six students within the same classroom were observed using a 5-min momentary time sampling procedure. A delayed multiple baseline across settings (e.g., Classroom teacher, Specials teacher) design was used to assess student behaviors across baseline (A), classroom behavior management treatment package (CBM) (B), CBM plus mindfulness (C), and CBM plus mindfulness and self-monitoring (D). Behavioral treatment alone increased on-task behaviors for four of six (66%) students compared to baseline; however, five of six (83%) students increased and sustained high rates of on-task behaviors when mindfulness exercises were added to the behavior analytic techniques. These preliminary results support the combination of mindfulness-based strategies with traditional behavior analytic interventions for increasing student on-task behaviors in classroom settings.

Assessing the Accuracy of Classwide Direct Observation Methods: Two Analyses Using Simulated and Naturalistic Data

Two studies investigated the accuracy of eight different interval-based group observation methods that are commonly used to assess the effects of classwide interventions. In Study 1, a Microsoft Visual Basic program was created to simulate a large set of observational data. Binary data were randomly generated at the student level to represent 30–min observations using a 15-s momentary time sampling procedure for 5,000 students distributed evenly across 200 classrooms. Additionally, five classroom types were generated to determine if the base rate of behavior affected the accuracy of each method. Each of the eight observation methods were applied to the simulated data and compared to a criterion to determine their accuracy in estimating rates of classroom behavior. A two-way ANOVA identified a significant main effect for observation method, F(3.40, 663.07) = 15,824.22, p &lt; .001, and a significant interaction between coding method and classroom composition, F(13.60, 663.07) = 40.04, p &lt; .001. In Study 2, to replicate Study 1 using authentic observation data, we compared the accuracy of the same eight methods using a small sample of observations collected in an actual classroom. The results of both studies suggest that six of the eight methods (i.e., two Individual methods and four Planned Activity Check methods) are accurate assessments of group behavior. Furthermore, although classroom composition was associated with statistically significant differences between the accurate methods, we do not consider them large enough to be practically relevant.

Comprehensive School Physical Activity Programming and Classroom Behavior.

The purpose of this study was to examine the effect of a comprehensive school physical activity program (CSPAP) on classroom behavior in low-income children. The participants included 1460 children recruited from 3 low-income schools receiving governmental financial assistance. A total of 77 classrooms were observed across grades K through 6. Classrooms were observed one week prior to the implementation of CSPAP and at 6 weeks and 12 weeks after commencement of the program. Members of the research team observed classroom behavior using systematic observation, specifically a 5-second momentary time sampling procedure. A generalized linear mixed effects model was used to determine the change in odds of a classroom achieving at least 80% on-task behavior following the implementation of CSPAP. There were 7.49 (95% CI: 2.83, 19.79) greater odds of a classroom achieving 80% on-task behavior at 6 weeks compared to baseline and a 27.93 (95% CI: 7.93, 98.29) greater odds of a classroom achieving 80% on-task behavior at 12 weeks compared to baseline (p < .001). After the CSPAP was implemented, on-task classroom behavior significantly improved across all grade levels.

Effects of Increasing Distance of a One-on-One Paraprofessional on Student Engagement

This study sought to maintain task engagement of a 4-year-old student with developmental disabilities included in a pre-K classroom while decreasing reliance of one-on-one support from a paraprofessional. To accomplish these goals, a withdrawal design (A-B-A) with a nested changing-criterion design was used to withdraw paraprofessional proximity. A cue was provided to the paraprofessional as an indicator of when to engage with and withdraw proximity from the student. Momentary time sampling procedures were used to measure task engagement during group circle time and proximity between student and paraprofessional. Results showed that task engagement was maintained at a level comparable to peers without disabilities, while proximity less than 0.9 m from the student was reduced from 95% to 18% of intervals.

Alternating Renewal Process Models for Behavioral Observation: Simulation Methods, Software, and Validity Illustrations

Direct observation recording procedures produce reductive summary measurements of an underlying stream of behavior. Previous methodological studies of these recording procedures have employed simulation methods for generating random behavior streams, many of which amount to special cases of a statistical model known as the alternating renewal process. This paper describes the alternating renewal process model in its general form, demonstrates how it provides an organizing framework for most past simulation research on direct observation procedures, and introduces a freely available software package that implements the model. The software can be used to simulate behavior streams as well as data from many common recording procedures, including continuous recording, momentary time sampling, event counting, and interval recording procedures. Several examples illustrate how the software can be used to study the validity and reliability of direct observation data and to develop measurement strategies during the planning phases of empirical studies.

The influence of student characteristics on the dependability of behavioral observation data.

Although generalizability theory has been used increasingly in recent years to investigate the dependability of behavioral estimates, many of these studies have relied on use of general education populations as opposed to those students who are most likely to be referred for assessment due to problematic classroom behavior (e.g., inattention, disruption). The current study investigated the degree to which differences exist in terms of the magnitude of both variance component estimates and dependability coefficients between students nominated by their teachers for Tier 2 interventions due to classroom behavior problems and a general classroom sample (i.e., including both nominated and non-nominated students). The academic engagement levels of 16 (8 nominated, 8 non-nominated) middle school students were measured by 4 trained observers using momentary time-sampling procedures. A series of G and D studies were then conducted to determine whether the 2 groups were similar in terms of the (a) distribution of rating variance and (b) number of observations needed to achieve an adequate level of dependability. Results suggested that the behavior of students in the teacher-nominated group fluctuated more across time and that roughly twice as many observations would therefore be required to yield similar levels of dependability compared with the combined group. These findings highlight the importance of constructing samples of students that are comparable to those students with whom the measurement method is likely to be applied when conducting psychometric investigations of behavioral assessment tools.

Assessing Physical Activity During Youth Sport: The Observational System for Recording Activity in Children: Youth Sports

The purpose of this study was to evaluate the validity and interrater reliability of the Observational System for Recording Activity in Children: Youth Sports (OSRAC:YS). Children (N = 29) participating in a parks and recreation soccer program were observed during regularly scheduled practices. Physical activity (PA) intensity and contextual factors were recorded by momentary time-sampling procedures (10-second observe, 20-second record). Two observers simultaneously observed and recorded children's PA intensity, practice context, social context, coach behavior, and coach proximity. Interrater reliability was based on agreement (Kappa) between the observer's coding for each category, and the Intraclass Correlation Coefficient (ICC) for percent of time spent in MVPA. Validity was assessed by calculating the correlation between OSRAC:YS estimated and objectively measured MVPA. Kappa statistics for each category demonstrated substantial to almost perfect interobserver agreement (Kappa = 0.67-0.93). The ICC for percent time in MVPA was 0.76 (95% C.I. = 0.49-0.90). A significant correlation (r = .73) was observed for MVPA recorded by observation and MVPA measured via accelerometry. The results indicate the OSRAC:YS is a reliable and valid tool for measuring children's PA and contextual factors during a youth soccer practice.

The Biasing Effects of Labels on Direct Observation by Preservice Teachers

Observational bias can significantly affect results attained through observation. This study focused on 122 preservice teacher educators who conducted a structured observation, using momentary time sampling procedures with 10-second intervals, to measure student on-task and off-task behaviors. The experimental variable altered was the exceptionality label of the observed student to determine if the label would have a biasing effect. Labels used were oppositional defiant disorder, attention deficit hyperactivity disorder, and gifted/talented. Results suggest that an exceptionality label (i.e., oppositional defiant disorder) significantly affects observed behavior. Practical implications of the study are discussed.

The Effects of Choice Making on Toy Engagement in Nonambulatory and Partially Ambulatory Preschool Students

This study evaluated the effects of an experimenter-delivered choice-making procedure. Three nonambulatory and partially ambulatory preschoolers were given access to six teacher-nominated preferred toys in two conditions: child choice and interventionist choice. Using an alternating treatment design and a 10-second momentary time-sampling procedure, results showed that children were comparably engaged with the toys in both conditions. Results are discussed in terms of implementing choice procedures with very young children with severe disabilities. Suggestions for further study of the effects of choice using comprehensive preference assessment strategies and considerations of individual participant characteristics are discussed.

A METHOD FOR DESCRIBING PRESCHOOLERS' ACTIVITY PREFERENCES

We designed a series of analyses to develop a measurement system capable of simultaneously recording the free-play patterns of 20 children in a preschool classroom. Study 1 determined the intermittency with which the location and engagement of each child could be momentarily observed before the accuracy of the measurement was compromised. Results showed that intervals up to 120 s introduced less than 10% measurement error. Study 2 determined the extent of agreement between two observers who simultaneously collected data for 20 children using 30-, 60-, 90-, and 120-s momentary time sampling (MTS) intervals. The three larger intervals resulted in high levels of interobserver agreement (above 90%), whereas the 30-s interval resulted in unacceptably low levels of agreement (less than 80%). By allowing observers to select from among the different MTS intervals via a datasheet array and then collect data with the chosen system, Study 3 determined observers' preferences for the remaining MTS intervals. Both data collectors preferred the 90-s MTS procedure. The sensitivity of the 90-s MTS procedure, which was shown to be accurate, reliable, and preferred, was then demonstrated by its use to describe activity preferences of a classroom of children in Study 4. This system identified high- and low-preference activities for individual children and revealed interesting patterns of response allocation by the group.

Behaviors of Teachers in Co-taught Classes in a Secondary School

Researchers examined roles and actions of members of “co-teaching” teams including a special educator and a regular educator in a public high school. Observational data were collected using momentary time sampling procedures. Results indicated that regular educators presented material to students in 29.93% of observed intervals; special educators presented material in less than 1% of observed intervals. Researchers observed regular educators conducting non-interaction instructional tasks (e.g., preparing for instruction) in 28.33% of the intervals; special educators conducted these tasks in 3.96% of intervals. Special educators observed or drifted in 45.24% of the intervals and responded to students more often (i.e., 29.86% observation intervals) than regular educators. Results are discussed in terms of needed study related to roles of general and special educators as increasing numbers of students with disabilities are expected to master the general curriculum.

Evaluating the Impact of Intergenerational Activities on Elders' Engagement and Expressiveness Levels in Two Settings

This study evaluated the impact of intergenerational activities on elders' engagement and expressiveness levels in two settings. Study 1 was conducted with 22 well elders at a senior center and approximately 15 children from a nearby grade school. Data were collected using a momentary time sampling procedure, and inter-observer reliability averaged 88% (ranging from 78% to 97%). Elders were significantly more engaged (t(85) = 4.60, p > .001) and expressive (t(85) = 5.55, p > .001) in the treatment condition than the control condition. Study 2 was conducted with 25 older adults diagnosed with dementia, living in a special care unit. Twenty-eight second-graders were in the experimental group and 32 second-graders were in the comparison group. A momentary time sampling procedure was used to observe engagement, expressiveness, and inappropriate behavior levels. Inter-observer agreement averaged 94% (ranged from 85% to 100%). Elders were significantly more engaged in the structured activities with children than the structured activities without children, and significantly more engaged in structured activities without children than the no-activity condition, F(l) = 60.1; p > .01. Elders were also significantly more expressive in structured activities with children than the structured activities without children, and significantly more expressive in the structured activities without children than the no-activity condition, F(1) =26.5; p = 01. Further, there was no significant increase in inappropriate behaviors between any condition, F(1) =.322; p = .57. The analysis of variance regarding children's attitudes towards the elderly showed no significant differences whether they did or did not participate in the intergen-erational activities (F3.5, p < .05), with both groups maintaining positive attitudes of elders. These results reflect the importance of offering intergenerational activities to well and institutionalized elders as well as to children.