Abstract
This paper illustrates a method of item analysis used to identify discriminating multiple-choice items in placement data. The data come from two rounds of pilots given to both SHL students and Spanish as a Second Language (SSL) students. In the first round, 104 items were administered to 507 students. After discarding poor items, the second round presented 64 items to 330 students. Both graphical and statistical item analyses were employed. Graphical analysis involved an examination of trace-line graphs of each item. A fine-grained statistical analysis was conducted using point-biserial correlation coefficients. Both of these methods were useful and contributed to measure reliability. Different sets of items were selected for each learner group: 31 items for SHL participants and 21 for SSL participants. These items are currently being used in a preliminary online placement exam; after taking a biographical questionnaire, students are piped to either the SHL exam or the SSL exam. Finally, this paper examines characteristics of SHL students found in these data and finds that regional characteristics should be considered in item creation in terms of answer variability and possible distinction between SHL and SSL students.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.