Research In Learning Technology Research Articles

Combining the formative with the summative: the development of a twostage online test to encourage engagement and provide personal feedback in large classes

The aim of this action research project was to improve student learning by encouraging more “time on task” and to improve self-assessment and feedback through the introduction of weekly online tests in a Year 2 lecture module in biological sciences. Initially voluntary online tests were offered to students and those who participated achieved higher exam marks than those who did not, but completion rate was low. Making the tests compulsory led to high completion rates, but class performance decreased, indicating that using the same assessment for formative and for summative purposes is not always beneficial for learning. Finally, these problems were resolved by introducing a two-stage approach: the first stage of each test was formative and provided prompt feedback. However, students had to achieve 80% to progress to the second summative stage of the test. The two-stage online tests led to significantly improved class performance. This novel test design ensures that students go through at least two attempts and therefore fully benefit from the learning opportunities presented by the formative stage. Two-stage online tests present the opportunity to provide regular feedback in large classes and to improve performance not only of good but also of “weak” students.Keywords: e-learning; e-assessment; action research; higher education(Published: 29 April 2013)Citation: Research in Learning Technology 2013, 21: 19153 - http://dx.doi.org/10.3402/rlt.v21i0.19153

Is it cheating – or learning the craft of writing? Using Turnitin to help students avoid plagiarism

Plagiarism is a growing problem for universities, many of which are turning to software detection for help in detecting and dealing with it. This paper explores issues around plagiarism and reports on a study of the use of Turnitin in a new university. The purpose of the study was to inform the senior management team about the plagiarism policy and the use of Turnitin. The study found that staff and students largely understood the university’s policy and Turnitin’s place within it, and were very supportive of the use of Turnitin in originality checking. Students who had not used Turnitin were generally keen to do so. The recommendation to the senior management team, which was implemented, was that the use of Turnitin for originality checking should be made compulsory where possible – at the time of the study the use of Turnitin was at the discretion of programme directors. A further aim of the study was to contribute to the sector’s body of knowledge. Prevention of plagiarism through education is a theme identified by Badge and Scott (2009) who conclude an area lacking in research is “investigation of the impact of these tools on staff teaching practices”. Although a number of recent studies have considered educational use of Turnitin they focus on individual programmes or subject areas rather than institutions as a whole and the relationship with policy.Keywords: higher education; plagiarism; assessment; Turnitin(Published: 29 April 2013)Citation: Research in Learning Technology 2013, 21: 17218 - http://dx.doi.org/10.3402/rlt.v21i0.17218

The habitus of digital scholars

This article concerns the Participatory Web and the impact it has on academic researchers’ perceptions of digital scholarship practices. The Participatory Web, as a space of active involvement, presence and socialisation of knowledge, has the potential to introduce significant changes to scholarly practice and to diversify it. This article draws on the findings of a narrative inquiry study that investigated the habitus of 10 digital scholars. The study uses Bourdieu’s concepts of habitus, field, and social and cultural capital as a research lens. One of the main findings to come out of the study was that research participants’ approaches to digital scholarship practices are highly influenced by their online social capital, the online networks that influence their thinking and outlook on scholarly practices, including their advocacy of openness and transparency of academic practice. This article concludes by highlighting the dispositions digital scholars display in an attempt to characterise the values and beliefs that underpin their scholarly practices.Keywords: digital scholarship; habitus; social capital; cultural capital; the Participatory Web; Pierre Bourdieu(Published: 31 January 2014)Citation: Research in Learning Technology 2014, 21: 21274 - http://dx.doi.org/10.3402/rlt.v21.21274

Aggregate-then-Curate: how digital learning champions help communities nurture online content

Informational resources are essential for communities, rooting them in their own history, helping them learn and solve problems, giving them a voice in decisionmaking and so on. For digital inclusion and inclusion in the informational and democratic processes of society more generally it is essential that communities retain the skills, awareness and motivation to create and manage their own informational resources. This article explores a model for the creation of online content that incorporates the different ways in which the quality and relevance of information can be assured. This model, ‘‘Aggregate-then-Curate’’ (A/C), was developed from earlier work concerning digital inclusion in UK online centres, models of informal e-learning and ecologies of resources. A/C shows how creating online content can be viewed as a 7-step process, initiated by individuals but bringing in ‘‘digital learning champions’’, other community members and formal educational institutions at different stages. A/C can be used to design training to help build the capacity to manage community informational resources in an inclusive way. The article then discusses and evaluates MOSI-ALONG, a Joint Information Systems Committee (JISC) funded project founded on these ideas, which illustrates how A/C can be used to design training to help build the capacity to manage community informational resources in an inclusive way. This conclusion is supported by evaluations of the work done so far in MOSI-ALONG.Keywords: curation; digital inclusion; object-centred sociality; ecology of resources; inclusion; online content; social media; digital learning champions; communities(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18677 - http://dx.doi.org/10.3402/rlt.v20i0.18677

Digital exclusion or learning exclusion? An ethnographic study of adult male distance learners in English prisons

Previous research has highlighted the value of technology to enhance learning. However, digital inclusion research has argued that many issues such as skills, access, usability and choice impact on the effectiveness of technology to enhance learning. The findings in this paper add to the debate by highlighting the importance of value and context. In particular, the value that institutions and individuals place on the role of further and higher distance learning in a prison can affect technology-enhanced learning in that context. This research identified that despite good IT skills and improved technologies, prison learners’ access and use of technology is hampered by conflicting priorities amongst the multiple organisations controlling prisoner activities. This can lead to a prison in which menial work is valued far higher than learning. Technology-enhanced distance learning, perceived by many to be a lifeline in a desolate environment, is heavily restricted in such prisons. The situation is thought to be deteriorating as the number of organisations involved increases and the Government’s plans for ‘‘working’’ prisons gather pace.Keywords: social inclusion; digital inclusion; distance learning; higher education; prisoner reintegration(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18620 - http://dx.doi.org/10.3402/rlt.v20i0.18620

Learning and digital inclusion: the ELAMP project

The Electronic Learning and Mobility Project (ELAMP) was a nationally funded project by the Department for Children, Schools and Families, which ran from 2004 to 2010. The main aim of ELAMP was to improve the education of Traveller children, particularly highly mobile learners. ELAMP focussed upon the use of mobile technology and distance learning to support, enhance and extend young Travellers’ educational and vocational opportunities. This article will reflect upon the learning and technological experiences and opportunities that the ELAMP project provided for Traveller children, young people and their families. In doing so it will critically consider the value of information technology in working with Traveller communities and advancing their educational opportunities. Reviewing ELAMP work will also demonstrate how the use of mobile technology can improve educational outcomes and Traveller families’ digital inclusion. Now that the project has ended, this article will question why we are not using what we learnt from ELAMP to move forward. The author was a tutor on the project who also evaluated the Strand B, Wider Key Skills element of ELAMP for The University of Sheffield between 2008 and 2010, which is the main focus of this particular article.Keywords: ELAMP; education: digital inclusion; information technology; young Travellers and their families(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18603 - http://dx.doi.org/10.3402/rlt.v20i0.18603

EDITORIAL: Empowering the digitally excluded: learning initiatives for (in)visible groups

There is growing evidence that some digitally excluded groups of learners are receiving more attention than others. Discussions regarding why some digitally excluded learners are more visible than others and therefore worthy of more committed digital inclusion interventions raises important questions about how we define and conceptualise digital inclusion and digital inclusion practice; particularly in relation to empowerment. In this article, we draw on a range of research, practice and policy literature to examine two important questions: what is empowerment and in whose hands does empowerment lie? We argue that empowerment involves making informed choices about technology use, but that learners often require support- human intervention- to make these choices. However, current digital inclusion research has failed to produce a detailed critique of what constitutes empowering support from educational institutions and their staff. A lack of open and reflexive accounts of practice means that we are no closer to identifying and understanding the kinds of empowering practices that are required to challenge the kinds of prejudices, stereotypes, risk-aversiveness and low aspirations associated with the most invisible of digitally excluded learners.Keywords: digital inclusion; digital exclusion; empowerment; risk-aversion; practice; conceptualisation(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 20214 - http://dx.doi.org/10.3402/rlt.v20i0.20214

Adapting online learning resources for all: planning for professionalism in accessibility

Online resources for education offer opportunities for those with disabilities but also raise challenges on how to best adjust resources to accommodate accessibility. Automated reconfiguration could in principle remove the need for expensive and time-consuming discussions about adaptation. On the other hand, human-based systems provide much needed direct support and can help understand options and individual circumstances. A study was carried out within an EU-funded accessibility project at The Open University (OU) in parallel with studies at three other European universities. The study combined focus groups, user-testing, management consultation and student survey data to help understand ways forward for accessibility. The results reinforce a holistic view of accessibility, based on three factors: positioning the university as a positive provider to disabled students; developing processes, systems and services to give personal help; and planning online materials which include alternatives. The development of a model that helps organisations incorporate professionalism in accessibility is described, though challenges remain. For example, a recurrent difficulty in providing adequate self-description of accessibility needs implies that a completely automated solution may not be attainable. A more beneficial focus, therefore, may be to develop systems that support the information flow required by the human ‘‘in the loop.’’Keywords: inclusion; students with disabilities; services; personalisation; evaluation; virtual learning environments; EU4ALL(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18699 - http://dx.doi.org/10.3402/rlt.v20i0.18699

Training in basic Internet skills for special target groups in non-formal educational settings - conclusions from three pilot projects

With the progress of Digital Inclusion, it becomes important to address marginalised groups that face specific barriers in being part of the information society. From 2009 to 2011 within the framework of the nation-wide Initiative Internet erfahren, funded by the German Federal Ministry of Economics, Stiftung Digitale Chancen has accompanied three pilot projects and researched the hindrances and motivations of specific target groups including young migrants from Russia, women in the low-wage sector and disabled elderly people, regarding their use of information and communication technology and related skills. This article describes the teaching methodologies in the training provided in nonformal education settings, exposes the different evaluation methods and sums up the results. A special focus in the discussion is given to the role of the teacher and the relationship between teacher and students as there turned out to be similarities in all three target groups. Understanding the balance between the training and abilities and preferences of the learners will facilitate the further development of training appropriate to those who are still digitally excluded.Keywords: specific target groups in Digital Inclusion; migrants; disabled persons; low-wage sector; barriers towards formal education and technology; student motivation; trainer student relationship(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18700 - http://dx.doi.org/10.3402/rlt.v20i0.18700

Information and communication technology related needs of college and university students with disabilities

Purpose: To explore variables related to how well the information and communication technologies (ICTs) related needs of students with different disabilities are being met on campus at institutions of higher education, at home and in e-learning contexts. We also explore the disciplines and programmes pursued by students with different disabilities and the specialised ICTs they use. Method: A total of 1,354 Canadian university and junior/community college students with various disabilities completed the POSITIVES Scale. Results: Post-secondary students often have several disabilities which may affect how easily they can use ICTs. Students’ disabilities also influence the specialised ICTs they use and how well their ICT-related needs are being met. While the findings indicate that, overall, students’ ICT-related needs are generally well met, the results also show that these are better met on campus than at home, and at colleges than at universities. This is not related to institution size or to students’ disciplines. Conclusions: Our results show more favourable than unfavourable findings. Nevertheless, there are concerns around the availability of computers with adaptive software/hardware in specialised laboratories as well as with institutional ICT loan programmes; funding for ICTs for personal use; training, both on and off campus; and technical support off campus.Keywords: college university students; disabilities; POSITIVES Scale; ICT needs; e-learning(Published: 19 December 2012)Citation: Research in Learning Technology 2012, 20: 18646 - http://dx.doi.org/10.3402/rlt.v20i0.18646

Derivation of electronic course templates for use in higher education

Lecturers in higher education often consider the incorporation of web technologies into their teaching practice. Partially structured and populated course site templates could aid them in getting started with creating and deploying webbased materials and activities to enrich the teaching and learning experience. Discussions among instructional technology support staff and lecturers reveal a paucity of robust specifications for possible course site features that could comprise a template. An attempted mapping from the teaching task as understood by the instructor to the envisaged course website properties proves elusive. We conclude that the idea of an initial state for a course site, embodied in a template, remains useful and should be developed not according to a formula but with careful attention to the context and existing pedagogical practice. Any course template provided for the use of lecturers should be enhanced with supporting instructions and examples of how it may be adapted for their particular purposes.Keywords: course template; learning platform; pedagogical dimensions; course site properties(Published: 17 December 2012)Citation: Research in Learning Technology 2012, 20: 18665 - http://dx.doi.org/10.3402/rlt.v20i0.18665

Adapting to the digital age: a narrative approach

The article adopts a narrative inquiry approach to foreground informal learning and exposes a collection of stories from tutors about how they adapted comfortably to the digital age.We were concerned that despite substantial evidence that bringing about changes in pedagogic practices can be difficult, there is a gap in convincing approaches to help in this respect. In this context, this project takes a ‘‘bottom-up’’ approach and synthesises several life-stories into a single persuasive narrative to support the process of adapting to digital change. The project foregrounds the small, every-day motivating moments, cultural features and environmental factors in people’s diverse lives which may have contributed to their positive dispositions towards change in relation to technology enhanced learning. We expect that such narrative approaches could serve to support colleagues in other institutions to warm up to ever-changing technological advances.Keywords: narrative inquiry; resonance; story; engagement(Published: 17 December 2012)Citation: Research in Learning Technology 2012, 20: 18976 - http://dx.doi.org/10.3402/rlt.v20i0.18976

Awareness, attitudes and participation of teaching staff towards the open content movement in one university

This research investigates the current awareness of, and participation in, the open content movement at one UK institution for higher education. The open content movement and the open educational resources can be seen as potential methods for reducing time and cost of technology-enhanced learning developments; however, its sustainability and, to some degree, its success are dependent on critical mass and large-scale participation. Teaching staff were invited to respond to a questionnaire. Respondents (n59) were open to the idea of sharing their own content and, similar to other studies, demonstrated existing practices of sharing resources locally amongst colleagues; however, there was little formal, large-scale sharing using suitable licenses. The data gathered concurs with other research suggesting a lack of awareness to the Creative Commons licenses as well as a lack of participation in large open educational resource repositories.Keywords: open educational resources; staff attitudes; sustainability(Published: 22 October 2012)Citation: Research in Learning Technology 2012, 20: 18520 - http://dx.doi.org/10.3402/rlt.v20i0.18520

Perceptions of undergraduate Graphic Design students on the educational potential of Facebook

The popularity of Facebook among university students inevitably raises questions on the educational potential of this Social Networking Site for Higher Education. From the limited literature on the instructional uses of Facebook, one can draw conflicting conclusions. Benefits were identified through the communicative potential, student participation in study groups and through informal learning, i.e. learning that takes place outside the formal structures of the learning environment. In contrast, it is also argued that the instructional benefits of Facebook are not straightforward. This phenomenographic investigation examines the perceptions of undergraduate Graphic Design students in a higher education institution in Cyprus, on the use of Facebook for teaching and learning. Characteristic of Art and Design education is the centrality of the studio and student self-reflection. Despite some literature that considers Facebook provides a viable alternative to the physical studio, the participants in this investigation expressed a preference for face-to-face instruction and consider Facebook as complimenting rather than replacing studio practices. Some participants benefited from the use of Facebook by joining support groups and exploring information relevant to their studies. Further research can investigate how Facebook can be embedded in studio-based teaching and learning.Keywords: Facebook; Graphic Design; teaching and learning; informal learning; studio(Published: 24 September 2012)Citation: Research in Learning Technology 2012, 20: 17490 - http://dx.doi.org/10.3402/rlt.v20i0.17490

Trajectories of engagement: a repeated cross-sectional investigation of student perceptions of an online learning environment

Evaluations of online learning environments (OLEs) often present a snapshot of system use. It has been identified in the literature that extended evaluation is required to reveal statistically significant developments in the evolution of system use over time. The research presented here draws on student OLE evaluations surveys run over the period 20042011 and include nearly 6800 responses exploring students’ perceptions of importance of, and satisfaction with elements of their OLE. Across the survey period, satisfaction ratings with all OLE elements rose significantly, suggesting a positive student engagement with the OLE over time. The corresponding ratings of importance of OLE elements generally rose significantly, though a number of elements registered no significant difference in the first two years of the survey, suggesting that short period surveys may struggle to reveal statistically significant trends. OLE element use appeared to be closely linked to perceived value. The OLE elements with the highest mean importance and satisfaction ratings related to student access of online learning resources. Other detailed results are also reported. We demonstrate a method for, and one large-scale case study of, quantifying and visualising the trajectories of engagement that students have had with an institutional OLE over time.Keywords: online learning environment; learning management system; repeated cross-sectional evaluation; student survey(Published: 24 September 2012)Citation: Research in Learning Technology 2012, 20: 17143 - http://dx.doi.org/10.3402/rlt.v20i0.17143

Students and recorded lectures: survey on current use and demands for higher education

Online recordings of lectures provide students with anytime-anyplace access to lectures. Research shows that students prefer courses accompanied by online recordings and an increasing number of universities provide recorded lectures. This paper presents the results of a study into the use of recorded lectures at two universities in the Netherlands. The goal of the study is to gain a better understanding of the way that this group of students use recorded lectures. This understanding will enable the creation of usage scenarios that need to be supported. Our results show that students use recorded lectures as a replacement for missed lectures and for study tasks, like preparing for an exam. A large proportion of the students report that they watch 75100% of a recorded lecture when the view one. The fact that students did not mention the quality of the actual lectures appears not to influence the use of the recorded lectures. Recorded lectures for courses that only use the blackboard are viewed less often. There are also interesting differences in the use of recorded lectures of the different groups of students at the two universities. To increase the credibility and validity of the results, we need a more direct way to measure the use of recorded lectures by students. Methodological triangulation using the log data for the recorded lectures can provide this.Keywords: recorded lectures; web lectures; online lectures; video lectures(Published: 24 September 2012)Citation: Research in Learning Technology 2012, 20: 17299 - http://dx.doi.org/10.3402/rlt.v20i0.17299

Using videoconferencing in a school-scientist partnership: students’ perceptions and scientists’ challenges

This research studied a series of videoconference teaching workshops and virtual labs, which formed a component of a school-scientist partnership involving a New Zealand science research institute and year 13 students at a Wellington high school. It explored students’ perceptions of the effectiveness of the videoconferences as an interactive medium for developing content knowledge, identified factors influencing their level of interaction during the conferences, and exposed issues when using videoconferences for highly specialised activities. The research followed an interpretive methodology using a case study approach, and employed mixed method qualitative/quantitative data gathering procedures. Results suggest that while videoconferencing was effective it was also expensive and timeconsuming, and that scientists’ efforts to engage students more interactively through movement towards more constructive practice, were largely ineffective. This article provides direction for teachers considering exploring the potential of interactive videoconferencing with students.Keywords: science; partnership; school; interaction; engagement; pedagogy; videoconference; technology; ICT(Published: 14 August 2012)Citation: Research in Learning Technology 2012, 20: 17194 - http://dx.doi.org/10.3402/rlt.v20i0.17194

Assessment choices to target higher order learning outcomes: the power of academic empowerment

Assessment of higher order learning outcomes such as critical thinking, problem solving and creativity has remained a challenge for universities. While newer technologies such as social networking tools have the potential to support these intended outcomes, academics’ assessment practice is slow to change. University mission statements and unit outlines may purport the value of higher order skills; however, questions remain about how well academics are equipped to design their curriculum and particularly their assessment strategies accordingly. This paper reports on an investigation of academic practice in assessing higher order learning in their units. Despite their intentions towards higher order learning outcomes for their students, the results suggest academics may make decisions when planning their assessment tasks that inadvertently lead students on the path towards lower order outcomes. Among the themes to emerge from the study is the importance of academics’ confidence and their attitudes towards the role of assessment in learning and how these perspectives, along with the types of learning outcomes they intend for their students, can influence their task design.Keywords: assessment; higher order learning; educational technologies; curriculum alignment; confidence(Published: 24 September 2012)Citation: Research in Learning Technology 2012, 20: 17595 - http://dx.doi.org/10.3402/rlt.v20i0.17595

Linking theory to practice in learning technology research

We present a case to reposition theory so that it plays a pivotal role in learning technology research and helps to build an ecology of learning. To support the case, we present a critique of current practice based on a review of articles published in two leading international journals from 2005 to 2010. Our study reveals that theory features only incidentally or not at all in many cases. We propose theory development as a unifying theme for learning technology research study design and reporting. The use of learning design as a strategy to develop and test theories in practice is integral to our argument. We conclude by supporting other researchers who recommend educational design research as a theory focused methodology to move the field forward in productive and consistent ways. The challenge of changing common practice will be involved. However, the potential to raise the profile of learning technology research and improve educational outcomes justifies the effort required. Keywords: research methodology; educational design research; educational theory; evaluation (Published: 15 March 2012) Citation: Research in Learning Technology 2012, 20 : 16148 - DOI: 10.3402/rlt.v20i0.16148

Chalkface; interface; screenface: moving the metaphor of teaching towards the nexus of teaching and learning

This paper provides a nuanced metaphor for teaching and learning, taking into account newer mediated forms of learning that lie at the nexus of teaching and learning. Firstly, the paper navigates this metaphorical minefield by tracing the evolution of the terms for describing learning environments: specifically coalface, chalkface and interface. Secondly, it addresses ways of thinking about curriculum design, taking account of the different actors involved in curriculum — designers, teachers and learners — at the chalkface, the interface and in the proposed new metaphor — the screenface. The screenface metaphor is then elaborated both in terms of the shifts in thinking it can facilitate and the implications of viewing research into teaching and learning through this lens. The screenface is a useful metaphor, with application beyond this initial proposal providing new and fruitful questions that can be asked about teaching and learning. Keywords: teaching; learning; technology; curriculum (Published: 25 April 2012) Citation: Research in Learning Technology 2012, 20 : 17187 - http://dx.doi.org/10.3402/rlt.v20i0.17187