Website Usage Statistics Research Articles

Automated Test-Item Generation System for Retrieval Practice in Radiology Education

To develop and disseminate an automated item generation (AIG) system for retrieval practice (self-testing) in radiology and to obtain trainee feedback on its educational utility. An AIG software program (Radmatic) that is capable of generating large numbers of distinct multiple-choice self-testing items from a given "item-model" was created. Instead of writing multiple individual self-testing items, an educator creates an "item-model" for one of two distinct item styles: true/false knowledge based items and image-based items. The software program then uses the item model to generate self-testing items upon trainee request. This internet-based system was made available to all radiology residents at our institution in conjunction with our didactic conferences. After obtaining institutional review board approval and informed consent, a written survey was conducted to obtain trainee feedback. Two faculty members with no computer programming experience were able to create item-models using a standard template. Twenty five of 54 (46%) radiology residents at our institution participated in the study. Twelve of these 25 (48%) study participants reported using the self-testing items regularly, which correlated well with the anonymous website usage statistics. The residents' overall impression and satisfaction with the self-testing items was quite positive, with a score of 7.89 ± 1.91 (mean ± SD) out of 10. Lack of time and email overload were the main reasons provided by residents for not using self-testing items. AIG enabled self-testing is technically feasible, and is perceived positively by radiology residents as useful to their education.

Process Evaluation of the Diabetes Canada Guidelines Dissemination Strategy Using the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) Framework

Our purpose was to disseminate and implement the Diabetes Canada (formerly the Canadian Diabetes Association) 2013 Clinical Practice Guidelines and evaluate the impact of the dissemination and implementation strategy on process outcomes (reach, adoption, implementation and maintenance). Our patient- and provider-directed strategy consisted of a guidelines website, electronic point-of-care decision-support tools, mobile applications, electronic medical record templates, laboratory prompts, continuing professional development modules, a communications campaign and printed education materials. We used the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to assess process-level outcomes. We report on the reach, adoption, implementation and organizational maintenance by using mixed methods and multiple data sources (communications reports, mailing lists, website-usage statistics, accreditation logs, session-evaluation forms, budgets). A total of 1,786,910 contacts were made with health-care professionals, the majority of whom were nurses. The greatest reach was through the website. A total of 35,573,154 contacts were made with the general population; the greatest reach occurred through media channels. We contacted 149 and collaborated with 18 governmental, professional and health advocacy organizations about activities such as distributing resources and implementing team-based care initiatives and screening policies. Most website users were young women, with use occurring during working hours. Interactive clinical decision-support tools were most commonly accessed. Website use increased with time. The institutionalization of guidelines occurred in a few areas such as the use of an adapted screening policy in the Northwest Territories. Our interactive tools were repeatedly accessed, signifying their relevance to problems in clinical care. Our synthesized analyses indicate that the guidelines website is resource intensive, with a wide reach and the potential to change outcomes.

From Evidence-Based Research to Practice-Based Evidence: Disseminating a Web-Based Computer-Tailored Workplace Sitting Intervention through a Health Promotion Organisation.

Prolonged sitting has been linked to adverse health outcomes; therefore, we developed and examined a web-based, computer-tailored workplace sitting intervention. As we had previously shown good effectiveness, the next stage was to conduct a dissemination study. This study reports on the dissemination efforts of a health promotion organisation, associated costs, reach achieved, and attributes of the website users. The organisation systematically registered all the time and resources invested to promote the intervention. Website usage statistics (reach) and descriptive statistics (website users’ attributes) were also assessed. Online strategies (promotion on their homepage; sending e-mails, newsletters, Twitter, Facebook and LinkedIn posts to professional partners) were the main dissemination methods. The total time investment was 25.6 h, which cost approximately 845 EUR in salaries. After sixteen months, 1599 adults had visited the website and 1500 (93.8%) completed the survey to receive personalized sitting advice. This sample was 38.3 ± 11.0 years, mainly female (76.9%), college/university educated (89.0%), highly sedentary (88.5% sat >8 h/day) and intending to change (93.0%) their sitting. Given the small time and money investment, these outcomes are positive and indicate the potential for wide-scale dissemination. However, more efforts are needed to reach men, non-college/university educated employees, and those not intending behavioural change.

The effectiveness of a web 2.0 physical activity intervention in older adults \u2013 a randomised controlled trial

BackgroundInteractive web-based physical activity interventions using Web 2.0 features (e.g., social networking) have the potential to improve engagement and effectiveness compared to static Web 1.0 interventions. However, older adults may engage with Web 2.0 interventions differently than younger adults. The aims of this study were to determine whether an interaction between intervention (Web 2.0 and Web 1.0) and age group (<55y and ≥55y) exists for website usage and to determine whether an interaction between intervention (Web 2.0, Web 1.0 and logbook) and age group (<55y and ≥55y) exists for intervention effectiveness (changes in physical activity).MethodsAs part of the WALK 2.0 trial, 504 Australian adults were randomly assigned to receive either a paper logbook (n = 171), a Web 1.0 (n = 165) or a Web 2.0 (n = 168) physical activity intervention. Moderate to vigorous physical activity was measured using ActiGraph monitors at baseline 3, 12 and 18 months. Website usage statistics including time on site, number of log-ins and number of step entries were also recorded. Generalised linear and intention-to-treat linear mixed models were used to test interactions between intervention and age groups (<55y and ≥55y) for website usage and moderate to vigorous physical activity changes.ResultsTime on site was higher for the Web 2.0 compared to the Web 1.0 intervention from baseline to 3 months, and this difference was significantly greater in the older group (OR = 1.47, 95%CI = 1.01–2.14, p = .047). Participants in the Web 2.0 group increased their activity more than the logbook group at 3 months, and this difference was significantly greater in the older group (moderate to vigorous physical activity adjusted mean difference = 13.74, 95%CI = 1.08–26.40 min per day, p = .03). No intervention by age interactions were observed for Web 1.0 and logbook groups.ConclusionsResults partially support the use of Web 2.0 features to improve adults over 55 s’ engagement in and behaviour changes from web-based physical activity interventions.Trial registrationACTRN ACTRN12611000157976, Registered 7 March 2011.

Online Dissemination Strategies of a Canada Research Chair: Overview and Lessons Learned.

BackgroundLittle is known about the use of online dissemination strategies, such as websites and social media, to increase the visibility and uptake of research.ObjectiveTo describe two online dissemination strategies of the Canada Research Chair in Implementation of Shared Decision Making in Primary Care over an eight-year period.MethodsOur two sources of online dissemination data were the website of the Canada Research Chair in Implementation of Shared Decision Making in Primary Care and the Chair’s Twitter account. We conducted a content analysis of the news section of the website. We extracted website usage statistics using Google Analytics and analyzed indicators such as total number of visits, new and returning visitors, page views per visit, time spent onsite per visit, visitors’ country of origin, and most popular pages. From the Chair’s Twitter account, we collected the number of tweets, followers, and follows. We consulted Google Scholar to chart the trend in citations of the Chair’s articles over the same period.ResultsFrom the website’s inception in January 2008 to December 2015, we recorded an average of 7906 visits per year (3809 in 2008; 8874 in 2015), 65.85% of which involved new visitors (5206/7906). The average number of pages viewed per visit was 3.2 and average bounce rate was 57.87% (4575/7906). Visitors spent an average of two minutes and 12 seconds per visit. We computed visits from 162 countries, with the majority from Canada (5910/7906, 74.75%). In order of frequency, the seven most visited pages were: (1) home page with news of publications and grants (24,787 visits), (2) profile of Chairholder (8041 visits), (3) profiles of research team members (6272 visits), (4) list of research team members (4593 visits), (5) inventory of shared decision making (SDM) programs (1856 visits), (6) interprofessional approaches to SDM (1689 visits), and (7) description of Chair activities (1350 visits). From the inception of the Twitter account in April 2011 to November 30, 2016 we recorded 5831 tweets in French and English, 1679 followers, and 1112 follows. The total number of visits and visitors to the website increased during the first three years, stabilized, and then dropped slightly, while the number of returning visitors rose slightly. In comparison, citations of the Chair’s articles increased steadily over the same period, rising more sharply as visits to the website declined.ConclusionsOver an eight-year period, visitors to the website increased in the first three years before levelling off. Meanwhile, the Chair’s citations rose continuously. There was no observable association between website visits or Twitter activity and rising citations. Our results suggest that online dissemination may not yet be a major determinant of research uptake or visibility in the scientific community.

Sesotho Online: Establishing an internet-based language knowledge community

Online knowledge communities can affect the status of languages within the internet linguistic landscape. Despite the prominence of English in the online environment, multilingualism is increasingly being promoted in these environments. It is against this background that the status, presentation and representation of African languages are being investigated. This article reports on the contribution of the website Sesotho Online to the establishment of an internet-based language knowledge community for the Sesotho language. In its literature review the article considers the concept of language knowledge communities and the internet language landscape with particular reference to Sesotho. Furthermore, an overview of website usage statistics and qualitative research by means of a descriptive study (borrowing from methodologies of autoethnographical enquiry of the author’s experiences) is provided. Online trends over the past twenty years are mirrored in the development of the researched website. From reflections on this website, some recommendations are made towards future developments in other African languages, for example. In conclusion, through Sesotho Online, clear lessons are learnt for the development of other internet-based language knowledge communities within the South African and other minority language contexts.

Acceptability of a mobile health exercise-based cardiac rehabilitation intervention: a randomized trial.

Mobile technologies (mHealth) have recently been used to deliver behavior change interventions; however, few have investigated the application of mHealth for treatment of ischemic heart disease (IHD). The Heart Exercise And Remote Technologies trial examined the effectiveness of an mHealth intervention to increase exercise behavior in adults with IHD. As a part of this trial, a process evaluation was conducted. One hundred seventy-one adults with IHD were randomized to receive a 6-month mHealth intervention (n = 85) plus usual care or usual care alone (n = 86). The intervention delivered a theory-based, automated package of exercise prescription and behavior change text messages and a supporting Web site. Three sources of data were triangulated to assess intervention participant perceptions: (1) Web site usage statistics; (2) feedback surveys; and (3) semistructured exit interviews. Descriptive information from survey and Web data were merged with qualitative data and analyzed using a semantic thematic approach. At 24 weeks, all intervention participants provided Web usage statistics, 75 completed the feedback survey, and 17 were interviewed. Participants reported reading the text messages (70/75; 93%) and liked the content (55/75; 73%). The program motivated participants to exercise. Several suggestions to improve the program included further tailoring of the content (7/75; 7%) and increased personal contact (10/75; 13%). Adults with IHD were able to use an mHealth program and reported that text messaging is a good way to deliver exercise information. While mHealth is designed to be automated, programs might be improved if content and delivery were tailored to individual needs.

Is an online skin cancer toolkit an effective way to educate primary care physicians about skin cancer diagnosis and referral?

Skin disorders account for over 20% of GP consultations. Half of dermatology referrals to secondary care are for skin lesions, but only 12% of urgent skin cancer referrals are deemed appropriate. Suitably designed online learning resources may positively impact GP confidence in the recognition of skin cancer and improve patient outcomes. This study evaluated the impact of a national, online, skin cancer recognition toolkit on GP confidence and knowledge in diagnosing skin cancers and referral behaviour to secondary care. The toolkit, consisting of a referral decision aid, lesion recognition resource, clinical cases and a quiz, was launched in March 2012. Website usage statistics and online focus groups were used to assess the usability of the website and perceived changes in behaviour. The impact of the toolkit was assessed using national skin cancer referral data, cross-sectional questionnaires and urgent skin cancer referral data to two NHS trusts. The toolkit was accessed by 20% of GPs in England from 20th March to 31st October 2012; spending a mean of over 5minutes each, with over 33% return users. A survey revealed that the toolkit improved perceptions of skin cancer training and self-reported knowledge about skin cancer referral pathways. Analysis of referral patterns did not identify an impact of the toolkit on number or appropriateness of urgent skin cancer referrals in the eight months following the launch of the website. Online focus groups confirmed the usefulness of the resource and suggested a positive influence on knowledge and referral behaviour. The skin cancer toolkit is an accessible online learning resource for improving confidence with skin cancer referral amongst GPs. Although we were unable to identify any immediate changes in skin cancer diagnoses or appropriate referral behaviours, research is required to evaluate its longer term effects on outcomes.

The Use of an Integrated Website to Enhance the Educational Experience in a Medical School Radiology Clerkship Course

The purpose of this study was to demonstrate the feasibility of creating an integrated website for the medical students enrolled in a core radiology clerkship and to assess the impact of this website on students' overall educational experience. An integrated website was created for the medical students and hosted on the main departmental website. The components of the website included: announcements and password-protected schedule, curriculum, student assessment, information about different radiology sections, digital resources, and fourth year opportunities. The schedule section was created using Google Calendar to facilitate automatic syncing and real-time updates to the students' mobile devices. Weblinks for resources and assignments were incorporated into the calendar entries, which could be "pushed" to students in real time. Student attitudes were assessed via an exit survey. Various website usage statistics were collected. A total of 35 students who have rotated through the month-long clerkship thus far have used the website. Overall, 80% of students accessed the website once or multiple times a day. Over 90% of students thought that the website was well organized and easy to use; having access to the schedule on a smartphone had a positive impact on overall clerkship experience; the website had an overall positive impact on their clerkship experience; and they would recommend it to visiting medical students. Since July 2013, there have been a total of 9740 page views with 4113 unique visits to the website (an average of 17 visits per day from 6 visitors per day). The authors conclude that the creation of an integrated website has a positive impact on students' overall educational experience.

Collaborative gaming and competition for CS-STEM education using SPHERES Zero Robotics

There is widespread investment of resources in the fields of Computer Science, Science, Technology, Engineering, Mathematics (CS-STEM) education to improve STEM interests and skills. This paper addresses the goal of revolutionizing student education using collaborative gaming and competition, both in virtual simulation environments and on real hardware in space. The concept is demonstrated using the SPHERES Zero Robotics (ZR) Program which is a robotics programming competition. The robots are miniature satellites called SPHERES—an experimental test bed developed by the MIT SSL on the International Space Station (ISS) to test navigation, formation flight and control algorithms in microgravity. The participants compete to win a technically challenging game by programming their strategies into the SPHERES satellites, completely from a web browser. The programs are demonstrated in simulation, on ground hardware and then in a final competition when an astronaut runs the student software aboard the ISS. ZR had a pilot event in 2009 with 10 High School (HS) students, a nationwide pilot tournament in 2010 with over 200 HS students from 19 US states, a summer tournament in 2010 with ∼150 middle school students and an open-registration tournament in 2011 with over 1000 HS students from USA and Europe. The influence of collaboration was investigated by (1) building new web infrastructure and an Integrated Development Environment where intensive inter-participant collaboration is possible, (2) designing and programming a game to solve a relevant formation flight problem, collaborative in nature—and (3) structuring a tournament such that inter-team collaboration is mandated. This paper introduces the ZR web tools, assesses the educational value delivered by the program using space and games and evaluates the utility of collaborative gaming within this framework. There were three types of collaborations as variables—within matches (to achieve game objectives), inter-team alliances and unstructured communication on online forums. Simulation competition scores, website usage statistics and post-competition surveys are used to evaluate educational impact and the effect of collaboration.

An online randomised controlled trial to assess the feasibility, acceptability and potential effectiveness of ‘Living with Bipolar’: A web-based self-management intervention for Bipolar Disorder: Trial design and protocol

BackgroundBipolar Disorder (BD) is a common and severe form of mental illness. Pharmacotherapy is the main treatment offered, but has limited effectiveness, and there is increasing evidence that people with BD respond well to psychological interventions. Inequalities in access to face-to-face psychological interventions mean many people seek support outside of routine health services. AimTo assess a recovery informed web-based self-management intervention for BD to increase access to psychological support. MethodA small online randomised controlled trial (RCT) will evaluate the feasibility, acceptability and potential effectiveness of the intervention compared to treatment as usual (TAU). Feasibility and acceptability will be assessed by recruitment, adherence and dropout rates, website usage statistics, user satisfaction scales and a series of qualitative interviews. Effectiveness will be assessed on a range of outcome measures including quality of life, mood symptoms, coping, recovery, and illness beliefs. AnalysisRates of adherence and dropout will be analysed using logistic regression models with health, socioeconomic and treatment factors as explanatory variables. Changes in quality of life mean scores, contrasting between arms, will be assessed using random effects models. An exploratory analysis will be performed on the secondary outcomes. Thematic analysis (Braun & Clarke, 2006) will be used to analyse the qualitative interviews. DiscussionThe benefits, challenges and methodological challenges of developing a web-based intervention and conducting an RCT online are discussed. ConclusionThe results of this trial will inform a definitive trial; and the implementation phase will aim to assess the potential for use within the NHS.

Beyond Description: Converting Web Site Usage Statistics into Concrete Site Improvement Ideas

Web site usage statistics are a widely used tool for Web site development, but libraries are still learning how to use them successfully. This case study summarizes how Morris Library at Southern Illinois University Carbondale implemented Google Analytics on its Web site and used the reports to inform a site redesign. As the main campus library at a research university with about 20,000 undergraduate and graduate students, the library included resources from multiple library departments on a single site. In planning the redesign, Morris Library's Virtual Library Group combined usage reports with information from other sources, such as usability tests and user comments. The Virtual Library Group faced barriers to interpreting and applying the usage statistics in the site redesign, including some that were specific to the library's implementation of the Google Analytics tool and some limitations inherent with Web usage statistics in general. Some key barriers in applying the usage statistics to a redesign included sifting through data that did not have implications for the site redesign, interpreting the implications of usage numbers for the site redesign, and balancing competing interests within the library. Nevertheless, the usage statistics enabled the Virtual Library Group to make better decisions by providing a source of factual information about the site's use rather than relying on staff members’ opinions and conjectures.

Letters to the Editor

Letters to the Editor

A Two-Tiered Model for Analyzing Library Web Site Usage Statistics, Part 2: Log File Analysis

The author proposes a two-tiered model for analyzing website usage statistics for academic libraries: one tier for library administrators that analyzes measures indicating library use, and a second tier for website managers that analyzes measures that aid in server maintenance and site design. The author discusses the technology of website usage statistics, including several caveats about the accuracy of derived counts, and recommends important measures for each tier. Part 1 describes Web server logs and the challenges inherent in their analysis. Part 2 presents recommendations for conducting log file analysis to obtain meaningful information, benefiting administrators and site managers.

A Two-Tiered Model for Analyzing Library Website Usage Statistics, Part 1: Web Server Logs

The author proposes a two-tiered model for analyzing website usage statistics for academic libraries: one tier for library administrators that analyzes measures indicating library use, and a second tier for website managers that analyzes measures that aid in server maintenance and site design. The author discusses the technology of website usage statistics, including several caveats about the accuracy of derived counts, and recommends important measures for each tier. Part 1 describes Web server logs and the challenges inherent in their analysis. Part 2 presents recommendations for conducting log file analysis to obtain meaningful information, benefiting administrators and site managers.

Recommendations for Benchmarking Web Site Usage among Academic Libraries

The Web sites that academic libraries are developing for their research communities represent an important new aspect of information management. Comparative statistical analysis of Web site usage among similar institutions would improve librarians’ ability to evaluate the effectiveness of their efforts. A centralized voluntary reporting structure for Web server usage statistics, coordinated by the Association of Research Libraries’ (ARL’s) Office of Statistics, would provide a significant service to academic librarians. Factors to consider in designing such a benchmarking program are discussed, based on a pilot study of Web site usage statistics from fourteen science and technology libraries.