Koli Calling Research Articles

Koli Calling 2024: Call for Participation

We warmly invite you to attend the 24th Koli Calling International Conference on Computing Education Research (Koli Calling 2024), to be held 14-17 November 2024 in the beautiful Koli National Forest in Eastern Finland. While the submission deadline for full papers and discussion papers has passed, you can still submit posters and demo papers by 20 September 2024.

Koli Calling 2024: Call for Submissions

Koli Calling 2024: Call for Submissions

Teaching Ethics in Computing: A Systematic Literature Review of ACM Computer Science Education Publications

The computing education research community now has at least 40 years of published research on teaching ethics in higher education. To examine the state of our field, we present a systematic literature review of papers in the Association for Computing Machinery computing education venues that describe teaching ethics in higher-education computing courses. Our review spans all papers published to SIGCSE, ICER, ITiCSE, CompEd, Koli Calling, and TOCE venues through 2022, with 100 papers fulfilling our inclusion criteria. Overall, we found a wide variety in content, teaching strategies, challenges, and recommendations. The majority of the papers did not articulate a conception of “ethics,” and those that did used many different conceptions, from broadly applicable ethical theories to social impact to specific computing application areas (e.g., data privacy and hacking). Instructors used many different pedagogical strategies (e.g., discussions, lectures, assignments) and formats (e.g., stand-alone courses, incorporated within a technical course). Many papers identified measuring student knowledge as a particular challenge, and 59% of papers included mention of assessments or grading. Of the 69% of papers that evaluated their ethics instruction, most used student self-report surveys, course evaluations, and instructor reflections. While many papers included calls for more ethics content in computing, specific recommendations were rarely broadly applicable, preventing a synthesis of guidelines. To continue building on the last 40 years of research and move toward a set of best practices for teaching ethics in computing, our community should delineate our varied conceptions of ethics, examine which teaching strategies are best suited for each, and explore how to measure student learning.

Koli Calling 2023 Invitation

We once more warmly invite you to attend the 23rd Koli Calling International Conference on Computing Education Research (Koli Calling 2023), to be held both online, 13-14 November 2023 and in Koli, Finland, 16-19 November 2023 in the beautiful Koli National Forest in Eastern Finland.

Koli Calling 2023 Invitation

We warmly invite you to attend the 23rd Koli Calling International Conference on Computing Education Research (Koli Calling 2023), to be held both online, 13-14 November 2023 and in Koli, Finland, 16-19 November 2023 in the beautiful Koli National Forest in Eastern Finland.

Koli Calling 2023 Call for Papers

We invite you to submit a paper or poster for the 23rd Koli Calling International Conference on Computing Education Research (Koli Calling 2023) to be hosted both online, 13-14 November 2023 and in Koli, Finland, 16-19 November 2023.

Koli Calling Conference Report

Koli Calling is a single-track conference covering a range of topics related to education in the computing disciplines. The 22nd Koli Calling International Conference on Computing Education Research was held in the beautiful Koli National Park from November 17-20, 2022. The conference was held in cooperation with the ACM and SIGCSE and was organized by the University of Eastern Finland and the University of Toronto Mississauga.

Koli Calling 2022

We warmly invite you to attend the 22nd Koli Calling International Conference on Computing Education Research (Koli Calling 2022), to be held 17-20 November 2022 in the beautiful Koli National Forest in Eastern Finland. Koli Calling is one of the leading international conferences dedicated to the scholarship of teaching and learning and to education research in the computing disciplines. This year, we had a record number of submissions (up 20% from last year!) and are anticipating a strong slate of presentations.

Koli Calling 2022

Just a reminder: the deadlines for the 22nd Koli Calling International Conference on Computing Education Research (Koli Calling 2022) are coming up soon!

Koli Calling 2022 call for participation

We invite you to submit a paper or poster to the 22nd Koli Calling International Conference on Computing Education Research (Koli Calling 2022), to be held on 17-20 November 2022.

From a National Meeting to an International Conference: A Scientometric Case Study of a Finnish Computing Education Conference

Computerisation and digitalisation are shaping the world in fundamental and unpredictable ways, which highlights the importance of computing education research (CER). As part of understanding the roots of CER, it is crucial to investigate the evolution of CER as a research discipline. In this paper we present a case study of a Finnish CER conference called Koli Calling, which was launched in 2001, and which has become a central publication venue of CER. We investigate the evolution of Koli Calling’s scholarly communities and zoom in on it’s publication habits and internalisation process. We explore the narrative of the development and scholarly agenda behind changes in the conference submission categories from the perspective of some of the conference chairs over the years.We then take a qualitative perspective, analysing the conference publications based on a comprehensive bibliometric analysis. The outcomes include classification of important research clusters of authors in the community of conference contributors. Interestingly, we find traces of important events in the historical development of CER. In particular, we find clusters emerging from specific research capacity building initiatives and we can trace how these connect research spanning the world CER community from Finland to Sweden and then further to the USA, Australia and New Zealand. This paper makes an important strategic contribution to the evolution of CER as a research discipline, from the perspective of one central event and publication venue, providing a broad perspective on the role of the conference in connecting research clusters and establishing a truly international research community. This work contributes insights to researchers in one specific CER community and how they shape the future of computing education.

Koli Calling 2021 report

Koli Calling is a single-track conference covering a range of topics related to education in the computing disciplines. The 21st Koli Calling International Conference on Computing Education Research was held virtually from November 18-21, 2021. An affiliated Doctoral Consortium, "AI Education for All," was held in-person immediately prior to the conference. This year, the conference was held in cooperation with the ACM and SIGCSE and was organized by the University of Eastern Finland, Aalto University, and the University of Toronto Mississauga.

Koli Calling is online

Koli Calling is a single-track international conference dedicated to the scholarship of teaching and learning and to education research in computing. The conference is known for its moderate size, intimate atmosphere, and lively discussions.

Koli Calling International Conference call for papers

We invite you to submit a paper or poster for the 21st Koli Calling International Conference on Computing Education Research (Koli Calling 2021) for the second virtual Koli, hosted around the world and from Finland, 18-21 November 2021.

Koli Calling 2020 call for participation

We invite you to submit a paper or poster for the 20th Koli Calling International Conference on Computing Education Research (Koli Calling 2020) and join us ... not in Koli this year, but anywhere on Earth, 19-22 November 2020.

Koli Calling 2019 conference report

The Koli Calling International Conference on Computing Education Research is a single-track conference dedicated to publishing high-quality work in all areas of teaching and learning in the computing disciplines. The 19th Koli Calling was held in November 2019 in the Koli National Park in Finland, organized by the University of Eastern Finland, the University of Helsinki, and the University of Adelaide, Australia. There is often snow at the conference and it was there in small amounts this year, along with some beautifully crisp early winter air and stunning views of the national park and its lakes.

Koli Calling 2019 call for submissions

Koli Calling is one of the leading international conferences dedicated to the scholarship of teaching and learning and to education research in the computing disciplines. Koli Calling is a single-track conference for original and novel work with research, practice, and systems presentations as well as a keynote and invited talks. The conference is known for its moderate size, intimate atmosphere, and lively discussions. The conference is held annually in the Koli National Park, about 70km north of Joensuu, Finland.

Koli Calling 2018 preview

The Koli Calling International Conference on Computing Education Research is a single-track conference dedicated to publishing high quality work on teaching and learning in the computing disciplines. The 18th Koli Calling will be held from 22-25 November 2018 in the Koli National Park in Finland, organized by the University of Warwick, the University of Helsinki, and the University of Eastern Finland, in-cooperation with ACM SIGCSE.

Koli Calling 2017 conference report

The Koli Calling International Conference on Computing Education Research is a single-track conference dedicated to publishing high quality work in all areas of teaching and learning in the computing disciplines. The 17th Koli Calling was held in November 2017, as per tradition, in the Koli National Park in Finland, organized by the University of Eastern Finland and the University of Warwick, UK. At the time of the conference every year, the national park is filled with white beautiful snow adding a mystical character to the iconic panoramic view from top of the Ukko-Koli hill. The quietly cold temperatures of the season are perfectly balanced by the lively and warm atmosphere of the conference.

Koli Calling international computing education conference review

Koli Calling International Conference on Computing Education Research is held toward the end of each year at Koli National Park in the centre of Finland. This cold time of year in Finland is well matched by a warm and inviting conference atmosphere. The conference is dedicated to scholarship of teaching and learning, and to education research in the computing disciplines. Koli is a single-track conference known for its inclusive spirit and lively discussions.