Abstract#
In this chapter, we share an experience report of teaching a master course on empirical research methods at Eindhoven University of Technology in the Netherlands. The course is taught for ten weeks to a mix of students from different study programs and combines both practical assignments with a closed-book exam. We discuss the challenges of teaching a course on research methods and explain how we address these challenges in the course design. Additionally, we share our lessons learned and the challenges we encountered over several iterations of teaching the course.
Fulltext on Springer LinkMaterials#
The files in these folders accompany the book chapter “Teaching Empirical Methods at Eindhoven University of Technology”. The book chapter gives an overview of Empirical Methods in Software Engineering, a master course taught to the computer science & engineering students of Eindhoven University of Technology in the Netherlands. Below an overview of all of the materials included in this supplement is given:
Syllabus#
The syllabus of the 2023/2024 edition as it was available to the students. It contains the lecture schedule, the requirements for each of the assignments, and an overview of the primary sources on which the course has been based.
Download .pdfExams#
Both the original exam (Exam) and the resit exam (Resit) for three academic years (21/22, 22/23, 23/24) are available. Each of these exams also contained, as appendix, a short paper with the threats to validity section redacted. The mapping of papers to exams is included as the following table:
Exam | Paper |
---|---|
23-Exam | G. Kudrjavets, N. Nagappan and A. Rastogi, “Are We Speeding Up or Slowing Down? On Temporal Aspects of Code Velocity,” in 2023 IEEE/ACM 20th International Conference on Mining Software Repositories (MSR), Melbourne, Australia, 2023 pp. 267-271. doi: 10.1109/MSR59073.2023.00046 |
23-Resit | Koyanagi, K., Wang, D., Noguchi, K., Kondo, M., Serebrenik, A., Kamei, Y., & Ubayashi, N. (2024). Exploring the Effect of Multiple Natural Languages on Code Suggestion Using GitHub Copilot. ArXiv, abs/2402.01438. |
22-Exam | A. Moharil, D. Orlov, S. Jameel, T. Trouwen, N. Cassee and A. Serebrenik, “Between JIRA and GitHub: ASFBot and its Influence on Human Comments in Issue Trackers,” 2022 IEEE/ACM 19th International Conference on Mining Software Repositories (MSR), Pittsburgh, PA, USA, 2022, pp. 112-116, doi: 10.1145/3524842.3528528. |
22-Resit | V. Bogachenkova, L. Nguyen, F. Ebert, A. Serebrenik and F. Castor, “Evaluating Atoms of Confusion in the Context of Code Reviews,” 2022 IEEE International Conference on Software Maintenance and Evolution (ICSME), Limassol, Cyprus, 2022, pp. 404-408, doi: 10.1109/ICSME55016.2022.00048. |
21-Exam | Y. Huang, D. Ford and T. Zimmermann, “Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good,” 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, ES, 2021, pp. 1020-1032, doi: 10.1109/ICSE43902.2021.00096. |
21-Resit | N. Shimada, T. Xiao, H. Hata, C. Treude and K. Matsumoto, “GitHub Sponsors: Exploring a New Way to Contribute to Open Source,” 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), Pittsburgh, PA, USA, 2022, pp. 1058-1069, doi: 10.1145/3510003.3510116. |
Exam 21/22#
Download .pdfResit Exam 21/22#
Download .pdfExam 22/23#
Download .pdfResit Exam 22/23#
Download .pdfExam 23/24#
Download .pdfResit Exam 23/24#
Download .pdfSlides#
The slides of (some) of the lectures.