Skip to main content

Teaching Empirical Software Engineering at Eindhoven University of Technology

Alexander Serebrenik
Nathan Cassee
Syllabus Slides Exams

Abstract
#

In this chapter, we share an experience report of teaching a master course on empirical research methods at Eindhoven University of Technology in the Netherlands. The course is taught for ten weeks to a mix of students from different study programs and combines both practical assignments with a closed-book exam. We discuss the challenges of teaching a course on research methods and explain how we address these challenges in the course design. Additionally, we share our lessons learned and the challenges we encountered over several iterations of teaching the course.

Fulltext on Springer Link

Materials
#

The files in these folders accompany the book chapter “Teaching Empirical Methods at Eindhoven University of Technology”. The book chapter gives an overview of Empirical Methods in Software Engineering, a master course taught to the computer science & engineering students of Eindhoven University of Technology in the Netherlands. Below an overview of all of the materials included in this supplement is given:

Syllabus
#

The syllabus of the 2023/2024 edition as it was available to the students. It contains the lecture schedule, the requirements for each of the assignments, and an overview of the primary sources on which the course has been based.

Download .pdf

Exams
#

Both the original exam (Exam) and the resit exam (Resit) for three academic years (21/22, 22/23, 23/24) are available. Each of these exams also contained, as appendix, a short paper with the threats to validity section redacted. The mapping of papers to exams is included as the following table:

ExamPaper
23-ExamG. Kudrjavets, N. Nagappan and A. Rastogi, “Are We Speeding Up or Slowing Down? On Temporal Aspects of Code Velocity,” in 2023 IEEE/ACM 20th International Conference on Mining Software Repositories (MSR), Melbourne, Australia, 2023 pp. 267-271. doi: 10.1109/MSR59073.2023.00046
23-ResitKoyanagi, K., Wang, D., Noguchi, K., Kondo, M., Serebrenik, A., Kamei, Y., & Ubayashi, N. (2024). Exploring the Effect of Multiple Natural Languages on Code Suggestion Using GitHub Copilot. ArXiv, abs/2402.01438.
22-ExamA. Moharil, D. Orlov, S. Jameel, T. Trouwen, N. Cassee and A. Serebrenik, “Between JIRA and GitHub: ASFBot and its Influence on Human Comments in Issue Trackers,” 2022 IEEE/ACM 19th International Conference on Mining Software Repositories (MSR), Pittsburgh, PA, USA, 2022, pp. 112-116, doi: 10.1145/3524842.3528528.
22-ResitV. Bogachenkova, L. Nguyen, F. Ebert, A. Serebrenik and F. Castor, “Evaluating Atoms of Confusion in the Context of Code Reviews,” 2022 IEEE International Conference on Software Maintenance and Evolution (ICSME), Limassol, Cyprus, 2022, pp. 404-408, doi: 10.1109/ICSME55016.2022.00048.
21-ExamY. Huang, D. Ford and T. Zimmermann, “Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good,” 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, ES, 2021, pp. 1020-1032, doi: 10.1109/ICSE43902.2021.00096.
21-ResitN. Shimada, T. Xiao, H. Hata, C. Treude and K. Matsumoto, “GitHub Sponsors: Exploring a New Way to Contribute to Open Source,” 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE), Pittsburgh, PA, USA, 2022, pp. 1058-1069, doi: 10.1145/3510003.3510116.

Exam 21/22
#

Download .pdf

Resit Exam 21/22
#

Download .pdf

Exam 22/23
#

Download .pdf

Resit Exam 22/23
#

Download .pdf

Exam 23/24
#

Download .pdf

Resit Exam 23/24
#

Download .pdf

Slides
#

The slides of (some) of the lectures.

Warning! Unfortunately, the missing lecture slides cannot be shared publicly.

Introduction
#

Download .pdf

Research Questions and Strategies
#

Download .pdf

Sampling
#

Download .pdf

Interviews/Surveys
#

Download .pdf

Quantitative Analysis
#

Download .pdf

Inferring Demographics
#

Download .pdf

Threats
#

Download .pdf

Licensing
#

licensed under CC BY-SA 4.0
Material licensed under CC BY-SA 4.0