Evaluation and Experimentation

Computer scientists build complex systems or choose among existing systems to satisfy perceived needs and requirements. The system is then deployed in an environment consisting of humans and other systems. How do we know the impact of the system on the environment and how well it meets the perceived requirements? A fundamental skill in informatics is the ability to design experiments for evaluating computer systems. In this course, the students will acquire a basic understanding of how to design such experiments and what pitfalls to avoid during design and experimentation. Basic concepts of experimental design, data measurement, qualitative and quantitative evaluation, and evaluation with and without users will be covered.

Teaching Mode

Lectures, presentations, homework assignments and in-class discussions.

References

No mandatory textbook will be used. Handouts will be provided. However, students are encouraged to complement their reading with one or more of the following sources:

  • E. J. Davidson: Evaluation Methodology Basics. Sage 2004, 280 pages.
  • A. Field, G. Hole: How to Design and Report Experiments. Sage 2003, 384 pages.
  • Claes Pohlin et al.: Experimentation in Software Engineering. Springer-Verlag 2012, ISBN-13: 978-3642290435.

Editions

ClassSemesterInstructorTeaching Assistant(s)
Evaluation and Experimentation 2022 Fall
Evaluation and Experimentation 2021 Fall
Evaluation and Experimentation in Informatics 2018 Fall
Evaluation and Experimentation in Informatics 2017 Fall
Evaluation and Experimentation in Informatics 2015 Spring
Evaluation and Experimentation in Informatics 2013 Fall
Evaluation and Experimentation in Informatics 2012 Fall
-
-

Other Courses

Field Project (MMI)

The Field Project consists in a consultancy study on behalf of a firm, conducted by a group of 2-3 students under the supervision of a professor (“tutor”) for a standard duration of 4 months. The aim of the Field Project is to provide students with: experience in project management contact …

Mobile and Wearable Computing

The widespread use of mobile and wearable devices enables the implementation of novel services in applications areas like, e.g., mobile health, sustainability, smart working, and more. This course introduces the building blocks of such services and discusses the challenges that arise on the path towards their realization. Specific topics covered …

User Experience Design

Usability and the overall User Experience are crucial for the success of any digital product. This course takes a hands-on approach in teaching how to create useful, usable, and (well-)used digital products. Students not only develop an awareness and appreciation of the crucial implications of good interfaces in terms of …

Computer Architecture

In this course, students learn how one can describe the basic operations in a computer using digital logic, and how these operations can be realized in both hardware and software. Students gradually combine these basic operations into a “microarchitecture” — a software-controlled datapath that connects digital memory with an arithmetic-logical …

Software Atelier 2: Human Computer Interaction

Software Atelier 2: Human Computer Interaction Goal of the course is to provide students with theoretical and practical knowledge of human-centered design of interfaces for computing systems. The course starts with an introduction to ethics that investigates the many ways and venues information and communication technologies can be used maliciously. …

Computer Networking

The Internet provides global connectivity for applications and end-users. This course aims to convey an understanding of, on the one hand, how common distributed applications such as the world-wide web use the network (the Internet), and, on the other hand, how the network is designed and how it provides its …

Recent News

People-Centered
Computing Group

Profs. S. Santini and M. Langheinrich
Università della Svizzera italiana (USI)
Faculty of Informatics
Via G. Buffi 13
6900 Lugano, Switzerland