MBIB4840 User studies and systems evaluation Course description

This course is about how people use information systems. The course provides a theoretical and practical introduction to how to study users' information searching, system interaction, and evaluation of information systems with users. Hence, the course strongly focuses on methods for user studies and systems evaluation to qualify for suitable test designs. Further, the course centres around the core concepts of information needs and relevance as the starting point for information searching and the measurement of satisfaction with retrieved information.

The course language is English.

None.

The student should have the following learning outcomes upon successful completion of the course:

Knowledge

The student has

• advanced knowledge and insight about methods for user studies and systems evaluation.
• advanced knowledge about central concepts, and methods for user studies and systems evaluation.
• advanced knowledge about how to conduct user studies and systems evaluation.

Skills

The student can

• reflect on central concepts and methods for user studies and systems evaluation.
• assess relevant methods, and combinations of these, for user studies and systems evaluation.
• use advanced knowledge of central concepts and methods to conduct user studies and systems evaluation.

General competence

The student is able to.

• disseminate and give an account of methods for user studies and systems evaluation approaches.
• analytically assess relevant methods, and combinations of these, for user studies and systems evaluation.
• independently design, plan, and conduct different types of user studies and systems evaluation.

The course takes place with classes on a weekly basis, on campus.

Examples of teaching forms are: Lectures, class discussions, group work, student presentations, and supervision. The students receive feedback during class discussions and supervision.

The student conducts a small-scale empirical user study or system evaluation study that is reported and discussed in the term paper.

The empirical study can be made individually or in groups of 2-3 students. However, the term paper is written individually.

The students receive feedback and supervision during dialog-based teaching and joint supervision at class.

No coursework requirements or compulsory activities.

The student writes a term paper reporting the empirical study. The student decides on the focus and research problem of the empirical study within the frames of the course and in agreement with the course responsible.

The term paper is written individually.

The term paper amounts 12-14 pages (A4). The front page, the list of contents, tables, diagrams, and screen shots, the list of references, and appendices are excluded.

Font and font size: Arial / Calibri / Verdana 12 points. Line spacing: 1.5.

The term paper can be written in either English or Norwegian (or another Scandinavian language).

In case, the term paper does not pass, the student must submit a revised term paper. Note, no supervision is offered in the case of revision of the term paper.

All aids are permitted, as long as the rules for source referencing are complied with.

Grading scale A-F.

All term papers are assessed by one internal and one external examiner.