A.Hornof -- 11/13/07
CIS 443/543, Fall 2007
CRN: 11350 (for 443), 11360 (for 543)

Project #6
Observe the Users

Due: Wednesday 11/28/07, at the start of class.

Purpose of assignment:

Working in your groups, evaluate your system with a user observation study. Identify problems with the interface. Propose design modifications to address these problems.

User Observation Study

A few key points:

  • You should identify usability problems.
  • You should conduct each evaluation for representative tasks.
  • Make sure you have enough tasks for the user to accomplish. They shouldn't be done with just a few mouse clicks.
  • Load your system with sample data so that it creates the most realistic test as possible.

The user observation study participants should not be computer science students or students in this class.

Follow all of the guidance provided in Chapter 7 for conducting user observation studies.

Write a script that you will follow each participant. Turn in the script with your evaluation. The script should incorporate all of Apple Computer's guidelines for Involving Users in the Design Process.

Videotape your user observation study. Reserve and check out a video camera and tripod from UofO Library Media Services, at 346-3091. In case you need to demonstrate that the checkout is required is for a class, you can just show them this assignment. The CRN is at the top of this page.

Test the camera setup before the actual user test to make sure that you will be able to clearly capture what is displayed on the screen, and clearly hear what the user is saying. Schedule the user test and reserve the equipment in advance. You may need to reserve the equipment one week in advance. Contact the instructor if you have any trouble reserving and checking out the equipment.

Turn in for grading the following in a document-sized envelope with your names on the outside:

  1. A title page listing the group members and the name of the system and/or group.
  2. Usability Report. Use the structure of the report given below.
  3. The video from the user study. (VHS, Super-VHS, MiniDV, DVD, or QuickTime on CD.)
  4. A consent form signed by every participant in the study.

Also, each student should separately submit a Group Member Evaluation.

Class Presentation

Prepare two or three overhead transparencies that show some interesting results and conclusions based on your user observation study, and that describe modifications you would make based on your user observation study. You will show these transparencies when you demo your projects in the last week of class.

The Usability Report

The report should be about 10-15 pages long, and should have (a) page numbers that run continuously from 1 to n with no interruptions or overlap in page numbers and (b) a table of contents that points the reader to the sections listed above. This is to in part to encourage groups to assemble all of the components a day in advance, as you should, and have everyone read the document before it is turned in. Everyone in the group is responsible for everything in the document with respect to Good Writing as discussed in the syllabus.

STRUCTURE OF THE REPORT:

PART I. Introduction

 

A. Brief description of your system

 

B. Usability requirements and goals for testing and evaluation

PART II: Testing and Evaluation of the User Interface

 

A. Brief description of how you tested your design with users

 

 

Describe the videotaped usability study.

 

 

Who were the participants? How did you choose them?

 

 

What tasks did they do? How did you record it?

 

 

What was the script that you used with each participant?

How did you analyze your data?

B. Overview of was observed.

C. What was observed with respect to usability goals and requirements

D. Specific usability problems that were observed

 

 

What were they? Why did they occur?

 

E. Proposed changes to design as a result of the testing

PART III. Conclusions

 

A. Summary of testing and evaluation results

 

B. Is the design working? Identify possible improvements and extensions.

C. Reflect on what you learned from the assignment and/or entire project.

Acknowledgments

This assignment is derived from Professor Sarah Douglas' UO Fall 1998 CIS 443/543 Assignment #4.