Traditional usability evaluation methods in corporate and academic
practice are well-documented and defined. This workshop seeks to
extend current thinking about those methods via discussion of methods
and metrics that have proven practicable for longitudinal data
collection. Typical evaluation methods tend to focus more on
'first-time' experiences with products that may arise within the first
hour or two, which trends the results more towards 'discoverability'
or 'learnability' problems, rather than usability problems that may
persist over time.
Longer-term usability issues are more difficult to evaluate, but they
are of great importance, especially for complex applications. An
experience or interaction that is initially difficult may become easy
with extended use and may add valuable power or functionality. It is
important to evaluate users' behavior over time with product or system
features that take longer to learn.
The goal of this one-day workshop is to gain a better understanding of
the longitudinal usability research practitioners are conducting
today. Specifically, this workshop aims to identify and discuss:
• What types of applications, web sites, or web applications would
benefit the most from longitudinal usability research?
• What methods and techniques are best suited to helping practitioners
uncover longitudinal usability issues and understand user performance
over time; and how can these methods best be incorporated into the UCD
• What are some heuristics for choosing the appropriate method(s) for
longitudinal usability studies?
• Why is longitudinal research important from a business context?
• What kinds of data provide the most value in helping us understand
We invite senior practitioners able to communicate their prior
experience and debate their methods to please submit a 3 page position
paper outlining your interest in this topic and a short bio to
(email). The position paper must be formatted using the template
provide at: https://www.usabilityprofessionals.org/upa_conference/program/2008/activity.php?id=9220#paper.
The facilitators will review each of the position papers and select up
to 20 participants. The selection process will seek a variety of case
studies from participants with diverse backgrounds and experiences.