Heuristic Evaluation Criteria for Physical Devices

26 Sep 2008 - 12:05pm
5 years ago
8 replies
1786 reads
david.shaw6@gma...
2004

Good Friday!
I'm trying to find a list of criteria when doing a heuristic evaluation on a
physical device. So far the only thing I've been able to find is
Useit.com's list,
http://www.useit.com/papers/heuristic/heuristic_list.html which
is specific to screen interfaces. Is there anything out there for non-screen
based testing?

Thanks in advance!
David

--
"Art provokes thinking, design solves problems"

w: http://www.davidshaw.info

Comments

26 Sep 2008 - 12:14pm
adamya ashk
2004

That would depend on the type and purpose of the device being evaluated.

Can you elaborate?

"Heuristics are "rules of thumb", educated guesses, intuitive
judgments or simply common sense"
http://en.wikipedia.org/wiki/Heuristic

-Adamya

On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> Good Friday!
> I'm trying to find a list of criteria when doing a heuristic evaluation on a
> physical device. So far the only thing I've been able to find is
> Useit.com's list,
> http://www.useit.com/papers/heuristic/heuristic_list.html which
> is specific to screen interfaces. Is there anything out there for non-screen
> based testing?
>
> Thanks in advance!
> David
>
>
>
> --
> "Art provokes thinking, design solves problems"
>
> w: http://www.davidshaw.info
> ________________________________________________________________
> Welcome to the Interaction Design Association (IxDA)!
> To post to this list ....... discuss at ixda.org
> Unsubscribe ................ http://www.ixda.org/unsubscribe
> List Guidelines ............ http://www.ixda.org/guidelines
> List Help .................. http://www.ixda.org/help
>

26 Sep 2008 - 12:19pm
david.shaw6@gma...
2004

Sure... we're investigating some peripheral devices to our product (medical
measurement devices like a blood sugar meter, etc.). Our target is elderly
60-80 with some type of chronic condition. I didn't know if there was a
list geared more towards physical interaction (maybe even ergonomics).

On Fri, Sep 26, 2008 at 10:14 AM, adamya ashk <adamya at gmail.com> wrote:

> That would depend on the type and purpose of the device being evaluated.
>
> Can you elaborate?
>
> "Heuristics are "rules of thumb", educated guesses, intuitive
> judgments or simply common sense"
> http://en.wikipedia.org/wiki/Heuristic
>
> -Adamya
>
> On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> > Good Friday!
> > I'm trying to find a list of criteria when doing a heuristic evaluation
> on a
> > physical device. So far the only thing I've been able to find is
> > Useit.com's list,
> > http://www.useit.com/papers/heuristic/heuristic_list.html which
> > is specific to screen interfaces. Is there anything out there for
> non-screen
> > based testing?
> >
> > Thanks in advance!
> > David
> >
> >
> >
> > --
> > "Art provokes thinking, design solves problems"
> >
> > w: http://www.davidshaw.info
> > ________________________________________________________________
> > Welcome to the Interaction Design Association (IxDA)!
> > To post to this list ....... discuss at ixda.org
> > Unsubscribe ................ http://www.ixda.org/unsubscribe
> > List Guidelines ............ http://www.ixda.org/guidelines
> > List Help .................. http://www.ixda.org/help
> >
>

--
"Art provokes thinking, design solves problems"

w: http://www.davidshaw.info

26 Sep 2008 - 1:17pm
adamya ashk
2004

Ah, I see. There may be lists more geared towards this type of
question. Particulalry ones with lots of industrial designers. maybe
others on the board can chime in.

I wonder if you can find some guidelines (even rough ones based on
people's experiences). They would give you a shortest path to
'heuristics'.

I also suggest doing a rudimentary task analysis with heavy doses of
common sense around context. For example if the device has a case how
easy or difficult is it to take it out and put it back in a case. If
it takes a while to display the reading what happens while we're
waiting etc.

Best of luck.

-Adamya

On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> Sure... we're investigating some peripheral devices to our product (medical
> measurement devices like a blood sugar meter, etc.). Our target is elderly
> 60-80 with some type of chronic condition. I didn't know if there was a
> list geared more towards physical interaction (maybe even ergonomics).
>
>
> On Fri, Sep 26, 2008 at 10:14 AM, adamya ashk <adamya at gmail.com> wrote:
> > That would depend on the type and purpose of the device being evaluated.
> >
> > Can you elaborate?
> >
> > "Heuristics are "rules of thumb", educated guesses, intuitive
> > judgments or simply common sense"
> > http://en.wikipedia.org/wiki/Heuristic
> >
> > -Adamya
> >
> >
> >
> >
> > On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> > > Good Friday!
> > > I'm trying to find a list of criteria when doing a heuristic evaluation
> on a
> > > physical device. So far the only thing I've been able to find is
> > > Useit.com's list,
> > >
> http://www.useit.com/papers/heuristic/heuristic_list.html
> which
> > > is specific to screen interfaces. Is there anything out there for
> non-screen
> > > based testing?
> > >
> > > Thanks in advance!
> > > David
> > >
> > >
> > >
> > > --
> > > "Art provokes thinking, design solves problems"
> > >
> > > w: http://www.davidshaw.info
> > >
> ________________________________________________________________
> > > Welcome to the Interaction Design Association (IxDA)!
> > > To post to this list ....... discuss at ixda.org
> > > Unsubscribe ................
> http://www.ixda.org/unsubscribe
> > > List Guidelines ............ http://www.ixda.org/guidelines
> > > List Help .................. http://www.ixda.org/help
> > >
> >
>
>
>
> --
> "Art provokes thinking, design solves problems"
>
> w: http://www.davidshaw.info
>

26 Sep 2008 - 1:18pm
david.shaw6@gma...
2004

Thanks Adamya... hopefully others will have some possible insight too. :-)

On Fri, Sep 26, 2008 at 11:17 AM, adamya ashk <adamya at gmail.com> wrote:

> Ah, I see. There may be lists more geared towards this type of
> question. Particulalry ones with lots of industrial designers. maybe
> others on the board can chime in.
>
> I wonder if you can find some guidelines (even rough ones based on
> people's experiences). They would give you a shortest path to
> 'heuristics'.
>
> I also suggest doing a rudimentary task analysis with heavy doses of
> common sense around context. For example if the device has a case how
> easy or difficult is it to take it out and put it back in a case. If
> it takes a while to display the reading what happens while we're
> waiting etc.
>
> Best of luck.
>
> -Adamya
>
> On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> > Sure... we're investigating some peripheral devices to our product
> (medical
> > measurement devices like a blood sugar meter, etc.). Our target is
> elderly
> > 60-80 with some type of chronic condition. I didn't know if there was a
> > list geared more towards physical interaction (maybe even ergonomics).
> >
> >
> > On Fri, Sep 26, 2008 at 10:14 AM, adamya ashk <adamya at gmail.com> wrote:
> > > That would depend on the type and purpose of the device being
> evaluated.
> > >
> > > Can you elaborate?
> > >
> > > "Heuristics are "rules of thumb", educated guesses, intuitive
> > > judgments or simply common sense"
> > > http://en.wikipedia.org/wiki/Heuristic
> > >
> > > -Adamya
> > >
> > >
> > >
> > >
> > > On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
> > > > Good Friday!
> > > > I'm trying to find a list of criteria when doing a heuristic
> evaluation
> > on a
> > > > physical device. So far the only thing I've been able to find is
> > > > Useit.com's list,
> > > >
> > http://www.useit.com/papers/heuristic/heuristic_list.html
> > which
> > > > is specific to screen interfaces. Is there anything out there for
> > non-screen
> > > > based testing?
> > > >
> > > > Thanks in advance!
> > > > David
> > > >
> > > >
> > > >
> > > > --
> > > > "Art provokes thinking, design solves problems"
> > > >
> > > > w: http://www.davidshaw.info
> > > >
> > ________________________________________________________________
> > > > Welcome to the Interaction Design Association (IxDA)!
> > > > To post to this list ....... discuss at ixda.org
> > > > Unsubscribe ................
> > http://www.ixda.org/unsubscribe
> > > > List Guidelines ............ http://www.ixda.org/guidelines
> > > > List Help .................. http://www.ixda.org/help
> > > >
> > >
> >
> >
> >
> > --
> > "Art provokes thinking, design solves problems"
> >
> > w: http://www.davidshaw.info
> >
>

--
"Art provokes thinking, design solves problems"

w: http://www.davidshaw.info

26 Sep 2008 - 1:52pm
Joel Eden
2006

David,

Here's a link to a paper by Jiajie Zhang and others where they extend
heuristic evaluation and task analysis a bit with ideas from
distributed cognitive task theory (from earlier work by Zhang and Don
Norman) for the medical device domain; e.g. they analyze infusion pump
interfaces in the paper. There are newer papers by Zhang on his site,
but many are pay-for-access such as ACM Portal.

Zhang, J., Patel, V. L., Johnson, T. R., Chung, P., & Turley, J. P.
(2005). Evaluating and predicting patient safety for medical devices
with integral information technology. In K. Henriksen, J. B. Battles,
E. Marks & D. I. Lewin (Eds.), Advances in Patient Safety: From
Research to Implementation (pp. 323-336). Rockville, MD: Agency for
Healthcare Research and Quality.

Zhang's research publications page:
http://acad88.sahs.uth.tmc.edu/research/research.htm

PDF of the paper:
http://www.ahrq.gov/downloads/pub/advances/vol2/Zhang.pdf

Enjoy,
Joel

On Fri, Sep 26, 2008 at 1:19 PM, David Shaw <david.shaw6 at gmail.com> wrote:
> Sure... we're investigating some peripheral devices to our product (medical
> measurement devices like a blood sugar meter, etc.). Our target is elderly
> 60-80 with some type of chronic condition. I didn't know if there was a
> list geared more towards physical interaction (maybe even ergonomics).
>
> On Fri, Sep 26, 2008 at 10:14 AM, adamya ashk <adamya at gmail.com> wrote:
>
>> That would depend on the type and purpose of the device being evaluated.
>>
>> Can you elaborate?
>>
>> "Heuristics are "rules of thumb", educated guesses, intuitive
>> judgments or simply common sense"
>> http://en.wikipedia.org/wiki/Heuristic
>>
>> -Adamya
>>
>> On 9/26/08, David Shaw <david.shaw6 at gmail.com> wrote:
>> > Good Friday!
>> > I'm trying to find a list of criteria when doing a heuristic evaluation
>> on a
>> > physical device. So far the only thing I've been able to find is
>> > Useit.com's list,
>> > http://www.useit.com/papers/heuristic/heuristic_list.html which
>> > is specific to screen interfaces. Is there anything out there for
>> non-screen
>> > based testing?
>> >
>> > Thanks in advance!
>> > David
>> >
>> >
>> >
>> > --
>> > "Art provokes thinking, design solves problems"
>> >
>> > w: http://www.davidshaw.info
>> > ________________________________________________________________
>> > Welcome to the Interaction Design Association (IxDA)!
>> > To post to this list ....... discuss at ixda.org
>> > Unsubscribe ................ http://www.ixda.org/unsubscribe
>> > List Guidelines ............ http://www.ixda.org/guidelines
>> > List Help .................. http://www.ixda.org/help
>> >
>>
>
>
>
> --
> "Art provokes thinking, design solves problems"
>
> w: http://www.davidshaw.info
> ________________________________________________________________
> Welcome to the Interaction Design Association (IxDA)!
> To post to this list ....... discuss at ixda.org
> Unsubscribe ................ http://www.ixda.org/unsubscribe
> List Guidelines ............ http://www.ixda.org/guidelines
> List Help .................. http://www.ixda.org/help
>

26 Sep 2008 - 3:39pm
Rob Tannen
2006

David - You can apply most, if not all, of the same heuristic
principles that you apply to a strictly UI analysis, but I would also
integrate key physical ergonomic factors like reach and posture.
Here's a quick description of those characterisitcs -

Feedback - Identify where the user's access to sensory feedback
(e.g. visual, tactile) is comprised

Reach - Identify situations where the user's major limbs (arms,
legs) and minor limbs (fingers) must over-extend in order to
carry-out a task

Clearance - Identify situations where the user's major limbs (arms,
legs) and minor limbs (fingers) must function within a limited space,
such as finger holes or a handle

Posture - Identify situations where the user's overall body posture
is deviated from neutral position, as well as deviations at key
joints (e.g. shoulder, wrist)

Strength - Identify situations where the user must apply excessive or
prolonged force for movement or stability, relative to their strength
capabilities

For a little more context, see 5 Guidelines for Ergonomic
Observations (focused on field observations, but applicable to
heuristics) - http://tinyurl.com/4pzb3c

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Posted from the new ixda.org
http://www.ixda.org/discuss?post=33561

29 Sep 2008 - 9:24am
david.shaw6@gma...
2004

Thank you all who have replied to my post! I'm going to look over the stuff
and see how we can integrate it in our workflow.
David

On Fri, Sep 26, 2008 at 10:05 AM, David Shaw <david.shaw6 at gmail.com> wrote:

> Good Friday!
> I'm trying to find a list of criteria when doing a heuristic evaluation on
> a physical device. So far the only thing I've been able to find is
> Useit.com's list,
> http://www.useit.com/papers/heuristic/heuristic_list.html which is
> specific to screen interfaces. Is there anything out there for non-screen
> based testing?
>
> Thanks in advance!
> David
>
>
>
> --
> "Art provokes thinking, design solves problems"
>
> w: http://www.davidshaw.info
>

--
"Art provokes thinking, design solves problems"

w: http://www.davidshaw.info

30 Sep 2008 - 7:53am
Gustavo Gawry
2006

You should take a look at the Ergonomic criteria for human-computer
interaction from Bastien and Scapin.

http://www.inria.fr/rrrt/rt-0156.html

On Mon, Sep 29, 2008 at 11:24 AM, David Shaw <david.shaw6 em gmail.com> wrote:

> Thank you all who have replied to my post! I'm going to look over the
> stuff
> and see how we can integrate it in our workflow.
> David
>
> On Fri, Sep 26, 2008 at 10:05 AM, David Shaw <david.shaw6 em gmail.com>
> wrote:
>
> > Good Friday!
> > I'm trying to find a list of criteria when doing a heuristic evaluation
> on
> > a physical device. So far the only thing I've been able to find is
> > Useit.com's list,
> > http://www.useit.com/papers/heuristic/heuristic_list.html which is
> > specific to screen interfaces. Is there anything out there for non-screen
> > based testing?
> >
> > Thanks in advance!
> > David
> >
> >
> >
> > --
> > "Art provokes thinking, design solves problems"
> >
> > w: http://www.davidshaw.info
> >
>
>
>
> --
> "Art provokes thinking, design solves problems"
>
> w: http://www.davidshaw.info
> ________________________________________________________________
> Welcome to the Interaction Design Association (IxDA)!
> To post to this list ....... discuss em ixda.org
> Unsubscribe ................ http://www.ixda.org/unsubscribe
> List Guidelines ............ http://www.ixda.org/guidelines
> List Help .................. http://www.ixda.org/help
>

--
Gustavo Gawry
User Experience Analyst
Voice: +55 21 9498-7923
Email: gustavogawry at gmail.com
Blog: http://gawry.com (in portuguese)
Twitter: gawry

Syndicate content Get the feed