Multitouch and iPhone - tip of the iceberg?

22 Jun 2007 - 11:56pm
7 years ago
3 replies
1015 reads
Trip O'Dell
2007

Interesting post on slashdot today discussing how the iphone may not
work with many rich media/web 2.0 applications because so many rich
behaviors currently assume a single point of focus (the mouse) and
therefore use onMouse events to trigger behaviors. Apparently, this
is not the way the iPhone handles touch events on the screen.

iPhone certainly won't be the last multi-touch device, and a standard
will eventually emerge from the market to deal with these sorts of
interactions, but in the mean time how will we design sites to
gracefully accommodate enhanced interfaces like iphone?

Could a web 2.0 browser war emerge? (WBW II). Does the IxDA as a
group of UX professionals have a responsibility to help shape a
unified vision for gesture-based interactions on the web? I'm
thinking of theway the W3C took the specification for HTML out of the
browser companies hands...

Lots of questions here. I guess I'm feeling lonely and want to see my
mailbox fill up with ixda messages. (pull the pin and count to three
- hehe)

Trip

The post on slashdot is here:
http://ask.slashdot.org/article.pl?sid=07/06/23/0028245&from=rss

Trip O'Dell
Interaction Designer
www.tripodell.com
------------------------------
"Specialization is for insects..."
-Robert A. Heinlein

Comments

23 Jun 2007 - 6:55am
Dave Malouf
2005

The guided tour
(http://www.apple.com/iphone/usingiphone/guidedtour.html) was very
enlightening in how they are thinking about gestures and I think the
issue of "mouseover" is not just a multi-touch issue, but just one
of pointing device. I mean how do you do a "mouseover" w/ a
single-touch device let alone a multi-touch one.

But looking at the guided tour has opened my eyes a bit to some
possibilities for how to handle this scenario and it is good one.

There are two types of "mouseovers". There is the "button
activation", ie. I rollover a button (or clickable area) and it
changes style communicating better the "hotness" of the button. It
also has an active state and a visited state as possible states to
communicate.

Then there is the rollover to reveal more information. THIS type of
rollover could possibly be done as a single-click and the action to
go to further detail be a double-click.

But going back to possible gestures for roll-over reveals might be
done in a multi-touch with many some of these:
double-finger tap
2 fingers: one holds off the active area and the other drags from the
holded finger out towards the active roll-over area.

Further, there may just need to be browser specific handles for
aiding in degredation of the rollover and other specific behaviors
like it.

Another area of gestures that Tip hasn't spoken about that is also
relevant in the hand-held space is motion-sensing. Too big a topic.

What IxDA might be able to do to take on this topic is create a wiki
space for exploring gestures in 2D and 3D and multi-touch
configurations.

There are a few projects like this that are interesting. Such as the
Touch project (http://www.nearfield.org/) which discusses changes in
interaction design based on RFID and other Near Field communication
protocols and technologies.

I love how a product like the iPhone really brings all of this to the
fore for us as many of us will be using and thus experimenting for
real with these technologies. It isn't just a dream any more.

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Posted from the new ixda.org
http://beta.ixda.org/discuss?post=17540

23 Jun 2007 - 9:13am
Petteri Hiisilä
2004

> The guided tour
> (http://www.apple.com/iphone/usingiphone/guidedtour.html) was very
> enlightening in how they are thinking about gestures and I think the
> issue of "mouseover" is not just a multi-touch issue, but just one
> of pointing device. I mean how do you do a "mouseover" w/ a
> single-touch device let alone a multi-touch one.

Maybe it should detect the finger that hasn't touched the screen yet.
Heat sensitive surface with smart tracking algorithms comes to mind.

Petteri

--
Petteri Hiisilä
Senior Interaction Designer
iXDesign / +358505050123 /
petteri.hiisila at ixdesign.fi

"Simple is better than complex.
Complex is better than complicated."
- Tim Peters

23 Jun 2007 - 4:03pm
lists
2006

Capacitive sensing technologies should also be able to do this.

Apple already has a filed patent application, "Proximity detector in
handheld device", on this topic so it's certainly something they've
been thinking about for a while. Here's an article:
http://www.appleinsider.com/articles/06/07/20/
inside_apples_latest_ipod_touch_screen_patent_filing.html

And the actual patent application:
http://appft1.uspto.gov/netacgi/nph-Parser?
Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-
bool.html&r=6&f=G&l=50&co1=AND&d=PG01&s1=proximity.AB.&s2=apple.AS.&OS=A
BST/proximity+AND+AN/apple&RS=ABST/proximity+AND+AN/apple

-Lonny

-------------------------------
Lonny L. Chu, Ph.D.
Principal, Furiant Consulting
www.furiant.com
-------------------------------

On Jun 23, 2007, at 7:13 AM, Petteri Hiisilä wrote:

>> The guided tour
>> (http://www.apple.com/iphone/usingiphone/guidedtour.html) was very
>> enlightening in how they are thinking about gestures and I think the
>> issue of "mouseover" is not just a multi-touch issue, but just one
>> of pointing device. I mean how do you do a "mouseover" w/ a
>> single-touch device let alone a multi-touch one.
>
> Maybe it should detect the finger that hasn't touched the screen yet.
> Heat sensitive surface with smart tracking algorithms comes to mind.
>
> Petteri
>
> --
> Petteri Hiisilä
> Senior Interaction Designer
> iXDesign / +358505050123 /
> petteri.hiisila at ixdesign.fi
>
> "Simple is better than complex.
> Complex is better than complicated."
> - Tim Peters
>
>
> ________________________________________________________________
> Welcome to the Interaction Design Association (IxDA)!
> To post to this list ....... discuss at ixda.org
> List Guidelines ............ http://listguide.ixda.org/
> List Help .................. http://listhelp.ixda.org/
> (Un)Subscription Options ... http://subscription-options.ixda.org/
> Announcements List ......... http://subscribe-announce.ixda.org/
> Questions .................. lists at ixda.org
> Home ....................... http://ixda.org/
> Resource Library ........... http://resources.ixda.org

Syndicate content Get the feed