Computer mouse, touchscreen, voice… Over the history of computing, humans have continued to adapt new ways to use technology, but if it’s the other way around? What if technology adopts human needs? This talk is about how we can (re)define relationships between humans and computers in physical spaces.
Spatial Interaction is an HCI theme and design framework with the goal of creating natural ways to interact with computers and AI agents in physical spaces. We humanize sensing technologies and machine perceptions to understand user context through a combination of verbal and non-verbal cues such as voice, face, presence, proximity, hand movements, and eye gaze.
The presentation will also include case studies with actual interactions currently available on consumer products created through over 5 years of research and product developments. Throughout our research, we revisited the meaning of natural interactions to learn from social interaction, proxemics, and human factors / ergonomics to achieve more thoughtful ways to interact with information and technologies.
__________
Hideaki Matsui
Hideaki Matsui is a design lead & manager at Google. Currently, leading Physical Systems, a design team to research, humanize, and land emerging technologies for Google Assistant Hardware products. Over the past 5 years, Matsui led the team to create the design systems for spatial computing powered by sensing and machine perceptions including Face Match, Quick Gestures, Proximity-based UI, and Look and Talk that they recently announced at Google I/O 2022.