Time
Jan - Apr 2022
Industry
Mixed Reality
team
Haoran Xu, Carina Geng,
Duoning Zheng, Zoe Zhang
Role
MR Designer
What if...
...things with hands in Mixed Reality?
People want to select & muti-select
People want to group & ungroup
People want to Copy & Paste
People want to delete
People want to undo
What does Metaverse & Mixed Reality mean in our eyes?
Why would Metaverse come true?
and why MR is the Access Point?
Currently, a lot of VR interactions are focused on gestures and behavior that people familiar with. However the metaverse can go beyond that. What if I can go beyond the traditional ways of interaction and improve the VR interaction?
However, What are the interaction barriers in metaverse (MR interaction)?
Based on our research of the XR interaction, I found that the user experience is insufficient, and we summarized them into the following bullet points.
And users can apply interactions everywhere as simple as sending emojis.
I want to explore the possibilities of universal gestural interfaces to make the interaction more usable, intuitive, and efficient.
AS A RESULT
target user
I research the current VR/AR/MR user, and designed a persona based on them.
concept
I made a game to help game designers try out our gestures library, experiencing them in an immersive environment.
User needs to use various of the interactions to escape from 2 rooms.
Scenario 1 room
(Entry interaction)
Scenario 2 factory
(advanced interaction)
design principles
According to Don Norman's article: Gestural Interfaces: A Step Backwards In Usability, I set design principles.
Visibility
Perceptible & Obvious signifiers.
Instant Feedback
Immediately, no matter it is a change of the status or showing the result of interaction.
Non-destructive operations
Hence the importance of "undo"
Discoverability
All operations can be discovered by systematic exploration of menus or Guidance
Reliability
Operations should work. Period. And events should not happen randomly.
Consistency
Logical and systematical interface. A good set of gestures should be applied across systems to reduce user memory costs.
Develop
Gesture Library
Setting up design principles based current OS interactions but in VR.
Natural Gestures
Select
Rotate
Move
Delete
Drag in space
Gestures for editing
Multi-select
Multi-selected
Group/Ungroup
Slicer
Selection
Scan
Gestures for virtual tools
Menu
Picker/Eyedrop
storage
making the interaction more intuitive
I led the research that watched people's reactions to completing tasks in real life and recorded them and analyzed the results and pulled out some common themes to create our final set of gestures.
improve the efficiency of the gestures
In order to improve the efficiency of gestures, I studied the interactions in the current interfaces and improved the efficiency of each gestures in XR. In result, I worked with the team developed the following gestures.
what i learned & The Impact
The infrastructure is to be built for the Metaverse. Just like the current screen based OS, I wish one day that our work can inspire people to design a universal interaction for all XR Apps.
© Copyright 2024 • All Rights Reserved
haoranfuture@gmail.com