Towards the Fusion of Gaze and Micro-Gestures

Kagan Taylor; Haopeng Wang; Florian Weidner; Hans Gellersen

doi:10.1109/VRW66409.2025.00383

Towards the Fusion of Gaze and Micro-Gestures

Computing and Communications

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review

90 Downloads (Pure)

Abstract

Gaze and hand-based micro-gestures have been widely studied individually, each offering unique advantages as input modalities, but their combination remains under-explored. In this work, we integrate gaze with thumb-to-finger micro-gestures, discussing their complementary strengths to enable expressive and efficient interactions. We examine two strategies for combining gaze and microgestures, assess their strengths and weaknesses, and present examples such as mouse emulation and application shortcuts. Finally, we outline the potential and challenges of gaze and micro-gestures to enhance interaction across diverse contexts, and discuss future directions. This work begins the exploration of gaze and micro-gestures for novel input techniques.

Original language	English
Title of host publication	2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Publisher	IEEE
Pages	1474-1475
Number of pages	2
ISBN (Electronic)	9798331514846
ISBN (Print)	9798331525637
DOIs	https://doi.org/10.1109/VRW66409.2025.00383
Publication status	Published - 24/04/2025

User-defined Keywords

Three-dimensional displays
Head-mounted displays
Conferences
Emulation
Focusing
Augmented reality
Human-computer interaction
micro-gestures
gaze
virtual reality
augmented reality
head-mounted displays

Access to Document

10.1109/VRW66409.2025.00383

_IEEE_VR_Poster__Gaze___Micro_GesturesAccepted author manuscript, 290 KBLicence: CC BY: Creative Commons Attribution 4.0 International License

https://ieeexplore.ieee.org/document/10972884

H2020 GEMINI: Gaze and Eye Movement in Interaction
Gellersen, H. (Principal Investigator)
European Commission
1/10/21 → 30/09/27
Project: Research

Cite this

@inproceedings{ac4bfe1f97a842b6abc3f5c8ac9030f1,

title = "Towards the Fusion of Gaze and Micro-Gestures",

abstract = "Gaze and hand-based micro-gestures have been widely studied individually, each offering unique advantages as input modalities, but their combination remains under-explored. In this work, we integrate gaze with thumb-to-finger micro-gestures, discussing their complementary strengths to enable expressive and efficient interactions. We examine two strategies for combining gaze and microgestures, assess their strengths and weaknesses, and present examples such as mouse emulation and application shortcuts. Finally, we outline the potential and challenges of gaze and micro-gestures to enhance interaction across diverse contexts, and discuss future directions. This work begins the exploration of gaze and micro-gestures for novel input techniques.",

keywords = "Three-dimensional displays, Head-mounted displays, Conferences, Emulation, Focusing, Augmented reality, Human-computer interaction, micro-gestures, gaze, virtual reality, augmented reality, head-mounted displays",

author = "Kagan Taylor and Haopeng Wang and Florian Weidner and Hans Gellersen",

year = "2025",

month = apr,

day = "24",

doi = "10.1109/VRW66409.2025.00383",

language = "English",

isbn = "9798331525637",

pages = "1474--1475",

booktitle = "2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)",

publisher = "IEEE",

}

TY - GEN

T1 - Towards the Fusion of Gaze and Micro-Gestures

AU - Taylor, Kagan

AU - Wang, Haopeng

AU - Weidner, Florian

AU - Gellersen, Hans

PY - 2025/4/24

Y1 - 2025/4/24

N2 - Gaze and hand-based micro-gestures have been widely studied individually, each offering unique advantages as input modalities, but their combination remains under-explored. In this work, we integrate gaze with thumb-to-finger micro-gestures, discussing their complementary strengths to enable expressive and efficient interactions. We examine two strategies for combining gaze and microgestures, assess their strengths and weaknesses, and present examples such as mouse emulation and application shortcuts. Finally, we outline the potential and challenges of gaze and micro-gestures to enhance interaction across diverse contexts, and discuss future directions. This work begins the exploration of gaze and micro-gestures for novel input techniques.

AB - Gaze and hand-based micro-gestures have been widely studied individually, each offering unique advantages as input modalities, but their combination remains under-explored. In this work, we integrate gaze with thumb-to-finger micro-gestures, discussing their complementary strengths to enable expressive and efficient interactions. We examine two strategies for combining gaze and microgestures, assess their strengths and weaknesses, and present examples such as mouse emulation and application shortcuts. Finally, we outline the potential and challenges of gaze and micro-gestures to enhance interaction across diverse contexts, and discuss future directions. This work begins the exploration of gaze and micro-gestures for novel input techniques.

KW - Three-dimensional displays

KW - Head-mounted displays

KW - Conferences

KW - Emulation

KW - Focusing

KW - Augmented reality

KW - Human-computer interaction

KW - micro-gestures

KW - gaze

KW - virtual reality

KW - augmented reality

KW - head-mounted displays

U2 - 10.1109/VRW66409.2025.00383

DO - 10.1109/VRW66409.2025.00383

M3 - Conference contribution/Paper

SN - 9798331525637

SP - 1474

EP - 1475

BT - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

PB - IEEE

ER -

Towards the Fusion of Gaze and Micro-Gestures

Abstract

User-defined Keywords

Access to Document

Projects

H2020 GEMINI: Gaze and Eye Movement in Interaction

Cite this