Research / Imaging and Perception Systems for Robotics / Human–robot interaction

Robot-Tablet Multimodal Behavioral Phenotyping for Cognitive Concern in Older Adults

We use a robot and tablet in brief, standardized sessions with older adults to measure behavioral markers of cognitive concern that are difficult to capture with paper-based, tablet-only, or static voice-based screening.

The humanoid robot introduces the tasks, and the tablet records participants’ responses.
The humanoid robot introduces the tasks, and the tablet records participants’ responses.

Project overview

A humanoid robot introduces each task, directs the participant’s attention, and responds as the conversation unfolds. The tablet records answers, drawings, taps, and response times. We study these records alongside speech and movement to see how cognitive concerns relate to a participant’s responses. The study does not provide a clinical diagnosis of mild cognitive impairment (MCI).

Project media

Project team

Project lead
Yang Qian

Principal investigator
Huaijin Chen

Contributors
Christian Moore · Ethan Chung · Sean Hiroki Flynn · Riki MacMillan