We are witnessing the rise of novel augmentation technologies designed to extend the physical abilities of able-bodied individuals. However, whilst engineers are developing extra fingers and even entire arms aimed to augment our own, relatively little attention has been afforded to how the human brain will control them. Is it possible, from a sensorimotor perspective, to merge extra robotic body parts with the human body? Here, I will describe a series of studies that aimed to begin addressing these questions, where individuals were trained to use a toe-controlled extra robotic finger (the Third Thumb; Dani Clode Design), both in the lab and ‘in the wild’. Our studies demonstrate that successful integration of a motor augmentation device can be readily achieved, with potential for flexible use, reduced cognitive reliance and increased sense of embodiment. To support this motor skill learning, participants will rely on a multitude of sensory cues arising both from the Third Thumb and from their own body. Importantly, we show that motor integration of the extra Thumb resulted in changed use and representation of the biological hand. This latter finding is of major significance as it indicates that successful human-robot integration may have consequences on certain aspects of body representation and motor control. Collectively these results demonstrate neurocognitive bottlenecks and opportunities for the successful realisation of robotic motor augmentation, with implications for related assistive technologies.
Tamar Makin is a Professor of Cognitive Neuroscience at the MRC Cognition and Brain Sciences Unit at Cambridge University and the leader of the Plasticity Lab www.plasticity-lab.com. She was previously a Professor of Cognitive Neuroscience at UCL’s Institute of Cognitive Neuroscience. Her main interest is in understanding how our body representation changes in the brain (brain plasticity). Her primary model for this work is studying hand function and dysfunction, with a focus on how we could use technology to increase hand functionality in able and disabled individuals at all ages. Tamar graduated from the Brain and Behavioural Sciences programme at the Hebrew University of Jerusalem in 2009. She was then awarded several career development fellowships to establish her research programme on brain plasticity in amputees at the University of Oxford, first as Research Fellow and later as a Principle Investigator. She joined the faculty of UCL in 2016 and moved to Cambridge in 2022. She is currently supported by the UKRI (European Research Council Consolidator Grants > deferred to UKRI), the Wellcome Trust (Senior Research Fellow) and the UK Engineering and Physical Sciences Research Council, in addition to the UK Medical Research Council.
The field of haptics has evolved beyond its early roots in robotics and virtual reality. While originally focused on object manipulation by robots, telemanipulation, and assistance for the visually impaired, there are now growing demands for haptic technologies in various computer interfaces. These include expanding the immersive experience of computer gaming and conveying the sense of touch in the metaverse. Many of these applications, basically, have aimed to support individuals to manipulate the external world according to their intentions and imaginations. However, with the rise of AI and its ability to estimate human thoughts, new possibilities for haptics are emerging. In this talk, I will discuss the evolving needs of haptics while introducing the latest developments in midair haptics using airborne ultrasound.
Hiroyuki Shinoda is a Professor with the Graduate School of Frontier Sciences at the University of Tokyo. After receiving his Ph.D., he began his carrier as an Associate Professor with the Tokyo University of Agriculture and Technology, Koganei, Japan, where he worked from 1995 to 1999. During this time, he also spent a year as a Visiting Scholar at the University of California, Berkeley, CA, USA, in 1999. He was an associate professor at the University of Tokyo from 2000 to 2012 and has been in his current position since 2013. His research focuses on haptics and mid-air haptics, as well as information physics, two-dimensional communication, and their applications. His research group has received many awards, including the Best Conference Paper Award at IEEE ICRA 1999 and the 2022 IEEE Transactions on Haptics Best Paper Award. He served as General Chair for Asia Haptics 2016, Program Co-Chair for Euro Haptics 2018, General Co-Chair for IEEE World Haptics Conference 2019, and Steering Committee Chair for IEEE World Haptics Conference 2021.
Throughout my academic career, I have had the privilege to work with leading companies such as Microsoft and Google, and consulted for other businesses. This exposure has provided me with unique insights that have enhanced my skills as a psychophysicist. I have gained a deep understanding of the complex and dynamic aspects of human perception. My work in the industry has taught me that conducting psychophysical experiments requires more than just technical expertise. Effective communication skills, the ability to collaborate with others, and a meticulous attention to detail are critical to successful outcomes. In this presentation, I will illustrate my industry learnings through a series of real-world examples, sharing practical insights and their impact on advancing the application of psychophysics.
Hong Z. Tan is the Keysight Professor of Electrical and Computer Engineering at Purdue University, with courtesy appointments in Mechanical Engineering and Psychological Sciences. She investigates the science and technology of displaying information through the sense of touch. She received her Bachelor’s degree in Biomedical Engineering from Shanghai Jiao Tong University and her Master and Doctorate degrees in Electrical Engineering and Computer Science from the Massachusetts Institute of Technology (MIT). Hong was a Research Scientist at the MIT Media Lab before joining Purdue University in 1998. She has held visiting positions at Oxford University, Stanford University, Shanghai Jiao Tong University, Microsoft Research Asia, Beijing Normal University, and Google. Hong was a recipient of the US National Science Foundation CAREER award and the Chinese National Natural Science Fund’s Distinguished (Overseas) Young Scholar award. She has served in various leadership roles, including co-organizer of the Haptics Symposium, founding chair of the IEEE Technical Committee on Haptics, and co-chair of the World Haptics Conference. She served two terms as an Associate Editor of the IEEE Transactions on Haptics, and was an Editor-in-Chief of the World Haptics Conference Editorial Board. Hong was elevated to IEEE Fellow in 2017 for her contributions to wearable haptics.