Tactile Interfaces to Appliances

Anhong Guo, Jeeeun Kim, Xiang ‘Anthony’ Chen, Tom Yeh, Scott E. Hudson, Jennifer Mankoff, & Jeffrey P. Bigham, Facade: Auto-generating Tactile Interfaces to Appliances, In Proceedings of the 35th Annual ACM Conference on Human Factors in Computing Systems (CHI’17), Denver, CO (To appear)

Common appliances have shifted toward flat interface panels, making them inaccessible to blind people. Although blind people can label appliances with Braille stickers, doing so generally requires sighted assistance to identify the original functions and apply the labels. We introduce Facade – a crowdsourced fabrication pipeline to help blind people independently make physical interfaces accessible by adding a 3D printed augmentation of tactile buttons overlaying the original panel. Facade users capture a photo of the appliance with a readily available fiducial marker (a dollar bill) for recovering size information. This image is sent to multiple crowd workers, who work in parallel to quickly label and describe elements of the interface. Facade then generates a 3D model for a layer of tactile and pressable buttons that fits over the original controls. Finally, a home 3D printer or commercial service fabricates the layer, which is then aligned and attached to the interface by the blind person. We demonstrate the viability of Facade in a study with 11 blind participants.

5792511475098337672(1)

Printable Adaptations

Reprise: A Design Tool for Specifying, Generating, and Customizing 3D Printable Adaptations on Everyday Objects

Reprise is a tool for creating custom adaptive 3D printable designs for making it easier to manipulate everything from tools to zipper pulls. Reprise’s library is based on a survey of about 3,000 assistive technology and life hacks drawn from textbooks on the topic as well as Thingiverse. Using Reprise, it is possible to specify a type of action (such as grasp or pull), indicate the direction of action on a 3D model of the object being adapted, parameterize the action in a simple GUI, specify an attachment method, and produce a 3D model that is ready to print.

Xiang ‘Anthony’ Chen, Jeeeun Kim, Jennifer Mankoff, Tovi Grossman, Stelian Coros, Scott Hudson (2016). Reprise: A Design Tool for Specifying, Generating, and Customizing 3D Printable Adaptations on Everyday Objects. Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology (UIST 2016) (pdf)

This slideshow requires JavaScript.

Helping Hands

Prosthetic limbs and assistive technology (AT) require customization and modification over time to effectively meet the needs of end users. Yet, this process is typically costly and, as a result, abandonment rates are very high. Rapid prototyping technologies such as 3D printing have begun to alleviate this issue by making it possible to inexpensively, and iteratively create general AT designs and prosthetics. However for effective use, technology must be applied using design methods that support physical rapid prototyping and can accommodate the unique needs of a specific user. While most research has focused on the tools for creating fitted assistive devices, we focus on the requirements of a design process that engages the user and designer in the rapid iterative prototyping of prosthetic devices.

We present a case study of three participants with upper-limb amputations working with researchers to design prosthetic devices for specific tasks. Kevin wanted to play the cello, Ellen wanted to ride a hand-cycle (a bicycle for people with lower limb mobility impairments), and Bret wanted to use a table knife. Our goal was to identify requirements for a design process that can engage the assistive technology user in rapidly prototyping assistive devices that fill needs not easily met by traditional assistive technology. Our study made use of 3D printing and other playful and practical prototyping materials. We discuss materials that support on-the-spot design and iteration, dimensions along which in-person iteration is most important (such as length and angle) and the value of a supportive social network for users who prototype their own assistive technology. From these findings we argue for the importance of extensions in supporting modularity, community engagement, and relatable prototyping materials in the iterative design of prosthetics

Prosthetic limbs and assistive technology (AT) require customization and modification over time to effectively meet the needs of end users. Yet, this process is typically costly and, as a result, abandonment rates are very high. Rapid prototyping technologies such as 3D printing have begun to alleviate this issue by making it possible to inexpensively, and iteratively create general AT designs and prosthetics. However for effective use, technology must be applied using design methods that support physical rapid prototyping and can accommodate the unique needs of a specific user. While most research has focused on the tools for creating fitted assistive devices, we focus on the requirements of a design process that engages the user and designer in the rapid iterative prototyping of prosthetic devices.

We present a case study of three participants with upper-limb amputations working with researchers to design prosthetic devices for specific tasks. Kevin wanted to play the cello, Ellen wanted to ride a hand-cycle (a bicycle for people with lower limb mobility impairments), and Bret wanted to use a table knife. Our goal was to identify requirements for a design process that can engage the assistive technology user in rapidly prototyping assistive devices that fill needs not easily met by traditional assistive technology. Our study made use of 3D printing and other playful and practical prototyping materials. We discuss materials that support on-the-spot design and iteration, dimensions along which in-person iteration is most important (such as length and angle) and the value of a supportive social network for users who prototype their own assistive technology. From these findings we argue for the importance of extensions in supporting modularity, community engagement, and relatable prototyping materials in the iterative design of prosthetics

Photos

Project Files

https://www.thingiverse.com/thing:2365703

Project Publications

Helping Hands: Requirements for a Prototyping Methodology for Upper-limb Prosthetics Users

Reference:

Megan Kelly Hofmann, Jeffery Harris, Scott E Hudson, Jennifer Mankoff. 2016.Helping Hands: Requirements for a Prototyping Methodology for Upper-limb Prosthetics Users. InProceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 525-534.

Making Connections: Modular 3D Printing for Designing Assistive Attachments to Prosthetic Devices

Reference:

Megan Kelly Hofmann. 2015. Making Connections: Modular 3D Printing for Designing Assistive Attachments to Prosthetic Devices. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS ’15). ACM, New York, NY, USA, 353-354. DOI=http://dx.doi.org/10.1145/2700648.2811323

Supporting Navigation in the Wild for the Blind

uncovering_thumbnailSighted individuals often develop significant knowledge about their environment through what they can visually observe. In contrast, individuals who are visually impaired mostly acquire such knowledge about their environment through information that is explicitly related to them. Our work examines the practices that visually impaired individuals use to learn about their environments and the associated challenges. In the first of our two studies, we uncover four types of information needed to master and navigate the environment. We detail how individuals’ context impacts their ability to learn this information, and outline requirements for independent spatial learning. In a second study, we explore how individuals learn about places and activities in their environment. Our findings show that users not only learn information to satisfy their immediate needs, but also to enable future opportunities – something existing technologies do not fully support. From these findings, we discuss future research and design opportunities to assist the visually impaired in independent spatial learning.

Uncovering information needs for independent spatial learning for users who are visually impaired. Nikola Banovic, Rachel L. Franz, Khai N. Truong, Jennifer Mankoff, and Anind K. DeyIn Proceedings of the 15th international ACM SIGACCESS conference on Computers and accessibility (ASSETS ’13). ACM, New York, NY, USA, Article 24, 8 pages. (pdf)

3D Printed Prosthetics: Case Study

Readings

  • Megan Hofmann, Julie Burke, Jon Pearlman, Goeran Fiedler, Andrea Hess, Jon Schull, Scott E. Hudson, Jennifer Mankoff: Clinical and Maker Perspectives on the Design of Assistive Technology with Rapid Prototyping Technologies. ASSETS 2016: 251-256
  • Cynthia L. Bennett, Keting Cen, Katherine Muterspaugh Steele, Daniela K. Rosner: An Intimate Laboratory?: Prostheses as a Tool for Experimenting with Identity and Normalcy. CHI 2016: 1745-1756

Optional: 

  • Jeremiah Parry-Hill, Patrick C. Shih, Jennifer Mankoff, Daniel Ashbrook: Understanding Volunteer AT Fabricators: Opportunities and Challenges in DIY-AT for Others in e-NABLE. CHI 2017: 6184-6194

 

Disability Studies and Accessible Technology Creation

Jennifer Mankoff, Gillian R. HayesDevva Kasnitz:
Disability studies as a source of critical inquiry for the field of assistive technology. ASSETS 2010: 3-10

Disability studies and assistive technology are two related fields that have long shared common goals–understanding the experience of disability and identifying and addressing relevant issues. Despite these common goals, there are some important differences in what professionals in these fields consider problems, perhaps related to the lack of connection between the fields. To help bridge this gap, we review some of the key literature in disability studies. We present case studies of two research projects in assistive technology and discuss how the field of disability studies influenced that work, led us to identify new or different problems relevant to the field of assistive technology, and helped us to think in new ways about the research process and its impact on the experiences of individuals who live with disability. We also discuss how the field of disability studies has influenced our teaching and highlight some of the key publications and publication venues from which our community may want to draw more deeply in the future.