Digital Fabrication in Medical Practice

Maker culture in health care is on the rise with the rapid adoption of consumer-grade fabrication technologies. However, little is known about the activity and resources involved in prototyping medical devices to improve patient care. In this paper, we characterize medical making based on a qualitative study of medical stakeholder engagement in physical prototyping (making) experiences. We examine perspectives from diverse stakeholders including clinicians, engineers, administrators, and medical researchers. Through 18 semi-structured interviews with medical-makers in US and Canada, we analyze making activity in medical settings. We find that medical-makers share strategies to address risks, define labor roles, and acquire resources by adapting traditional structures or creating new infrastructures. Our findings outline how medical-makers mitigate risks for patient safety, collaborate with local and global stakeholder networks, and overcome constraints of co-location and material practices. We recommend a clinician-aided software system, partially-open repositories, and a collaborative skill-share social network to extend their strategies in support of medical making.

“Point-of-Care Manufacturing”: Maker Perspectives onDigital Fabrication in Medical Practice. Udaya Lakshmi, Megan Hofmann, Stephanie Valencia, Lauren Wilcox, Jennifer Mankoff and Rosa Arriaga. CSCW 2019. To Appear.

A venn diagram showing the domains of expertise of those we interviewed including people from hospitals, universities, non-profits, va networks, private practices, and government. We interviewed clinicians and facilitators in each of these domains and there was a great deal of overlap with participants falling into multiple categories. For example, one participant was in a VA network and in private practice, while another was at a university and also a non-profit.

Designing in the Public Square

Design in the Public Square: Supporting Cooperative Assistive Technology Design Through Public Mixed-Ability Collaboration (CSCW 2019)

Mark. S. Baldwin, Sen H Hirano, Jennifer Mankoff, Gillian Hayes

From the white cane to the smartphone, technology has been an effective tool for broadening blind and low vision participation in a sighted world. In the face of this increased participation, individuals with visual impairments remain on the periphery of most sight-first activities. In this paper, we describe a multi-month public-facing co-design engagement with an organization that supports blind and low vision outrigger paddling. Using a mixed-ability design team, we developed an inexpensive cooperative outrigger paddling system, called DEVICE, that shares control between sighted and visually impaired paddlers. The results suggest that public design, a DIY (do-it-yourself) stance, and attentiveness to shared physical experiences, represent key strategies for creating assistive technologies that support shared experiences.

A close-up of version three of the CoOP system mounted to the rudder assembly and the transmitter
used to control the rudder (right corner).
Shows 5 iterations of the CoOP system, each of which is progressively less bulky, and more integrated (the first is strapped on for example and the last is more integrated).
The design evolution of the CoOP system in order of iteration from left to right.

Observation & Reflection (due by end of quarter)

Much of this quarter will likely be spent inventing and building accessibile technology, and you may not have time to also do the sort of participatory design project that would ideally ensure that your technology fully reflects your target user. This project is your opportunity to focus on learning rather than building, observing rather than inventing. Even if you already have a disability or have worked closely with people with disabilities before, you can always learn something new from going out into the field.

Up to 3 students at a time will attend a demo/ eval events involving assistive technology. I am still gathering details for this including timing and length.

During a device demonstration, students will have the opportunity to observe one of WATAP’s assistive technology specialists provide a guided exploration of the features and options of AT devices with the purpose of helping individuals with disabilities to make informed decisions and a confident choices about what AT would meet their functional needs. Evaluations are similar, but using information including the individual’s history, skills, decision and choice, environmental considerations, etc, the specialist will provide a written recommendation on what AT should be considered for purchase. You will have an opportunity to see the process of what information and considerations are used to make these recommendations.

At the end you should write a short reflection (about 1 page) about your experience. This reflection should touch on the following topics:

  • What did you observe (what stood out to you as interesting about the space, people, and task that you engaged with? Were there things that worked particularly well? Were there breakdowns?)
  • What did you learn (did you learn something about accessible technologies? Anything that might inform your approach to research?)

The grading rubric for this assignment is as follows. Please fill it out yourself, and ask a classmate to fill out and sign it. When points are 1 or 0, this is pass fail (no nuance). When points are 0-3, use the following scale: 0 – No answer to question; 1 – Short shallow answer to question; 2 – Good answer to question; 3 – Outstanding answer to question.

Points Description Comments (by grader)
1 or 0Student attended observation
0-3Paragraph on what was observed
0-3Paragraph on what was learned

Yash Baldawa

Yash is an undergraduate student at the University of California, Berkeley. While at make4all lab, Yash worked under the mentorship of Prof. Jennifer Mankoff and Dr. Anat Caspi on the Urban Mobility project. He was responsible of recruiting participants with a diverse range of abilities, conducting contextual interviews, survey monitoring, data collection and data analysis for majority of the pool of participants. His time at the make4all lab taught him to be inclusive of the different abilities of people while designing and developing technology. Yash will be interested in taking up projects in the future that aim to develop universally accessible technologies.

Project 2: Build a Better Button

Learning Goals for the Project

  • Learn about Circuit design
  • Learn how to communicate between an Arduino and your phone
  • Build a simple circuit that is enhanced by its connection to your phone

Basic Requirements for Project

Your project should demonstrate your ability to either:

  • Take input from at least one button (or other sensor), and connect it to some interesting service
  • Your focus should be on circuit design and Arduino programming. You don’t need to create a custom phone app. You can if you want create a custom case or button using 3d printing.

You should make a case for why this is an assistive technology of some sort. For example, you could build a door opening sensor (using a button or proximity sensor) that causes your phone to announce the door was opened, or a single switch control for scrolling or tabbing through a web page, or a capacitive sensor that captures a log of how often a cane is used.

There is some great software that con be connected to the Arduino including 1Shield, AppInventor, Blynk and IFTTT. Some work only for Android, others for both Android and iPhone.

There are lots of really great examples online of arduino based projects, arduino projects that involve smartphones, and arduino projects that involve 3D printing or laser cutting. Many of them are too complex for the expectations of this project, though they might help to inspire final projects, or give you ideas for something simple you can do in a week. Here is a sample:

Hand In

Create a Thingiverse or Instructables page for your project with a brief description of the project, a video, any 3D printed files, and a schematic for your circuit. Turn the URL in by email with the subject: Project 2. Be prepared to demo your project in class.

PointsDescription
1 or 0 Project uses physical computing to solve an accessibility problem
1 or 0Project communicates with your phone in some way
1 or 0Project includes a working circuit that you designed
1 or 0Project includes at least one button
1 or 0 Project includes some kind of response to the button
1 or 0Thingiverse or Instructables page describes project in a reproducable fashion.

The Future of Access Technologies

Sieg 322, M/W 9-10:20

How can physical computing enable new solutions to accessibility, including both access to the world and access to computers? Similarly, how can a disability studies perspective guide us in developing empowering and relevant solutions to accessibility problems? This course explores both of those questions through a combination of discussions, reading, and building.

Access technology (AT) has the potential to increase autonomy, and improve millions of people’s ability to live independently. This potential is currently under-realized because the expertise needed to create the right AT is in short supply and the custom nature of AT makes it difficult to deliver inexpensively. Yet computers’ flexibility and exponentially increasing power have revolutionized and democratized access technologies. In addition, by studying access technology, we can gain valuable insights into the future of all user interface technology.

In this course we will focus on two primary domains for access technologies: Access to the world (first half of the class) and Access to computers (second half of class). Students will start the course by learning some basic physical computing capabilities so that they have the tools to build novel access technologies. We will focus on creating AT using sensors and actuators that can be controlled/sensed with a mobile device. The largest project in the class will be an open ended opportunity to explore access technology in more depth. 

Class will meet 9-10:20 M/W

Class Syllabus

Private Class Canvas Website

Tentative Schedule

Week 1 (9/25 ONLY): Introduction

Week 2 (10/2 ONLY): Introduction

Week 3  (10/7; 10/9): 3D Printing & Laser Cutting

Week 4 (10/14; 10/16): Physical Computing

In class: Connect simple LED circuit to a phone

Pair Project: Build a Better Button (Demo 10/30; webpage due 11/1)

Week 5 (10/21; 10/23): Finishing Arduino; Disability Studies

  • Disability Studies reading due: Pick ONE only to read. Hopefully among us we will cover a range of them. We’ll compare and contrast.
  • Open work time on Arduino projects

Week 6 (10/28; 10/30): Disability Studies; Input [Tentative]

  • Discussion of Arduino Projects
  • Starting on Input
    • Characterizing the performance of input devices (‘Design space of input devices’)
    • Digital techniques for adapting to user input capabilities (e.g. voice control, eye gaze)
    • Novel interaction techniques (e.g. mobile phone interaction, at the time)
    • Passive sensing and other real world input challenges
  • Reading 1: Slide Rule
  • Reading 2: The Design Space of Input Devices

Week 7 (11/4; 11/6): Output

Week 8 (11/13 ONLY): Applications

Week 9 (11/18; 11/20): The Web

Learn about “The Web,” how access technologies interact with the Web, and how to make accessible web pages.

WebAim.org — WebAIM has long been a leader in providing information and tutorials on making the Web accessible. A great source where you can read about accessibility issues, making content accessible, etc. Run it on your website or web page and look at the results before class.

Reading 1: Google Video on Practical Web Accessibility — this video provides a great overview of the Web and how to make web content accessible. Highly recommended as a supplement to what we will cover in class.

Optional Reading: If you want to supplement the reading with written guidance, check out WebAim.org Introduction to Web Accessibility, specifically the section titled ‘Principles of Accessible Design’ (which has links to how to properly write alt text; appropriate document structure, and so on).

Reading 2: What’s the problem?

Discussion: How can we make the web accessible when individual authors don’t? Also how can we improve web authoring?

Assignment: Assess a Web Page. In class, we will also make it more accessible. Please come prepared on 11/18.

Week 10 (11/25; 11/27):  Screen Readers (AKA Bigham (plus a few others) week 🙂

Week 10 (12/2; 12/4):  Working with Cognitive Impairment

Finals Week

Final Project Presentations will take place from 8:30-10:20 on Wednesday of finals week.

Final project presentations

Clench Interaction: Biting As Input

Shows human faced diagraming where the clench sensor should be placed between the teeth; the settings for correctly sensing clench, and the hardware platform used.
Xuhai Xu, Chun Yu, Anind K. Dey, Jennifer Mankoff
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19)
People eat every day and biting is one of the most fundamental and natural actions that they perform on a daily basis. Existing work has explored tooth click location and jaw movement as input techniques, however clenching has the potential to add control to this input channel. We propose clench interaction that leverages clenching as an actively controlled physiological signal that can facilitate interactions. We conducted a user study to investigate users’ ability to control their clench force. We found that users can easily discriminate three force levels, and that they can quickly confirm actions by unclenching (quick release). We developed a design space for clench interaction based on the results and investigated the usability of the clench interface. Participants preferred the clench over baselines and indicated a willingness to use clench-based interactions. This novel technique can provide an additional input method in cases where users’ eyes or hands are busy, augment immersive experiences such as virtual/augmented reality, and assist individuals with disabilities.

Who Gets to Future?

Picture of potted plants and a bench with the word Africatown in the background, painted in bright red and green colors

Who Gets to Future? Race, Representation, and Design Methods in Africatown

Jasper Tran O’Leary, Sara Zewde, Jennifer Mankoff , Daniela K. Rosner
CHI 2019

This paper draws on a collaborative project called the Africatown Activation to examine the role design practices play in contributing to (or conspiring against) the flourishing of the Black community in Seattle, Washington. Specifically, we describe the efforts of a community group called Africatown to design and build an installation that counters decades of disinvestment and ongoing displacement in the historically Black Central Area neighborhood. Our analysis suggests that despite efforts to include community, conventional design practices may perpetuate forms of institutional racism: enabling activities of community engagement that may further legitimate racialized forms of displacement. We discuss how focusing on amplifying the legacies of imagination already at work may help us move beyond a simple reading of design as the solution to systemic forms of oppression.

“Occupational Therapy is Making”

Web Accessibility

This course was originally an introduction to accessibility centered on web in particular for graduate and undergraduate student. Jeff Bigham and I co-created it and he has since expanded it and taught it multiple times.  The current iteration can be found at: http://www.accessibilitycourse.com/

Jeff Bigham’s new framing is wonderful inspiration for future accessibility courses. To quote his website:

Access technologists are the ultimate interface hackers. They take existing technology and make it work for people and situations for which it wasn’t designed — they transform visual interfaces into landscapes of sound and touch, they overlay interfaces that people with low dexterity can use on top of interfaces requiring fine motor control, and they turn speech and sound into visual displays. This course teaches how access technology is built to work within the tough technical and human constraints in which it must operate. As early adopters, people with disabilities have inspired a host of future user interface technologies, e.g., conversational assistants, text-to-speech, speech recognition, optical character recognition, predictive typing, tactile displays, etc. People with disabilities continue to be the first users of interface next-generation technologies that are gradually adopted widely. This course will not only teach you the deep inner workings of today’s user interface technology, but will also serve as a guide for building the user interfaces of the future.