Reflections on Deafhood and A11yhood

During my sabbatical, one of my goals has been to start learning ASL. As I mentioned in a prior post, this effort was briefly accelerated by the loss of my voice in November, but I have continued to take ASL classes well past that experience and am now a student in ASL 103. In addition to the language, these classes have introduced aspects of d/Deaf culture I was not previously aware of. One concept in particular, Deafhood, and its parallels to modern disability justice and culture, really resonates with me.

Deafhood is a reaction to the historical trauma and oppression of d/Deaf people and community that became particularly acute during the mid to late 1800s when Oralism began to forcibly replace sign language education around the world, something that would continue for about a century (Ladd, 2003; Murray & Greenwald, 2010). Hereditary deafness combined with acceptance, culture, and language, unimpeded, had the potential to nurture strong, integrated, and positive communities such as found in Martha’s Vineyard (Groce, 1985). Yet the Oralist movement tore this apart.

In this same time period, the “science” of eugenics came to the fore in America, fed both by prejudice and advances in scientific understanding, led by scientists such as Mendel and Darwin (Nielsen, 2012). These beliefs were used as a basis for excluding immigrants (and fed into racial bias and stereotyping) (Nielsen, 2012), including d/Deaf immigrants, but their impact on Americans with disabilities was even more profound. Forced sterilization, institutionalization, experimentation and murder became “acceptable” practices imposed on people with disabilities (Nielsen, 2012; Sheffer, 2018).

For d/Deaf people and communities, a twist of fate may have provided some protection from the worst of the eugenics movement: Alexander Graham Bell, whose mother and wife were deaf, was an influential participant in the eugenics movement. Although an advocate for Oralism and eugenics both, perhaps because of his personal relationships, he argued against “negative” eugenics (meaning forced sterilization, institutionalization and worse) for d/Deaf people, and instead developed a policy centered on “positive” eugenics — breaking the genetic line, so to speak, by discouraging intermarriage (Greenwald, 2009). Although he may have provided some protection, Deafness was certainly still mentioned in forced sterilization laws across the country, and eugenics of any sort, combined with Oralism, extremely harmful to d/Deaf people and community.

Intellectual capability, and the ability to support oneself financially, were both reasons given for the eugenics movement — essentially that people with disabilities were somehow harming society/non-disabled people by being less intelligent, and independent, than their counterparts (all false assumptions). Ironically, d/Deaf people in Martha’s Vineyard had above average income (Groce, 1985, p. 50), something Oralism (with its negative impacts on education), and lack of community, could only hurt.  Although Oralism was no longer the only option by the time Paddy Ladd began his 2003 ethnography, “Understanding deaf culture”, the legacy of this history of colonization and oppression remains today. Further, one might argue that it is now codified in the medicalization of “treatment” for deafness, i.e. the focus of medical professionals counseling families with deaf children to use cochlear implants, a technology literally designed to improve the effectiveness of oralism, over ASL (Kite, 2020). 

Ladd’s ethnography, in which he coins the term Deafhood, is a theory of culture grounded in the Deaf experiences of identity, language, and society. Ladd, and by extension Ladd’s definition of Deafhood, recognizes that identity is a process. As described in the definition on deafhood.org, “Deafhood as a journey that a Deaf person undertakes to discover his, her or their identity and purpose in life.” This journey is not an isolated, individual experience but rather a reframing, and recreation of a rich, linguistic, humanistic culture which is also engaged in a radical act of self definition. 

I see many parallels between Deafhood and other cultures that have arisen from the ashes of erasure and oppression. As the comedian Hannah Gadsby remarks in her show Nanette, in describing her experience of oppression as a child, 

When you soak a child in shame, they cannot develop the neurological pathways that carry thought… you know, carry thoughts of self-worth. They can’t do that. Self-hatred is only ever a seed planted from outside in. But when you do that to a child, it becomes a weed so thick, and it grows so fast, the child doesn’t know any different. It becomes… as natural as gravity.”

Similarly, questions about self worth are deeply influenced by our cultural and individual historical treatment of disability, particularly in Western culture during the industrial revolution and beyond. Disability is not only a minority identity that through eugenics and other means was hidden and erased, but even worse, disability was the justification for erasing, enslaving, and institutionalizing people from many other minoritized identities (Nielsen, 2012). Even the Deaf community tried to distance it from disability due to disability’s stigma (Nielsen, 2012, p. 136). The legacy of these attitudes and policies remains today, with the prison population, for example, having a much higher rate of disability than average, and disability feeding into the school to prison pipeline (Mahon-Reynolds & Parker, 2016). 

Although it lacks a literal common language, or a name, I would argue that similar to Deafhood, there is a movement toward a disability cultural identity connected to the disability justice movement, what I chose to call A11yhood in the title to this post. As Neil Marcus writes in his poem, “Disabled Country”, “If there was a country called disabled / I would be from there / … / In my life’s journey / I am making myself / At home in my country” This journey is based in shared experience, as highlighted in the movie Crip Camp. It is also political in nature — one might argue that modern disability culture is rooted in activism, which began at least as early as 1935 (Nielsen, 2012, p. 133) and continues today.  The rise of the independent living movement created cultural centers for people with disabilities in many cities, further strengthening this change. Today, disability culture plays out on social media, with strong voices such as Alice Wong (Wong, 2020) and Imani Barbarin, as well as collectives such as Sins Invalid (Berne, 2018) leading the way. 

Similar to Deafhood, I have observed the journey implicit in a modern disability justice identity in my own journey into acceptance and power as a disabled woman; and in the transformation a disability identity has provided to the multiple people I have offered it to as an explanatory frame for their disability experience. I have seen the power of this, particularly in settings that integrate community and support, as well as activism and advocacy. Each of us must learn about our identity, and purpose, and power, as disabled people. We must learn the vocabulary of community, of oppression and of activism. We must learn A11yhood.

References

Ladd, P. (2003). Understanding deaf culture. In Understanding Deaf Culture. Multilingual Matters.

Murray, J. J., & Greenwald, B. H. (2010) How the Past Informs the Present: Intersections of Deaf History with Deaf Studies. Deaf Studies Today! (Volume 4)

Nielsen, K. E. (2012). A disability history of the United States (Vol. 2). Beacon Press.

Sheffer, E. (2018). Asperger’s children: The origins of autism in Nazi Vienna. WW Norton & Company.

Greenwald, B. H. (2009). The real “toll” of AG Bell: Lessons about eugenics. Sign Language Studies, 9(3), 258-265.

Groce, N. E. (1985). Everyone here spoke sign language: Hereditary deafness on Martha’s Vineyard. Harvard University Press.

Kite, B. J. (2020). How the medical professionals impact ASL and English families’ language planning policy. Psychology in the Schools, 57(3), 402-417.

Mahon-Reynolds, C., & Parker, L. (2016). The overrepresentation of students of color with learning disabilities. DisCrit—Disability studies and critical race theory in education, 145.

Nicole Newnham and James LeBrecht. Prod. (2020) Crip Camp: A Disability Revolution. Dir. by Good Gravy Films and Higher Ground Productions,. 108 mins. (https://cripcamp.com)

Wong, A. (Ed.). (2020). Disability visibility: First-person stories from the twenty-first century. Vintage.

Berne, P., Morales, A. L., Langstaff, D., & Invalid, S. (2018). Ten principles of disability justice. WSQ: Women’s Studies Quarterly, 46(1), 227-230.

CHI Trip Report: Comparing Remote, Hybrid and In Person

I was one of those who asked for CHI to be fully remote. I intended to attend remotely. Due to my disability travel is difficult and attending the entire conference would not have been worth the cost physically. Additionally, I face higher personal and family risk with COVID; and caregiving responsibilities at home.

However, when I received the Social Impact award, I decided it was important to attend in person to make the most of the opportunity this represented to talk about social impact. I decided to avoid indoor meals if possible and limit overall exposure; did not attend any evening parties; attended most of the conference remotely even when I was in New Orleans and tried to socialize outside when possible (it was too warm some of the time).

I truly embraced the hybrid model for CHI as a result (and am very grateful to the organizers for working hard to make both virtual and in-person attendance possible). I spent Tuesday and Wednesday morning in person; the awards dinner in person; and everything else online, including some synchronous programming Wednesday afternoon and Thursday morning and many hours watching talks asynchronously on Thursday and Friday. So far, I am still negative, but given recent events I attribute that as much to luck as my choices about what to attend.

It’s worth noting that others have already written excellent articles on this topic, including Michael Correll’s very thoughtful much more holistic commentary on the future of academic conferences; and Amy Ko’s detailed experiential trip report from CHI 2021, I encourage you to check those out as well if interested in this topic.

Workshops

I attended two workshops. Both were at their heart about inclusion, and both worked hard to explore inclusion from multiple perspectives. One was focused on disability, the other on making. My main take away is the breadth of both of these communities and gratitude for my chance to get to know about researchers who I wasn’t aware of in both. I think workshops are particularly critical to networking in the era of remote participation because of the ways in which they bring people together with shared interests. Slack supported networking at both.

At the hybrid workshop we found ourselves in a “lunch break” with no virtual equivalent, we explicitly had a conversation about networking and what people were hoping to achieve. The sharing in this conversation was vulnerable and moving and highlighted how important it is to consciously make space for networking time when remote.

Virtual Only Events

My longest synchronous virtual-only segments were Wednesday after about 10:30am and all day Thursday. I attended from my hotel room. The town hall worked great virtually, as did the social justice event I attended, but being in person just before them highlighted how “dry” such events are in terms of interpersonal connection. I also struggle with remote question asking because it is so hard to change the contents of a question between when you ask it and it is read aloud (context can change in the interim).

One of the least dry/favorite events I attended was on data and design, where the session started out with an interactive multi-step Miro board activity. This is a screenshot showing a gestalt view of the thoughtful planning that went into this (names occluded for privacy). Over the course of an hour we worked our way through a combination of activities on this Miro board and breakout rooms.

A picture of a miro board. There is too much to visually process at detail, but it's clear that there are at least 3 sections to this, each with multiple activities within (reflected in multiple colored areas with labeled circles for putting badges into and responding within.
The Miro Board from the Data and Design SIG on Tuesday Morning

One unique aspect of having traveled to New Orleans was the “physicality” of the virtual experience. In one extreme example, I accidentally left my phone in the NOLA sun by mistake when attending a session from my hotel’s roof deck, and my network connection went down due to the phone overheating! I could not reconnect until I wet it down and blew on it. It didn’t affect much as I just increased the speed of the livestream until I caught up. Overall, though, being in my hotel room, ordering local food, having the chance to connect with a friend 1:1 in between things, and having the time to center the conference, all made the experience much better than any prior virtual experience.

I also spent many hours on what I might term “asynchronous virtual events” on Thursday and Friday. I watched live sessions (such as award talks) that I had missed, and watched, coded and wrote up all of the relevant talks that I had missed during the week (such as Monday when I was traveling, or during parallel sessions). Whenever I watched a talk that I had a question about, I made an effort to email the first and last author with my question and a compliment, just as I might have approached them after the session. I am still answering emails about this three days later, and have even been offered collaboration opportunities. This effort has been significant, and included a sort of qualitative coding to do my trip report. I don’t usually take the time to synthesize a conference like this, and at CHI’s current size in terms of the variety of papers I could select from, I found it an incredibly relevant and fruitful experience.

Hybrid Events

My first hybrid session (I was in person) was an interesting opportunity to see some of the unique challenges to hybrid sessions, from a missing session chair (turns out they were virtual) to no presenter (the talk is recorded after all) to unclear understanding of the backup plan if delay becomes an issue. I participated in a hybrid session remotely twice (including one of my workshops) and experienced some awkwardness in not knowing when I was expected/able to speak up as a virtual attendee.

Overall, though, I experienced something very similar to what others have said to me: being virtual, or hybrid, feels like a whole different conference than in person. You, and other remote people, are in your own social space even if you are looking at the same talks as in-person people.

Lesson Learned

I have several takeaways from this mix of experiences. Networking is better in person (no surprise) but I think that can be improved by going out of ones way to send emails and/or discord/slack messages to folks about their work (just as you might approach them on stage after a talk); and by creating synchronous and asynchronous opportunities to connect about goals and networking needs. Community building needs more attention, especially longitudinally. Visibility requires explicit attention for remote presenters. And Redundancy is critical to an accessible and reliable experience. Finally, Synthesis helped bring CHI together for me. I enjoyed most of CHI’s content remotely (see the other half of my trip report for more on that) — and more than any recent virtual experience: the trip was a lesson in the value of truly creating space for conferencing, even when remote.

Networking

Networking is one of the aspects of in-person conferencing that translates worst to virtual. However, my experiences this week showed me that with a concrete plan in place, it is possible to do much better even in virtual/hybrid settings. I also learned from how diverse networking needs are and that I definitely am glad I asked what folks were looking for.

I think asking about networking needs more often, and earlier, could better guide networking planning. Much more structure for this is needed than in person (though one might argue that even in person structure helps folks who are more marginalized within the community). For example, my best virtual networking experience last year was at an event that was clearly labeled in terms of purpose, and thus drew people who could support that purpose and/or sought it. It is possible to create small intimate gatherings even online, and we should try to find more opportunities to do so.

I also found myself regretting not planning ahead more. Several of us were in Seattle during one of my workshops — we could have made the effort to all be in the same room. I hope we can experiment more with such models for the next (small) conference I attend virtually. I think smaller conferences (workshops may be too small to have much co-location?) are the easier place to start with such efforts.

A word of advice to students: It really helps to have a web page of your own that describes your interests and highlights the most relevant work you do. One advantage of virtual networking is that I could google everyone I came in contact with to find common interests. Yet many of the people I googled only had a linked in page. You can use off the shelf blogging platforms for free to make a website and still have a nice look and feel (I use WordPress for my group, for example, and some of my students use their page on my site, while others have their own websites).

Building Lasting Communities.

I am by no means an expert on community building (for that, see Kraut & Resnick) However, one thing that occurs to me is that we can be more strategic about building virtual networks that last, and we especially need to do that in this era. For example, there is already a slack for the maker community in HCI++. Why not have a fabrication-related workshop invite people into a channel in that space rather than an entirely new slack that is likely to be shut down or die off shortly after the conference ends? I have the same thoughts about the CHI 22 specific discord. Are we doing these things to gatekeep access, and what do we gain (and lose) from those choices? How can we better ensure that people know about, and build on, existing virtual communities?

Visibility

An important loss for remote presenters in particular is the visibility of giving a talk to a bunch of like minded folks and then engaging with them right afterwords. I’m not sure how to solve all of that, but I think small things help, like making sure that your face is visible throughout your recorded talk. I gained a lot from taking the time to send an email to a student or their advisor when I saw a talk I loved, this feedback is missing for many online presenters, and also resulted in conversations that were valuable to me.

Relatedly, I think that recorded talks create new opportunities for visibility (what Michael Correll calls history). I would love to see more of this freedom of access. For example, it would be interesting to consider a new model that allows more people to participate in workshops than submit position papers — more like a SIG model — so more people can benefit from the networking opportunity of even just knowing about each other. I understand that submitting something is an important way of showing interest, and I think this requires more thought, but I believe there are ways to work through these challenges (for example who presents versus who attends).

Redundancy

When technology failed, having redundant forms of access was really helpful. Discord & Hubb complemented each other; as did Zoom and Youtube. This was a prescient choice by the organizers as it was needed multiple times over. It also contributes to overall accessibility.

One area of redundancy that I only partly engaged with was timing. Being able to attend things asynchronously is part of this, but I had the advantage of always being in a time zone that worked for synchronous participation if I wanted / was healthy enough for it. I would love to see more of the multiple touchpoints that CHI introduced in 2021 in the future, to add networking redundancy to the existing emphasis on content redundancy.

Synthesis

CHI is a firehose, and it’s easy to be overwhelmed. Even more so when working from home and just “sampling” parts of CHI now and then. By traveling and/or canceling other activities (I did both), I was able to get much more out of the conference. Watching things I had missed, and synthesizing what I learned, really helped me to take lasting value from the non-networking aspects of it. It also helped with networking, as I connected with people by email, and even introduced my students to authors (by email) and content (by sending students links of interest).

Final Thoughts

In the end, was it worth attending in person? I absolutely benefited from the time away and the networking opportunities. Depending on whether I test positive, the scales may tip the other way, though. Even if I do not get COVID, my body has required 2 full days of rest after the travel home to be semi-functional today (3 days after my flight). This is a cost I can afford to bear on a sabbatical year, but it becomes increasingly less appealing as my career matures.

Regardless, my belief that CHI should not have been in person stands firm. My opposition to an in-person CHI was never about my personal gain, it was about equity for all of the people who would like to attend, and the risk to attendees. Both of those continue to be concerns. Particularly so if we move away from innovations that convey the benefits of in-person conferencing for remote attendees. I fear that the extra effort necessary to create an equitable experience online, due to current state of our technology and knowledge about how to effectively support remote networking, will suppress innovation in this space when it already takes so much out of those organizing events.

My best hope is that the experience of attending in person can be of value in guiding us toward a better future. I believe that the future must include virtual only events that center community and connection. I also see room for innovation. I’ll end with some questions and ideas rather than answers. Answers will only come with time.

What if every journal paper was released with the same 8 minute videos as CHI talks? Could we organize safe regional in-person networking events that coincide with conferences? Could we form a truly active discord community that featured topical office hours and networking events similar to the equity talks the EC organized in structure, advertising, and participation? How could SIGCHI benefit from and foster community around speaker series such as the Future of Work conversations and the Web Series on Computational Fabrication? Could the SIGCHI EC financially sponsor young faculty invested in and in need of innovation in this space, to do experiments this year in ways that would meaningfully create space for them to organize and try out satellite and networking events? Will the CHI SC commit now to adding a virtual conference to their sequence, as an experiment if not as a promised ongoing event?

CHI Trip Report: Visualization, Fabrication and Accessibility

I regularly take notes when I attend a conference, and especially when attending for the first time after several years I have the sense that there is so much to absorb and enjoy! I have been much less consistent about doing this in a public way, but this year I’m particularly trying to do so for the sake of the many people who can’t attend in person or at all; as well as all of us who can only go to one session when so many are worth attending!

It would be a very long blog post if I summarized all of the great accessibility work, as that is an increasingly large subset of CHI work. I’ll focus on things relevant to areas that are of growing importance to me — visualization and fabrication, along with a brief section on some accessibility highlights. To learn more about the experience of attending remotely versus in person, see my other trip report.

Visualization Sessions

I attempted to attend a mix of paper sessions and other conversations around data and accessibility. In the SIG on “Data as Human Centered Design Material” I had a number of interesting conversations. I spoke with Alex Bowyer who looks at personal data use. One important use of data he mentioned to “create evidence.” Interesting to think about “data for activism” in this context. Another interesting conversation from that SIG centered on how to summarize complex data for retrospective interviews, and accessibility concerns here. Another challenge is how to design apps that use data effectively in the field/live use, again accessibility concerns arise. Further, how do you properly generalize machine learning and visualizations? How do you improve start up, and scale well? How do you support customization of both visualizations and machine learning?

The session on accessible visualization was my next dip into visualization. The first talk talked about audio data narratives for BLV users. Their study highlighted how audio narrative could help to highlight features that might be hard to hear otherwise through strategies like foreshadowing breaking up the basic sonification. The second talk was on 1dof haptic techniques for graph understanding, for BLV users. The authors explored the value of static 3D printed and haptic moveable cues for helping with graph understanding tasks such as comparison. An interesting technique, though sonification also held its own in their data. An interesting question to me is whether a dynamic chart with a piece of flexible material over it (to “smooth” the line) would be better than the slider in terms of the experience — similar to the 3D printed chart, but dynamic. Next, a retroactive fix for a range of charts inaccessible to screen reader users was presented in VoxLens. The authors highlighted the state of online visualization today (which is truly terrible) and then provide a real solution to this problem. The solution combines sonification, high level summaries, and NLP based queries, all automatically supported given simple configuration in JavaScript about axes and a pointer to the chart object. It would be interesting to see them take advantage of ideas from a related paper on proactive visualization exploration support agents in this work. The next presentation focused on improving color patterns to address color vision deficiency. The final paper in the session focused on infographic accessibility.

Some additional papers also looked at accessibility. Joyner et al looked at visualization accessibility in the wild. They analyzed visualizations and surveyed and interviewed practitioners and found the vast majority were accessibility novices; 30-40% did not think it was their job and 71% could think of reasons to eliminate accessibility features even though the acknowledged accessibility was important. They also highlight some difficulties in creating accessible visualizations, such uncertainty in what and how to do (such as how to deal with filters), as well as lack of organization support and lack of tool support. “ComputableViz” support composition such as union, difference, and intersection. They discuss the potential for this approach to make a visualization more cognitively accessible. The intermediate representation used in this work is a relational database derived from the vega-lite specification — I think this has great potential for other accessibility applications including better description; change monitoring; end-user authoring of sonifications; and more. Finally, MyMove is a new method for collecting activity data from older adults.

Two studies made use of simulation. I call them out because of their thoughtfulness in doing so — simulation can have negative impacts and is usually not an appropriate substitute for working with people with disabilities. One study modified visualizations to simulate color deficiency on published visualizations and then crowdsourced large scale data about their accessibility. I think this is a reasonable application of that technique for two reasons: (1) the benefits of data at this scale are high and (2) the specific disability and task structure are unlikely to create bias either in the study data or in the participants (i.e. negatively influence their opinion of disability). Another good example of a study which used hearing people instead of DHH people was ProtoSound. This allowed them to collect data about the accuracy of non-speech sound recognition by their system. However they made use of DHH input throughout the design process.

I also want to highlight research that I though had interesting applications here that were not accessibility papers: “Data Every Day” was interesting because of its emphasis on personalized data tracking, including customization, data entry and authorship, both things that are under-explored in accessible visualization research. “Cicero” allows specification of transformations to visualizations declaratively — thus making visualization changes computationally available which creates many interesting opportunities. “CrossData” is an NLP interface to a data table which provides a fascinating model for authorship and exploration of data. Although the authors didn’t mention this, I think this could be a great way to author alt text for charts. “Diff In The Loop” highlights the ways that data changes during data science programming tasks as code changes. The authors explored a variety of ways to represent this– all visual– but highlights why change understanding is so important. It also raises issues such as what time scale to show changes over which would be relevant to any responsive visualization interaction task as well. Fan et al’s work (VADER lab) on addressing deception made me wonder whether accessible charts (and which chart accessibility techniques) can perform well on visual literacy tests. Cambo & Gergle’sq paper on model positionality and computational reflexivity has immediate implications for disability, and particularly highlights the importance of not only whether disability data is even collected but also things like who annotates such data. Finally, Metaphorical Visualizations translates graph data into arbitrary metaphorical spaces. Although the authors focus on visual metaphors, this could be valuable for audio as well.

There were several tangible visualizations, again relevant to but not targeting accessibility. Shape changing displays for sound zones; STRAIDE used interactive objects mounted on strings that could be actuated to move vertically in space over a large (apparently 4ft or so) range of heights to support rapid prototyping of moveable physical displays. Sauvé et al studied how people physicalize and label data. They explored the relation between type and location of labels, which may have implications for intuitive design of nonvisual physical charts. Making Data Tangible is an important survey paper that explores cross-disciplinary considerations in data physicalization.

Finally, a look at applications, and here we see a mix including some accessibility focused papers. CollabAlly, can represent collaboration activities within a document, and provided an interesting synergy with the earlier talk this same week, Co11ab that provided realtime audio signals about collaborators. This dive into what makes tables inaccessible suggests concrete viable solutions (and check out some other interesting work by this team). Graphiti demonstrated a thoughtfully designed approach to interacting with graph data extracted dynamically with computer vision, a complex and intricate exploratory visualization task. Xiaojun Ma and her students created a system for communicating about data analysis by automatically producing presentation slides from a Jupyter notebook. Working jointly and iteratively with automation and a machine, from a source notebook, could make it easier to make those slides accessible. ImageExplorer vocalizes description of an image with auto-generated captions to help BLV people identify errors. I wonder what one might need to change in this approach for auto-generated (or just badly written) chart captions. Two important learnings from ImageExplorer were the value hierarchical, spatial nature of navigation supported; and the need to support both text and spatial navigation. Cocomix was focused making on comics, not visualizations, accessible to BLV people, but I think the many innovations in this paper have lots of applications for change description and dashboard description. Saha et al discuss visualizing urban accessibility, exploring how different types of secondary information and visualization needs vary for different stakeholders.

Fabrication Work

The vast majority of fabrication work this year did not directly engage with accessibility. That said, I saw a lot of potential for future work in this space.

I first attended the workshop, Reimagining Systems for Learning Hands-on Creative and Maker Skills. We discussed a wide variety of topics around who makes, how people make, and what we might want to contribute to and learn about those experiences as a community. We talked about who is included in making as well. Some provocative discussions happened around whether digital tools or physical tools are a better starting place for learning; how we engage with diverse communities without “colonizing” those spaces; and whether we should “claim” diverse crafts as making or not; The ways in which new technologies can inhibit learning (everyone makes a keychain tag); and the need to educate not only students but educators. Another interesting discussion happened around how time plays out in making and adds challenges when things take time to print, grow, etc etc. Another topic that came up was the digital divide in access to maker spaces, i.e. what may be available in rural communities. Another was tutorial accessibility and whether/how to improve that. Some of the interesting people I learned more about include: Jun Gong (formerly at MIT, now at Apple; does everything from interaction technique design to meta materials); Erin Higgins (introducing youth in Baltimore City to making); and Fraser Anderson (whose work includes instrumenting maker spaces to better understand maker activities). I also want to highlight some students I already knew about here at UW 🙂 including my own student Aashaka Desai (working on machine embroidered tactile graphics) and Daniel Campos Zamora who is interested in the intersection of fabrication and access (ask him about his mobile 3D printer :). 

The first fabrication session I made it to was a panel that placed fabrication up against VR/AR/Haptics. Hrvoje Benko and Michael Nebeling were in “camp AR/VR” and listed challenges such as interaction devices; adaptive UIs and so on. Valkyrie Savage, “camp fabrication” talked of interaction and sensing (as well as the sensory systems); Huaishu Peng & Patrick Baudisch talked about fabrication + interaction; small artifacts; and AR/VR. The wide-ranging discussion mentioned machine reliability; accessibility and 3D printing as a public utility; using AR/VR to bridge the gap between a physical object that almost fills a need and reality with AR/VR (repurposing); and/or business (i.e. Amazon vs Fab). I will focus on what I see as accessibility challenges in the arguments made: Can have anything delivered to our door in 2 hrs? I would claim that our process today works for mass manufacturing but is not customizable to people with disabilities. Next, a potential flaw of AR/VR is its dependence on electricity — if we are to make meaningful, useful objects, physicality is essential for people who either cannot count on having power, or who depend upon a solution being available all the time. Another concern is bridging from accessible consumption to accessible, inclusive authoring tools. As Valkyrie Savage argued, physicality addresses multiple types of inclusion better than VR/AR. Lastly, materials were discussed briefly, though not from an accessibility perspective (though material properties are critical to successful access support in my mind).

Moving on to individual papers, I was excited to see multiple people talking about the importance of programming language support for parametric modeling and physical computing (an interest of my own). For example, Tom Veuskensideas about combining WYSWIG and code for parametric modeling look highly intuitive and fun to use. Valkyrie Savage talked about the importance of this for novice learners and lays the idea of a Jupyter notebook style approach to physical computing design. Tom Vueskens et al. provide a beautiful summary of the variety of code based approaches to support re-use in the literature. Another interesting and I think related set of conversations happened around how you understand making activities. An example is Colin Yeung’s work on tabletop time machines. The concept of being able to go back and forward in time, ideally with linkages to physical actions, project state, and digital file state, is really interesting from an accessibility perspective. Relatedly, Rasch, Kosch and Feger discuss how AR can support learning of physical computing. Finally, Clara Rigaud discussed the potential harms of automatic documentation.

In the domain of modeling tools, accessibility did not come up much. While many papers mentioned custom modeling tools, none of the talks mentioned accessibility for authors/modelers nor did they report on studies with disabled people. The most obvious challenge here is BLV accessibility; but to the extent that generative design is simplifying the modeling experience and computationally controllable, I think there are some very easy ways to improve on this situation. I was actually most intrigued by a non-fabrication paper’s relevance to both fabrication and accessibility: HAExplorer which the fabrication person in me sees as an interesting model for understanding the mechanics of motion of any mechanics, not just biomechanics. In addition, visualizations of mechanics raise the possibility of accessible visualizations of mechanics.

The haptics session had multiple potential accessibility applications. FlexHaptics provides a general method and design tool for designing haptic effects using fabrication, including in interactive controllers; while ShapeHaptics supports design of passive haptic using a combination of springs and sliders which together can control the force profile of a 1D slider. An interesting accessibility side effect of this approach is to modify existing objects by adding both physical and audio effects at key moments, such as when pliers close. In some configurations, the system can also be easily swappable, thus allowing for manual selection experiences based on context. ReCompFig supports dynamic changes to kinematics using a combination of rods and cables (which can be loosened or tightened by a motor). They create effects like a joystick, pixelated display with varying stiffness; and a range of haptic effects such as holding a glass of liquid, or stiff bar. 3D printed soft sensors uses a flexible lattice structure to support resistive soft sensor design.

Interesting materials included Embr, which combines hand embroidery with thermochromic ink, which characterizes 12 of the most popular embroidery stitches for this purpose and supports simulation and design. The results are beautiful to look at and I wonder if there is potential for creating shared multi-ability experiences, such as combining capacitive touch-based audio output with simultaneous visual feedback. I loved multiple aspects of FabricINK because of its sustainable approach (recycling e-ink) as well as the way it opens the door to fine grained displays on many surfaces. Luo it al present pneumatic actuators combined with machine knitting. ElectroPop uses static charge combined with cut mylar sheets to create 3D shapes (it would be interesting to know how well these would hold up to exploratory touch). SlabForge supports design (for manual production) of slab based ceramics. Finally, the Logic Bonbon provides a metamaterial edible interaction platform. Nice to see the range of materials+X being presented, and lots of interesting potential applications of these low-level capabilities.

Another grouping of papers explored capabilities that could increase the accessibility of objects with additional information. M. Doga Dogan et al created InfraredTags, which allow embedding of infrared QR codes in 3D printed objects. Although not a focus of the paper, this has accessibility value (for example an audio description could be embedded). This does require an IR camera. Pourjafarian et al present Print-A-Sketch, which supports accurate printing on arbitrary surfaces, including reproductions of small icons as well as scanning and line drawing. Although not a focus of the work, it would be very interesting to think about how this could be used to create tactile and interactive graphics, or to annotate existing documents and objects for increased accessibility. It would be interesting to think about inks with other kinds of properties than conductive (such as raised inks) as well.

Although my theme is accessibility, disability justice is an intersectional issue that must consider other aspects of design. In that vein, I want to highlight two lovely examples of sustainable design. ReClaym, which creates clay objects from personal composting, and Light In Light Out which harvests and manipulates natural light computationally.

There were a few papers that focused on accessibility, all in the applications space. Roman combines object augmentation with a robotic manipulator to support a wide range of manipulation tasks not easily manipulable by robotic arms. The robot is augmented with a motorized magnetic gripper, while the target object is augmented with a device that can translate rotary motion into an appropriate motion and force profile. Mobiot is a system that supports the creation of custom print and assembly instructions for IoT mobile actuators by leveraging recognition of objects in a known model database combined with demonstration. My student Megan Hofmann presented Maptimizer, a system which creates optimal 3D printed maps was very synergistic with 3D printed street crossings for mobility training. TronicBoards, which support electronic design. FoolProofJoints improves ease of assembly, which although not tested with disabled participants seems to me to have direct accessibility benefits. One final application was material adaptations for supporting accessible drone piloting. This involved both software adaptation, physical control adaptation and posture adaptations. The authors supported multiple disabilities (and multiply disabled people); and open sourced their toolkit.

Other Disability/Accessibility Highlights

Dreaming Disability Justice Workshop: This workshop discussed academic inclusion and the importance of research at the intersection of race and disability that is strongly influenced by both perspectives in conjunction (as opposed to a “this and that” model). Also just not erasing that history (e.g. see these examples of Black, disabled, powerful women). Some of the interesting people I learned more about include:  Cella Sum (politics of care in disability spaces); Frank Elavsky (accessible visualization); Harsha Bala (an anthropologist); Erika Sam (Design Researcher at Microsoft) and Tamana Motahar (A PhD student studying personal informatics and Social Computing for empowering marginalized populations worldwide).

On Tuesday morning I attended Accessibility and Aging. The first talk explored the experience of older adults sharing the work of financial management. Joint accounts & power of attorney are both problematic mechanisms. Banking assistance needs fall along a spectrum these are two blunt for. These concerns seem common to many domains (e.g. health portals; social media accounts; etc). The second talk was on The third was a paper I collaborated on, access needs research design was presented by Kelly Mack. How can we empower researchers to anticipate the broad range of disabilities they might encounter? Anticipate (make things accessible from the beginning) and Adjust as needed. End by Reflecting on things like power dynamics and access conflicts. Next, Christina Harrington‘s award winning paper addressed communication breakdowns in health information seeking using voice for black older adults. Her paper addressed critical concerns such as what dialects are supported by voice systems.

In reviewing other accessibility-related talks, I want to highlight the importance of end-user and multi-stakeholder authoring of interaction and experiences. Dai et al discussed relational maintenance in AAC conversation between users and caregivers. Seita et al show how DHH and speaking people can effectively collaborate when using a visual collaboration system like Miro. Ang et al discuss how video conferencing systems can better support the combination of speaking / signing / interpreting in mixed ASL/spoken language video conferencing calls. One concern — the difficulty of dynamically adjusting communication — reminded me of challenges I’ve experienced with online conferencing as well. Another mixed stakeholder case is Waycott et al’s study staff’s role in supporting VR experiences for elders are positive. A unique case of multi-stakeholder interaction is Choi’s analysis of disabled video blogger interaction with content curation algorithms and how algorithms could better support identity negotiation and audience selection.

I also want to highlight some interaction design work. I loved the WoZ study with ASL control of voice assistants by Glasser et al. It got right to the heart of an important unsolved problem, and in the process shed light on challenges we must solve for ASL as an input language for all sorts of automated contexts. Zhao et al described user-defined above-shoulder gesturing for motor-impaired interaction design, highlighting the importance of end user control over the interaction language for things like social acceptability and comfort. Nomon is an innovative approach to single switch input. This might be amenable to smooth saccade tracking as well.

To summarize an inspiring event. I was glad to be able to review it so thoroughly, thanks to all the online talks which I watched asynchronously.