Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps
AuthorsForough Mehralian, Titus Barik, Jeff Nichols, Amanda Swearngin
AuthorsForough Mehralian, Titus Barik, Jeff Nichols, Amanda Swearngin
Accessibility is crucial for inclusive app usability, yet developers often struggle to identify and fix app accessibility issues due to a lack of awareness, expertise, and inadequate tools. Current accessibility testing tools can identify accessibility issues but may not always provide guidance on how to address them. We introduce FixAlly, an automated tool designed to suggest source code fixes for accessibility issues detected by automated accessibility scanners. FixAlly employs a multi-agent LLM architecture to generate fix strategies, localize issues within the source code, and propose code modification suggestions to fix the accessibility issue. Our empirical study demonstrates FixAlly’s capability in suggesting fixes that resolve issues found by accessibility scanners—with an effectiveness of 77% in generating plausible fix suggestions—and our survey of 12 iOS developers finds they would be willing to accept 69.4% of evaluated fix suggestions.
July 17, 2024research area Accessibility, research area Human-Computer Interactionconference ACM Transactions on Computer-Human Interaction
Many apps have basic accessibility issues, like missing labels or low contrast. Automated tools can help app developers catch basic issues, but can be laborious to run or require writing dedicated tests. In this work, we developed a system to generate accessibility reports from mobile apps through a collaborative process with accessibility stakeholders at Apple. Our method combines varied data collection methods (e.g., app crawling, manual...
March 11, 2024research area Accessibility, research area Human-Computer Interactionconference CHI
Despite increasing awareness of the need to support accessibility in mobile apps, many still lack support for key accessibility features. Developers and quality assurance testers often rely on manual testing to test accessibility features throughout the product lifecyle. However, manual testing can be tedious, often has an overwhelming scope, and test passes can be difficult to time amongst other development milestones. Recently, Large Language...