Not every user can tap.
Some press a switch.
SWITCH ACCESS
One element at a time.
A scanner highlights each control in turn. The user waits, then presses the switch to select.
0
words per minute
with a switch
0
words per minute
with touch
Yet tools rarely look out for them.
Accessibility tooling has focused mostly on users with low vision or hearing loss.
Introducing
MotorEase
Accessibility checks for motor-impaired users.
SCREEN 1
Explore every screen.
Any automated input generator crawls the app. No test cases needed.
Screenshots
What every screen actually looks like.
<node clickable="true"
bounds="[16,61][72,117]"/>
UI metadata
uiautomator XML for every element.
Four detectors.
Computer vision and text processing work out what each element looks like and does.
01
Visual touch target
Visible icon under 48 px, even when its tap area is bigger.
02
Icon distance
Adjacent clickable elements less than 8 px apart.
03
Expanding sections
Pop-ups with no closing word or icon.
04
Persisting elements
The same element, moved across screens.
Report every violation.
MotorEase writes an accessibility report, with screenshots, for developers to fix.
accessibility_report.md
✕ touch target back icon · visibly under 48 px
✕ icon distance Start / Privacy · under 8 px apart
✕ expanding dialog · no way to close it
✕ persisting search · moved on screen 2
Evaluated on MotorCheck, a new benchmark
≈0%
average accuracy across all four detectors
<9%false-positive rate
91% vs 72%expanding sections, vs. Groundhog
85% vs 60%touch targets, vs. Accessibility Scanner
From 18 guidelines in a systematic literature review
Four guidelines.
No prior tool targeted them.
MotorEase is one of the first tools built to catch violations that affect motor-impaired users.
MotorEase: Automated Detection of Motor Impairment
Accessibility Issues in Mobile App UIs
Arun Krishnavajjala · S M Hasan Mansur · Justin Jose · Kevin Moran
ICSE 2024 · IEEE/ACM International Conference on Software Engineering