publications

Check out my Google Scholar for my latest publications

2025

  1. extracted/mowar2025codea11y.png
    CodeA11y: Making AI Coding Assistants Useful for Accessible Web Development
    Peya Mowar, Yi-Hao Peng, Jason Wu, and 2 more authors
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 2025
    [PDF]
  2. extracted/leung2025squire.png
    Squire: Interactive UI Authoring via Slot QUery Intermediate Representations
    Alan Leung, Ruijia Cheng, Jason Wu, and 2 more authors
    In Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology, 2025
    [PDF]
  3. extracted/wu2025rldf.png
    Improving User Interface Generation Models from Designer Feedback
    Jason Wu, Amanda Swearngin, Arun Krishna Vajjala, and 3 more authors
    2025
    Preprint
    [PDF]

2024

  1. extracted/swearngin2024towards.png
    Towards Automated Accessibility Report Generation for Mobile Apps
    Amanda Swearngin, Jason Wu, Xiaoyi Zhang, and 8 more authors
    ACM Transactions on Computer-Human Interaction (TOCHI), 2024
    [PDF]
  2. extracted/wu2024framekit.png
    FrameKit: A Tool for Authoring Adaptive UIs Using Keyframes
    Jason Wu, Kashyap Todi, Joannes Chan, and 2 more authors
    In Proceedings of IUI 2024, ACM Conference on Intelligent User Interfaces, 2024 Best Paper
    [PDF] [Video]
  3. extracted/wu2024uicoder.png
    UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback
    Jason Wu, Eldon Schoop, Alan Leung, and 3 more authors
    In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024
    [PDF]
  4. Computational Understanding of User Interfaces
    Jason Wu
    Carnegie Mellon University, 2024
    [PDF] [Talk Video]
  5. extracted/peng2024dreamstruct.png
    DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation
    Yi-Hao Peng, Yue Jiang Faria Huq, Jason Wu, and 3 more authors
    In Proceedings of ECCV 2024, The 18th European Conference on Computer Vision, 2024
    [PDF] [Project Page] [Hugging Face] [GitHub]
  6. extracted/wu2024uiclip.png
    UIClip: A Data-driven Model for Assessing User Interface Design
    Jason Wu, Yi-Hao Peng, Amanda Li, and 3 more authors
    In In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024, 2024
    [PDF] [Talk Video] [Project Page] [Hugging Face] [Demo]

2023

  1. extracted/wu2023screen.png
    Screen Correspondence: Mapping Interchangeable Elements between UIs
    Jason Wu, Amanda Swearngin, Xiaoyi Zhang, and 2 more authors
    arXiv preprint arXiv:2301.08372, 2023
    [PDF]
  2. extracted/wu2023webui.png
    WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
    Jason Wu, Siyan Wang, Siman Shen, and 3 more authors
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023 Honorable Mention
    [PDF] [Talk Video] [Project Page] [Hugging Face] [Demo] [GitHub]
  3. Towards Never-ending Learning of User Interfaces
    Jason Wu, Rebecca Krosnick, Eldon Schoop, and 3 more authors
    In ICML Workshop on Artificial Intelligence & Human Computer Interaction, 2023
    [PDF]
  4. extracted/wu2023never.png
    Never-ending Learning of User Interfaces
    Jason Wu, Rebecca Krosnick, Eldon Schoop, and 3 more authors
    In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023
    [PDF] [Talk Video]
  5. extracted/kim2023star.png
    STAR: Smartphone-analogous Typing in Augmented Reality
    Taejun Kim, Amy Karlson, Aakar Gupta, and 6 more authors
    In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023
    [PDF]
  6. extracted/li2023using.png
    Using LLMs to Customize the UI of Webpages
    Amanda Li, Jason Wu, and Jeffrey P Bigham
    In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023
    [PDF]

2022

  1. extracted/feiz2022understanding.png
    Understanding Screen Relationships from Screenshots of Smartphone Applications
    Shirin Feiz, Jason Wu, Xiaoyi Zhang, and 3 more authors
    In 27th International Conference on Intelligent User Interfaces, 2022
    [PDF]
  2. extracted/chen2022towards.png
    Towards Complete Icon Labeling in Mobile Applications
    Jieshan Chen, Amanda Swearngin, Jason Wu, and 3 more authors
    In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022
    [PDF]
  3. extracted/chen2022extracting.png
    Extracting replayable interactions from videos of mobile app usage
    Jieshan Chen, Amanda Swearngin, Jason Wu, and 3 more authors
    arXiv preprint arXiv:2207.04165, 2022
    [PDF]
  4. extracted/wu2022reflow.png
    Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements
    Jason Wu, Titus Barik, Xiaoyi Zhang, and 3 more authors
    arXiv preprint arXiv:2207.07712, 2022
    [PDF]
  5. extracted/peng2022diffscriber.png
    Diffscriber: Describing Visual Design Changes to Support Mixed-ability Collaborative Presentation Authoring
    Yi-Hao Peng, Jason Wu, Jeffrey Bigham, and 1 more author
    In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, 2022
    [PDF]

2021

  1. extracted/zhang2021screen.png
    Screen recognition: Creating accessibility metadata for mobile applications from pixels
    Xiaoyi Zhang, Lilian Greef, Amanda Swearngin, and 8 more authors
    In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021 Best Paper
    [PDF] [Talk Video]
  2. extracted/wu2021can.png
    When can accessibility help? an exploration of accessibility feature recommendation on mobile devices
    Jason Wu, Gabriel Reyes, Sam C White, and 2 more authors
    In Proceedings of the 18th International Web for All Conference, 2021 Best Paper
    [PDF] [Talk Video]
  3. extracted/liang2021multibench.png
    MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
    Paul Pu Liang, Yiwei Lyu, Xiang Fan, and 8 more authors
    In NeurIPS Datasets and Benchmarks 2021, 2021
    [PDF]
  4. extracted/wu2021screen.png
    Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
    Jason Wu, Xiaoyi Zhang, Jeff Nichols, and 1 more author
    In The 34th Annual ACM Symposium on User Interface Software and Technology, 2021
    [PDF] [Talk Video]

2020

  1. extracted/wu2020automatic.png
    Automatic Class Discovery and One-Shot Interactions for Acoustic Activity Recognition
    Jason Wu, Chris Harrison, Jeffrey P Bigham, and 1 more author
    In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020 Honorable Mention
    [PDF] [Video]
  2. extracted/herskovitz2020making.png
    Making Mobile Augmented Reality Applications Accessible
    Jaylin Herskovitz, Jason Wu, Samuel White, and 4 more authors
    In Proceedings of the 22nd international ACM SIGACCESS conference on Computers and accessibility, 2020
    [PDF]
  3. Towards Recommending Accessibility Features on Mobile Devices
    Jason Wu, Gabriel Reyes, Sam C. White, and 2 more authors
    In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020
    [PDF]
  4. extracted/gleason2020disability.png
    Disability and the COVID-19 pandemic: Using Twitter to understand accessibility during rapid societal transition
    Cole Gleason, Stephanie Valencia, Lynn Kirabo, and 6 more authors
    In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020
    [PDF]

2019

  1. extracted/li2019tongueboard.png
    TongueBoard: An Oral Interface for Subtle Input
    Richard Li, Jason Wu, and Thad Starner
    In Proceedings of the 10th Augmented Human International Conference 2019, 2019
    [PDF] [Video]
  2. extracted/wu2019scratchthat.png
    ScratchThat: supporting command-agnostic speech repair in voice-driven assistants
    Jason Wu, Karan Ahuja, Richard Li, and 2 more authors
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019
    [PDF] [Video]
  3. extracted/lee2019selfsync.png
    SelfSync: exploring self-synchronous body-based hotword gestures for initiating interaction
    Juyoung Lee, Shaurye Aggarwal, Jason Wu, and 2 more authors
    In Proceedings of the 2019 ACM International Symposium on Wearable Computers, 2019
    [PDF]

2018

  1. extracted/reyes2018synchrowatch.png
    Synchrowatch: One-handed synchronous smartwatch gestures using correlation and magnetic sensing
    Gabriel Reyes, Jason Wu, Nikita Juneja, and 4 more authors
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018
    [PDF]
  2. extracted/wu2018synchronous.png
    Synchronous Interfaces for Wearable Computers
    Jason Wu
    Undergraduate thesis, Georgia Institute of Technology, 2018
    [PDF]
  3. extracted/wu2018seesaw.png
    Seesaw: rapid one-handed synchronous gesture interface for smartwatches
    Jason Wu, Cooper Colglazier, Adhithya Ravishankar, and 4 more authors
    In Proceedings of the 2018 ACM International Symposium on Wearable Computers, 2018
    [PDF]
  4. extracted/wu2018nadia.png
    Nadia: Neural network driven virtual human conversation agents
    Jason Wu, Sayan Ghosh, Mathieu Chollet, and 3 more authors
    In Proceedings of the 18th International Conference on Intelligent Virtual Agents, 2018
    [PDF]
  5. NADiA-Towards Neural Network Driven Virtual Human Conversation Agents
    Stefan Scherer, Jason Wu, Sayan Ghosh, and 3 more authors
    In International Conference on Autonomous Agents and Multiagent Systems, 2018
    [PDF]

2016

  1. extracted/reyes2016whoosh.png
    Whoosh: non-voice acoustics for low-cost, hands-free, and rapid input on smartwatches
    Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, and 7 more authors
    In Proceedings of the 2016 ACM International Symposium on Wearable Computers, 2016
    [PDF]