Zheng Zhang

HCI + AI researcher

profile_image.jpg

Hey! I’m a PhD student in the Department of Computer Science and Engineering at the University of Notre Dame. My advisor is Dr. Toby Jia-Jun Li. Before joining ND, I received two M.S degrees in Computer Science from the University of Rochester and the University of Minnesota, where I was advised by Dr. Zhen Bai and Dr. Haiyi Zhu respectively. I received B.Eng in Software Engineering from Shaanxi Normal University.

My work falls in the intersection of Human-Computer Interaction, Natural Language Processing, Program Synthesis, and Computer Vision, where I use human-centered methods to design, build, and evaluate human-AI collaborative systems to strengthen the efficiency, trustworthiness, explanability, and accuracy of different phases in the AI model development and deployment, ranging from data annotation to model’s decision making. Besides, I’m also passionate about leveraging the state-of-the-art AI techniques to benefit a variety of human needs and optimizing user experience accordingly.

News

Jan 19, 2024 Our paper “CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models” got accepted to CHI 2024!
Oct 7, 2023 Our paper about Interactive Text-to-SQL Generation got accepted to EMNLP 2023!
Aug 4, 2023 Both VISAR and PEANUT got accepted to UIST 2023! Thanks for all collaborators’ effort on these works.
May 22, 2023 Excited to start my applied scientist internship with Alex Williams and Erran Li at AWS AI Human-in-the-loop science team!
Apr 20, 2023 Give an invited talk of VISAR system at AWS AI

Publications

(* indicates equal contribution)

  1. C&C 2024
    MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos
    Zheng Zhang*, Ning Zheng*, Jerrick Ban, Kaiwen Jiang, Ruohong Gan, Yapeng Tian, and Toby Jia-Jun Li
    In Proceedings of the 15th Conference on Creativity and Cognition, May 2024
  2. TiiS
    Insights into Natural Language Database uery Errors: From Atention Misalignment to User Handling Strategies
    Ning Zheng, Yuan Tian, Zheng Zhang, Tianyi Zhang, and Toby Jia-Jun Li
    In ACM Transactions on Interactive Intelligent Systems, May 2024
  3. CHI 2024
    CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models
    Jie Gao, Yuchen Guo, Gionnieve Lim, Tianqin Zhang, Zheng Zhang, Toby Jia-Jun Li, and Simon Tangi Perrault
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, May 2024
  4. EMNLP 2023
    Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations
    Yuan Tian, Zheng Zhang, Zheng Ning, Toby Jia-Jun Li, Jonathan K. Kummerfeld, and Tianyi Zhang
    In The 2023 Conference on Empirical Methods in Natural Language Processing, Dec 2023
  5. UIST 2023
    PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data
    Zheng Zhang, Zheng Ning, Chenliang Xu, Yapeng Tian, and Toby Jia-Jun Li
    In Proceedings of the 2023 ACM Symposium on User Interface Software and Technology, Oct 2023
  6. UIST 2023
    VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping
    Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, and Toby Jia-Jun Li
    In Proceedings of the 2023 ACM Symposium on User Interface Software and Technology, Oct 2023
  7. CHI 2023
    PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis
    Zheng Zhang*, Simret Araya Gebreegziabher*, Xiaohang Tang, Yihao Meng, Elena Glassman, and Toby Jia-jun Li
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Apr 2023
  8. IUI 2023
    An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries
    Zheng Zhang*, Zheng Ning*, Tianyi Sun, Yuan Tian, Tianyi Zhang, and Toby Jia-jun Li
    In Proceedings of the 28th International Conference on Intelligent User Interfaces, Mar 2023
  9. ACL 2022
    Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension
    Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, and Mark Warschauer
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), May 2022
  10. ACL 2022
    It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books
    Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang, Toby Li, Mo Yu, and Ying Xu
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), May 2022
  11. CHI 2022
    StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement
    Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tongshuang Wu, Mo Yu, Dakuo Wang, and Toby Jia-Jun Li
    In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, May 2022
  12. CHI 2020
    Race, Gender and Beauty: The Effect of Information Provision on Online Hiring Biases
    Zheng Zhang*, Weiwen Leung*, Daviti Jibuti, Jinhao Zhao, Maximilian Klein, Casey Pierce, Lionel Robert, and Haiyi Zhu
    In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, May 2020
  13. CHI 2019
    Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
    Hao-Fei Cheng, Ruotong Wang, Zheng Zhang, Fiona O’Connell, Terrance Gray, F. Maxwell Harper, and Haiyi Zhu
    In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, May 2019