Home
Research
CV
Other
Hello 👋, I am a PhD student in Computer Science at the University of Chicago, where I am fortunate to be advised by Mina Lee. Previously, I was a research associate in the Human-Computer Interaction Institute at Carnegie Mellon University.
My research interests are Human-Centered AI Evaluation and AI Literacy, with focus on broadening participation in AI evaluation, to bridge the gap between the reality of AI systems and the principles of human-centered computing. Concretely, I explore theories and build systems of engaging users into the AI development process, and design methods, processes and tools for AI practitioners to better involve users and consider human feedback in their practices.
Please feel free to drop me an email if you are interested in a discussion!
Jiayin Zhi (she/her)
📧 jiayin.3zh@gmail.com
✉️ jzhi@uchicago.edu
Selected Works
Understanding Human Feedback in Context-Specific AI Alignment: How Workers Interpret Problematic LLM-Generated Job Ads
Jiayin Zhi, Sara Kingsley, Beibei Li, Jeffrey Bigham, Saiph Savage.
[Paper]
PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals
Ruiyi Wang*, Stephanie Milani*, Jamie C. Chiu, Jiayin Zhi, Shaun M. Eack, Travis Labrum, Samuel M. Murphy, Nev Jones, Kate Hardy, Hong Shen, Fei Fang, Zhiyu Zoey Chen.
In Proceedings of EMNLP 2024.
Investigating What Factors Influence Users’ Rating of Harmful Algorithmic Bias and Discrimination
Sara Kingsley*, Jiayin Zhi*, Wesley Hanwen Deng, Jaimie Lee, Sizhe Zhang, Motahhare Eslami†, Ken Holstein†, Jason I. Hong†, Tianshi Li†, Hong Shen†. (* equal contribution, † equal contribution)
In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2024. Best Paper Award 🏆
"You’re in a Ferrari. I’m Waiting for the Bus": Confronting Tensions in Community-University Partnerships for Publicly Deployed Technologies
Cella M Sum, Jiayin Zhi, Amil N.T. Cook, Patrick James Cooper, Arturo Lozano, TJ Johnson, Jason Perez, Rayid Ghani, Michael Skirpan, Motahhare Eslami, Hong Shen, Sarah E Fox.
To Appear in Proceedings of the ACM on Human-Computer Interaction, CSCW 2025.
[Paper]
AI Failure Cards: Understanding and Supporting Grassroots Efforts to Mitigate AI Failures in Homeless Services
Ningjing Tang, Jiayin Zhi, Tzu-Sheng Kuo, Calla Kainaroi, Jeremy J Northup, Kenneth Holstein, Haiyi Zhu, Hoda Heidari, Hong Shen.
In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024.
Predicting and Presenting Task Difficulty for Crowdsourcing Food Rescue Platforms
Zheyuan Ryan Shi, Jiayin Zhi, Siqi Zeng, Zhicheng Zhang, Ameesh Kapoor, Sean Hudson, Hong Shen, Fei Fang.
In Proceedings of the ACM on Web Conference 2024.
© 2023 by Jiayin.