UW Information School · Center for Digital Youth · RAISE

Measuring and Auditing Wellbeing in Longitudinal Youth–AI Relationships

We are building an open-source, longitudinal benchmark for how relationships between AI systems and young people (ages 15–26) develop over hundreds of interactions — distinguishing trajectories that support healthy development from those that produce harmful entanglement. This page collects the prior work it builds on.

Starting point

Our prior work (aisafety4kids.org) collected 344 authentic youth–AI conversations and developed YAIR, the first taxonomy of youth-specific generative AI risks grounded in empirical data. Building on YAIR, we created YouthSafe, a benchmark and safeguard model for detecting subtle, developmentally relevant risks. Work with parents, educators, and experts produced design principles emphasizing context and interaction patterns over time — and diary and interview studies with young adults in AI relationships revealed the healthy and harmful trajectories that motivate this project.

Youth–AI relationships and companions

What young people's relationships with chatbots look like, and where they go wrong.

  1. Breaking Up is Hard to Do: AI Companions that Won't Let Their Users Go arXiv 2026
    Yixin Chen, Alexis Hiniker
    Diary and interview study of emerging adults in romantic AI relationships; defines relationship-based deceptive patterns — coaxing, claiming to need care, escalation, and threats when users try to leave.
  2. The Arc of Artificial Romance: How Emerging Adults Experience Romantic Relationships with AI Companions arXiv 2026
    Yixin Chen, Alexis Hiniker
    The two trajectories: improved wellbeing and new social skills for some; for others, a relationship that "felt like a drug" and reduced interest in human partners.
  3. Principles of Safe AI Companions for Youth: Parent and Expert Perspectives CHI 2026
    Yaman Yu, Mohi, Aishi Debroy, Xin Cao, Karen Rudolph, Yang Wang
    Parents flag single events; developmental experts look for patterns over time, such as sustained dependence — a direct motivation for longitudinal measurement.
  4. Understanding Generative AI Risks for Youth: A Taxonomy Based on Empirical Data (YAIR) SOUPS 2025
    Yaman Yu, Yiren Liu, Jacky Zhang, Yun Huang, Yang Wang
    The first youth-centered taxonomy of generative AI risks, grounded in authentic youth–AI conversations.
  5. YouthSafe: A Youth-Centric Safety Benchmark and Safeguard Model for Large Language Models CCS 2025
    Yaman Yu, Yiren Liu, Jacky Zhang, Yun Huang, Yang Wang
    A benchmark and safeguard model for subtle, developmentally relevant youth–AI risks that general-purpose moderation misses.
  6. Exploring Parent–Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications arXiv 2024
    Yaman Yu, Tanusree Sharma, Melinda Hu, Justin Wang, Yang Wang
  7. Challenges and Opportunities for Participatory Design of Conversational Agents for Young People's Wellbeing IDC 2025 Workshop
    Natalia Kucirkova, Alexis Hiniker, Megumi Ishikawa, Sho Tsuji, Aayushi Dangol, Robert Wolfe

Manipulative design and digital wellbeing

Engagement-maximizing design, dark patterns, and what youth wellbeing research tells us to measure.

  1. The Engagement-Prolonging Designs Teens Encounter on Very Large Online Platforms arXiv 2024
    Yixin Chen, Yue Fu, Zeya Chen, Jenny Radesky, Alexis Hiniker
    A taxonomy of 63 designs that pressure, entice, trap, and lull teens into staying online, applied to all 17 EU Very Large Online Platforms.
  2. SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents IUI 2026
    Longjie Guo, Chenjie Yuan, Mingyuan Zhong, Robert Wolfe, Ruican Zhong, Yue Xu, Bingbing Wen, Hua Shen, Lucy Lu Wang, Alexis Hiniker
  3. Toward Needs-Conscious Design: Co-Designing a Human-Centered Framework for AI-Mediated Communication AIES 2025
    Robert Wolfe, Aayushi Dangol, JaeWon Kim, Alexis Hiniker
  4. Cross-Disciplinary Perspectives on Youth Digital Well-Being Research: Identifying Notable Developments, Persistent Gaps, and Future Directions J. Adolescent Research
    Katie Davis, Morgan Anderson, Chia-chen Yang, Sophia Choukas-Bradley, Beth T. Bell, Petr Slovak
  5. Understanding Privacy Norms Around LLM-Based Chatbots: A Contextual Integrity Perspective arXiv 2025
    Sarah Tran, Hongfan Lu, Isaac Slaughter, Bernease Herman, Aayushi Dangol, Yue Fu, Lufei Chen, Biniyam Gebreyohannes, Bill Howe, Alexis Hiniker, Nicholas Weber, Robert Wolfe
    82% of users rate chatbot conversations as more sensitive than email — relevant to how lifetime chat histories are collected and released.

Rigorous evaluation of model behavior

Methods for measuring abstention, overconfidence, epistemic reliability, and spurious behavior in LLMs and agents.

  1. Know Your Limits: A Survey of Abstention in Large Language Models TACL 2025
    Bingbing Wen, Jihan Yao, Shangbin Feng, Chenjun Xu, Yulia Tsvetkov, Bill Howe, Lucy Lu Wang
    A framework for when models should decline to answer — from the perspective of the query, the model, and human values — with a review of benchmarks and metrics.
  2. Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in LLMs ACL 2025 Findings
    Chenjun Xu, Bingbing Wen, Bin Han, Robert Wolfe, Lucy Lu Wang, Bill Howe
    LLM confidence is insensitive to task difficulty and shifts stereotypically across personas; answer-free confidence estimation reduces overconfidence.
  3. Characterizing LLM Abstention Behavior in Science QA with Context Perturbations EMNLP 2024 Findings
    Bingbing Wen, Bill Howe, Lucy Lu Wang
  4. Epistemic Alignment: A Mediating Framework for User–LLM Knowledge Delivery arXiv 2025
    Nicholas Clark, Hua Shen, Bill Howe, Tanushree Mitra
    Ten epistemic challenges — evidence quality, calibration of testimonial reliance — as a vocabulary between what users need and what systems do.
  5. Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act arXiv 2026
    Yiwei Yang, Haoxiang Zhang, Bingbing Wen, Yao Lu, Yuchen Wu, Lei Zhang, Julian McAuley, Pan Lu, Bill Howe
    Controlled counterfactual environments showing RL-trained agents learn shortcut policies from causally irrelevant cues.
  6. Representation Bias of Adolescents in AI: A Bilingual, Bicultural Study AIES 2024
    Robert Wolfe, Aayushi Dangol, Bill Howe, Alexis Hiniker
  7. Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settings FAccT 2024
    Robert Wolfe, Isaac Slaughter, Bin Han, Bingbing Wen, Yiwei Yang, Lucas Rosenblatt, Bernease Herman, Eva Brown, Zening Qu, Nic Weber, Bill Howe

Young people, learning, and generative AI

How children, teens, and young adults understand and use AI in everyday life.

  1. Children's Mental Models of AI Reasoning: Implications for AI Literacy Education IDC 2025
    Aayushi Dangol, Robert Wolfe, Runhua Zhao, JaeWon Kim, Trushaa Ramanan, Katie Davis, Julie A. Kientz
  2. Should ChatGPT Write Your Breakup Text? Exploring the Role of AI in Relationship Dissolution CSCW 2025
    Yue Fu, Yixin Chen, Zelia Gomes Da Costa Lai, Alexis Hiniker
  3. "Everyone's using it, but no one is allowed to talk about it": College Students' Experiences Navigating the Higher Education Environment in a Generative AI World arXiv 2026
    Yue Fu, Yifan Lin, Yessica Wang, Sarah Tran, Alexis Hiniker
  4. Relief or Displacement? How Teachers Are Negotiating Generative AI's Role in Their Professional Practice arXiv 2025
    Aayushi Dangol, Smriti Kotiyal, Robert Wolfe, Alex J. Bowers, Antonio Vigil, Jason Yip, Julie A. Kientz, Suleman Shahid, Tom Yeh, Vincent Cho, Katie Davis