Professor Andres De Los Reyes – Professor Elizabeth Talbott | Transforming Youth Mental Health Through Evidence-based Assessment
Youth mental health in the USA is in crisis, having steadily worsened over the past ten years. To tackle this crisis, we have to understand it. Evidence-based assessment is key to this understanding. Professor Andres De Los Reyes at the University of Maryland and Professor Elizabeth Talbott at William and Mary lead the study of mental health assessment designed to advance outcomes for all children and youth.
Understanding the Mental Health Challenge
According to the Centers for Disease Control and Prevention, almost 1 in 5 children in the USA experience a mental health or behavioural disorder. Children with attention-deficit hyperactivity disorder (ADHD), autism spectrum disorder (ASD), externalising problems, and anxiety or depression benefit from evidence-based practices designed to meet their needs. Gathering and interpreting data about a child’s condition from different informants is central to the delivery of these evidence-based practices. These assessment data include ratings from parents, teachers, and youth themselves. Yet, in both education and health care, research on assessment has not kept pace with research on interventions. This gap persists even as research shows that parents, teachers, and youth disagree in their ratings.
To address this gap and understand these disagreements, Professor Andres De Los Reyes at the University of Maryland and Professor Elizabeth Talbott at William and Mary use innovative approaches, all guided by the Operations Triad Model (OTM). As a framework, the OTM allows researchers to account for the different perspectives of informants and the contexts where informants observe youth behaviour (i.e., in the home, school, and community). Recent research guided by the OTM gives professionals a vision and a method for using informant ratings to make decisions, especially when these ratings disagree. This is because the disagreements capture the unique nature of the perspectives from informants, depending on where behaviour happens. In surprising ways, disagreements among informants allow professionals to understand youth mental health.
The Impact of Attention Deficit Hyperactivity Disorder
ADHD is one of the most common diagnoses among children and youth, affecting around 10% to 12% of young students. According to the 2018 National Health Survey, the percentage of youth identified with ADHD has doubled over the last two decades. Symptoms can include talking too much, finding it hard to resist temptation, taking unnecessary risks, having trouble taking turns, and having trouble getting along with others. Children and youth with ADHD often experience complex problems that need comprehensive interventions at home and at school.
Team-Based Collaborative Care
Young people receive their ADHD diagnoses and evidence-based practices in healthcare settings. They also receive services in school. Yet, healthcare and school providers do not always share youth and family data. Professors Talbott and De Los Reyes proposed a team-based collaborative care model (TBCCM) to promote communication and collaboration among healthcare and education leaders to advance evidence-based assessment. Their model has three key features: (a) effective teamwork between leaders in health care and education, (b) the use of data from different informants (parents, teachers, and youth), and (c) the adaptation of evidence-based practices using those data.
Based on pioneering work conducted by their colleagues in pediatric health care, Professors De Los Reyes and Talbott anticipate that the TBCCM will improve the uptake of evidence in assessment by health care and education teams. The result will be a better understanding of youth mental health and better outcomes.
The Needs-to-Goals Gap
Sound assessment tools are essential for evidence-based practice within the TBCCM. Assessment involves gathering, interpreting, and using evidence to guide mental health services. This is the bedrock for evidence-based practices in youth mental health care.
Although collecting data from multiple informants is best practice in healthcare and education, professionals have little guidance on how to use these data, with disagreements among ratings playing a vital role in the need for guidance. The result is a Needs-to-Goals Gap that limits the quality of youth mental health services. To close this gap, Professors De Los Reyes and Talbott embrace (not erase) informant disagreements. When they account for the different perspectives of informants and the contexts where they observe behaviour, professionals can identify youth needs, establish goals for mental health, and find evidence-based practices to meet those goals.
Evidence-Based Assessment in Special Education
Gaps also emerge in the assessment of youth academic skills. Gaps occur when we don’t know where and how youth are struggling with what academic skills. Nor is there consistent empirical guidance about how to interpret results and make decisions when different academic data sources disagree. Guided by the previously mentioned OTM, Professors Talbott, De Los Reyes, and their colleagues advance EBA in special education research. The OTM framework helps investigators decide what domains to measure, how and when to measure them, and how to interpret results. The OTM and EBA work across special education, such as in reading for youth with dyslexia and EBA for English learners. To support researchers in using the OTM, the research team compiled a set of open data resources and articulated future directions for research.
Optimising Mental Health Assessment
We know that EBA in youth mental health must account for the different perspectives of informants and the contexts where informants observe youth behaviour (i.e., in the home, school, and community). Professor De Los Reyes and his team devised and tested CONTEXT―a methods-focused extension of the OTM―to increase the accuracy of data from multi-informant assessment. Whereas current approaches force researchers to assume that informant disagreements cannot contain useful information, CONTEXT provides users with an evidence-based approach to decide what combination of informant ratings best describes a young person’s mental health status. With CONTEXT, professionals boost the accuracy of informant ratings, thereby allowing them to understand the mental health of the youth they serve.
The Next Steps
Having developed, tested, and validated new approaches for making sense of mental health data, we are overdue to tackle the role of sound assessment in the mental health crisis. We must learn what professionals in the field are doing right now to serve the needs of children and youth. What informants do professionals use? Do they rely on one, two or three informants to understand the needs of youth? When do professionals use informants – at the beginning or throughout service delivery? We do not know.
To answer these and other questions, Professors Talbott and De Los Reyes seek funding for a national survey of youth mental health leaders in education and health care. These leaders guide intervention teams in making decisions for youth with a range of mental health problems – from externalising and internalising to symptoms of ADHD and ASD. How do they use informant data to make decisions for these youth? The answer to this question is key to understanding youth mental health and improving evidence-based practice. Evidence-based assessment is the first step to tackling the mental health crisis.
MEET THE RESEARCHERS
Professor Elizabeth Talbott
School of Education
William & Mary
Elizabeth Talbott obtained her BS in Psychology from Virginia Tech and MEd and PhD in Special Education from the University of Virginia. She serves as Associate Dean for Research and Faculty Development and Professor of Special Education at William and Mary. She is on the Board of Directors and a Founding Affiliate of the Alethia Society at the University of Virginia, and a consultant with the National Center for Leadership in Intensive Intervention at Vanderbilt University. During her well-published career, she has held positions at the University of Illinois at Chicago, University of Virginia Hospital, and Albemarle County Schools. Her areas of expertise are the use of evidence in assessment, intervention, and public policy for children and youth with mental health, learning and behavioural disabilities.
Professor Andres De Los Reyes
Department of Psychology
University of Maryland at College Park
Andres De Los Reyes received his PhD from Yale University in 2008. He is currently a Professor in the Department of Psychology at the University of Maryland at College Park and the Editor-in-Chief of the Journal of Clinical Child and Adolescent Psychology. During his career, he has received a number of awards, including a Presidential Citation from the American Psychological Association (APA) in 2021, and the Distinguished Scientific Award for an Early Career Contribution to Psychology from the APA in 2013. In 2022, he served as the Fulbright Canada Research Chair in Mental Health at the University of Regina. In his research, he seeks to understand why clinical assessments commonly produce discrepant results in estimates of clients’ mental health.
Mo Wang (University of Florida)
Matthew Lerner (Drexel University)
John Weisz (Harvard University)
Devin Kearns (University of Connecticut)
Jeannette Mancilla-Martinez (Vanderbilt University)
Thomas Power (University of Pennsylvania)
Jeremy Michel (University of Pennsylvania)
Andres De Los Reyes received support for the work described in this article from the Fulbright US Scholars Program (Fulbright Canada Research Chair in Mental Health) and the Institute of Education Sciences (R324A180032).
Elizabeth Talbott received support for this work from William and Mary’s Vision 2026 Faculty Innovators award.
A De Los Reyes, M Wang, MD Lerner, et al., The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation, Journal of Clinical Child & Adolescent Psychology, 2023, 52(1), 19–54. DOI: https://doi.org/10.1080/15374416.2022.2111684
E Talbott, A De Los Reyes, DM Kearns. et al., Evidence-Based Assessment in Special Education Research: Advancing the Use of Evidence in Assessment Tools and Empirical Processes, Exceptional Children, 2023, 89(4), 467–487. DOI: https://doi.org/10.1177/00144029231171092
A De Los Reyes, E Talbott, TJ Power, et al., Review The Needs-to-Goals Gap: How informant discrepancies in youth mental health assessments impact service delivery, Clinical Psychology Review, 2022, 92, 102114. DOI; https://doi.org/10.1016/j.cpr.2021.102114
E Talbott, A De Los Reyes, TJ Power, et al., A Team-Based Collaborative Care Model for Youth With Attention-Deficit Hyperactivity Disorder in Education and Health Care Settings, Journal of Emotional and Behavioral Disorders, 2021, 29(1), 24–33. DOI: https://doi.org/10.1177/1063426620949987
REPUBLISH OUR ARTICLES
We encourage all formats of sharing and republishing of our articles. Whether you want to host on your website, publication or blog, we welcome this. Find out more
Creative Commons Licence (CC BY 4.0)
This work is licensed under a Creative Commons Attribution 4.0 International License.
What does this mean?
Share: You can copy and redistribute the material in any medium or format
Adapt: You can change, and build upon the material for any purpose, even commercially.
Credit: You must give appropriate credit, provide a link to the license, and indicate if changes were made.
MORE ARTICLES YOU MAY LIKE
Exploring the complexities of residing in disaster-prone areas is challenging for individuals, businesses, and governments. Professor John Freebairn of the University of Melbourne is shedding light on this process, and notes that the benefits of living in disaster-prone areas often outweigh the potential risks. As governments intervene with financial incentives, infrastructure development, and regulatory measures, finding an appropriate balance between short-term relief and long-term resilience is crucial. Professor Freebairn considers the roles of government, information, insurance strategies, and subsidy consequences.
While individual national identities are typically conveyed using a single flag, some nationalists choose to express their identity with two flags. For instance, Christian nationalists in the USA and South Korea have started flying the Israeli flag beside their country’s national flag at right-wing Christian rallies or outside their homes. Dr Amílcar Antonio Barreto and HyungJin Kim, two researchers at Northeastern University, have recently carried out a study exploring the symbolic meaning of this double flag use among Christian nationalists.
In recent years, many European countries have introduced bans that limit or prohibit the use of religious face veils, which include the burqa and niqab. Dr Brenda O’Neill worked with colleagues to examine the role of feminist arguments amongst non-Muslim women in Quebec on the acceptability of wearing the niqab in public spaces. This work explored some additional attitudes underpinning these arguments, identifying how these also shape the diverse beliefs of Canadian women.
Professor Richard Collins – Dr Jintai Li | Project Super Soaker: Investigating High-altitude Polar Ice Clouds with Rockets
Phenomena in the upper atmosphere are difficult to study for several reasons – some rarely form, others are difficult to see, and all are incredibly high up. Polar Mesospheric Clouds (PMCs) are no exception, forming at around 80 kilometres up into the sky, only under specific atmospheric conditions, and only visible to the naked eye during twilight. PMCs are also called noctilucent or ‘night-shining’ clouds, as they appear to glow in the summer nighttime sky. Professor Richard Collins from the University of Alaska Fairbanks is using rockets to seed these clouds, allowing better investigations of both PMCs and the effects of space traffic on our upper atmosphere.