Abstract illustration of two people and sinewaves and DNA strands

Diagnosing Autism More Precisely

At the Davis Institute for Artificial Intelligence, a postdoctoral fellow teams-up with a psychologist to build an AI tool to make autism diagnoses simpler
Words by Chuck Reece
Photographs by Ashley L. Conti
Illustration by Pamela Chavez
Would you like to win five bucks in a hurry? Bet a friend that tomorrow’s newspaper will contain at least one story about artificial intelligence. The rapid rise of chatbots like ChatGPT, from the San Francisco research company OpenAI, brought forth a hailstorm of news stories about AI—with most of them offering reasons we should worry about the technology.

But the people working inside Colby’s new Davis Institute for Artificial Intelligence are focusing more on opportunities to use AI to improve lives. When the institute opened two years ago, thanks to a $30-million gift from the Davis family and trustee of its charitable foundation, Andrew Davis ’85, LL.D.’15, it became the first cross-disciplinary institute for AI at a liberal arts college.

“One of the beauties of people who are trained in the liberal arts is that they really understand how to come at a problem from multiple, different angles,” President David A. Greene told National Public Radio after the institute opened. “I think the more that we have people who are coming from liberal arts backgrounds, who are really raising the kind of questions that will ultimately shape AI in more positive ways, the better off we’ll be.”

The Davis Institute for Artificial Intelligence has become the home of intense interdisciplinary collaboration. Approximately 25 percent of faculty representing all four academic divisions teach AI courses that reach close to 20 percent of the student body, and the institute hosts scholars, speakers, and events.

Students who come from a liberal arts background “are really raising the kind of questions that will ultimately shape AI in more positive ways.”
— President David A. Greene
Tahiya Chowdhury
Above: Tahiya Chowdhury, the first postdoctoral fellow at the Davis Institute for Artificial Intelligence, said AI can help psychologists make more accurate diagnoses of children on the autism spectrum.
Students at demonstration at Davis Institute for Artificial Intelligence
Above: Since its inception, the Davis Institute for Artificial Intelligence has become the home of intense interdisciplinary collaboration. Approximately 25 percent of faculty representing all four academic divisions teach AI courses that reach close to 20 percent of the student body, and the institute hosts scholars, speakers, and events. Here, students come together for a demonstration about the future of AI.
The Davis Institute for Artificial Intelligence is the first cross-disciplinary institute for artificial intelligence at a liberal arts college. The institute was made possible by a $30-million gift from the Davis family and a trustee of its charitable foundation, Andrew Davis ’85, LL.D. ’15. Directed by computer scientist and natural-language processing specialist Amanda Stent, the institute supports interdisciplinary, human-centered scholarship and prepares students to be informed AI tool users and builders for a future where AI transforms industries, careers, creativity, and modes of discovery. Before joining Colby, Stent served as the natural language processing architect at Bloomberg L.P., and she is a leading authority on NLP, the branch of artificial intelligence that provides computers with the ability to understand human text and spoken words. Stent has authored or co-authored more than 100 papers on natural language processing, regularly speaks on the topic, and is co-inventor on more than 30 NLP-related patents.
Tahiya Chowdhury is Davis AI’s first postdoctoral fellow, a position that enables her to conduct research, consult with Colby faculty, staff, and students, and teach hands-on AI. She has been working with 2022-23 Faculty Fellow and Assistant Professor of Psychology Veronica Romero ’09, a psychologist studying how children are diagnosed on the autism spectrum. The two are building technology to help psychologists make accurate diagnoses, and their work is an example of how the institute is trying to use artificial intelligence in a positive way to improve the world.

When psychologists attempt to determine whether a child is autistic, Chowdhury said, “There is no physical test, there is no chemical test you can perform. All you look for is behavioral markers.”

AI, Chowdhury said, can help psychologists identify more of those behavioral markers and make more accurate diagnoses. And incorporating AI into the diagnostic process will allow psychologists to focus more intently on their young patients.

“The way autism is now diagnosed is psychologists give the children or the individuals being tested a couple of questions or tasks,” she said. “They need to look at how the individuals respond to these tasks. So that means they have to look at what they’re saying, how they’re saying it, and how they’re expressing their emotions. The psychologists are making notes at the same time. It’s cognitively demanding. My hope is, through the type of work that I’m interested in, we will help augment the practitioner’s work.”

In short, practitioners could rely on AI to catch what they might miss in that scenario. Davis AI Director Amanda Stent elaborated.

“The psychologist who does the conversation has to do four things at once, which is three too many,” Stent said. “They have to conduct the conversation in the structure that is given to them by the diagnostic manual. They have to take notes on the conversation. They have to monitor themselves and their own behaviors. And they have to monitor the child’s behavior and attempt to make a diagnosis.”

Chowdhury and Romero are working together to build an AI tool that will automatically analyze the video recordings of the conversations. The idea is that an AI tool could do the note-taking and record the behaviors, allowing the psychologist to focus on the conversation.

Romero has worked with children and adolescents with autism spectrum disorder since 2013. Her dissertation research investigating the “Computational Measurement of Social Communication Dynamics in Adolescents with Autism Spectrum Disorder” was funded by a predoctoral fellowship from the National Institutes of Health.

For years, she has focused on improving the demanding diagnostic process by finding ways to automate certain aspects to lighten the cognitive load of clinicians. Romero began thinking about incorporating AI tools while working at the Davis Institute for AI as one of its first sabbatical fellows.

The collaboration with Chowdhury has led to publications and a fall workshop, Connecting Multiple Disciplines to AI Techniques in Interaction-centric Autism Research and Diagnosis.

Romero is reaching out to the autism community in Maine and recruiting to further these efforts in her research. If you or someone you care about has autism and would like to discuss Romero’s research, please contact her at veronica.romero@colby.edu.