A Screen-Based Multimodal Virtual Classroom Interface for Understanding Behavioral Sensory Responses in Autistic Adolescents: A Pilot Study.

Researchers created a computer screen system that simulates a classroom environment to study how autistic teens respond to different sights, sounds, and touches. All 26 participants (9 autistic, 17 non-autistic teens) found the system comfortable to use. The study found clear differences in how autistic teens looked at the screen, moved their hands, and coordinated their eyes and hands compared to non-autistic teens. These differences were linked to their sensory sensitivities.

This pilot study developed and tested a screen-based Multimodal Virtual Classroom Interface (MVCI) to assess sensory responses in autistic adolescents. The system delivers controlled visual, auditory, and tactile stimuli mimicking classroom environments without the discomfort of head-mounted VR devices. Testing with 9 autistic and 17 typically developing adolescents showed 100% system acceptance. Significant behavioral differences were observed between groups in eye gaze patterns, fine motor movements, and eye-hand alignment.

Behavioral responses correlated strongly with participants' sensory profiles and ADHD symptoms. A novel predictive modeling framework achieved 97-98% accuracy in forecasting participant performance based on behavioral data.

Screen-based VR systems may offer accessible alternatives for sensory assessment in autism. Objective behavioral measures could complement traditional sensory evaluations. The technology shows promise for developing personalized interventions, though larger validation studies are needed before clinical implementation.

Very small sample size (9 autistic participants) limits generalizability. Pilot study design provides preliminary data only. No control for medication effects or co-occurring conditions mentioned. Short-term assessment may not reflect sustained behavioral patterns.

Autism impacts at least 1 in 100 children worldwide, with about 90% experiencing sensory processing difficulties. Virtual Reality (VR), which can precisely deliver controlled sensory stimuli, has emerged as a promising tool for studying sensory experiences. However, VR systems using a head-mounted display may cause discomfort and exacerbate sensory challenges for autistic children. Screen-based VR could offer a viable alternative, but research on designing multimodal sensory delivery systems that simulate real-life experiences remains limited.

As a result, the impact of on-screen VR on children's behavioral sensory responses is not well understood. Therefore, as a pilot study to fill this gap, we designed a novel screen-based Multimodal Virtual Classroom Interface (MVCI) system. MVCI was designed to deliver well-controlled visual, auditory, and tactile stimuli that closely mimic a real classroom environment. The pilot study involved 9 autistic adolescents and 17 typically developing (TD) adolescents, all of whom reported 100% acceptance of the system.

Quantitative behavioral analysis demonstrated that, even with the small sample size, the on-screen interaction showed significant differences ( ${p} \lt 0.05$ ) between the two groups in terms of eye gaze, fine motor movements, and eye-hand alignment. Additionally, several behavioral patterns were strongly correlated with participants' sensory profiles and ADHD symptom severity ( ${p} \lt 0.05$ , ${r}_{s}$ >0.7). Using a novel Fixation Sequence Modeling (FSM) framework, we were able to predict participants' near-future performance with high accuracy (97-98% proximity) based on their granular behavioral responses.