← Projects

Virtual Pedagogical Agents

Overview

A $450K DoD/NSF-funded Mixed Reality and AI platform for microelectronics education. Students engage with 3D models of chip packaging structures through interactive learning modules—toggling component visibility, scaling objects for inspection, and completing assembly exercises to build understanding of semiconductor architectures.

A GPT-powered virtual tutor provides real-time, context-aware assistance throughout the learning experience. This work spawned the PATHS program at UF, helping autistic adults pursue microelectronics career opportunities.

Research

PC users showed stronger immediate knowledge acquisition (89% vs 73% normalized gain), while MR users demonstrated more stable six-week retention with higher engagement. GPT chat significantly improved social presence, perceived knowledge gain, and quiz performance.

A scoping review synthesized 54 studies on AI and XR for personalized learning, identifying gaps in multimodal input, long-term assessment, and learner profile integration.

Key Features
Technical

Built in Unity 2022.3.40f with XR Interaction Toolkit v3.0.7 and XR Hands v1.4.3. 3D models created in Maya. Fine-tuned CustomGPT models trained on microelectronics data. Deployed on Meta Quest 3 and WebGL.

Publications
Partners