Reference Number: ARL-SRP-00076
Project Description
This summer project will explore how human data can provide useful grounding for agentic artificial intelligence (AI) systems. Agentic AI systems can plan, reason, use tools, and take actions in support of human users; however, their effectiveness often depends on understanding the user’s current situation, environment, goals, attention, and intent. This project will investigate how data generated by or collected from people—such as gaze, gestures, speech, text, movement, physiological signals, first-person video, and interactions with the environment—can improve an agent’s contextual awareness.
The student will identify representative use cases and develop prototype agent workflows that incorporate one or more human-sensed data streams. The project will assess how these inputs can help an AI agent interpret user needs, ground language or task instructions in the surrounding environment, and provide more timely and relevant assistance.
Expected deliverables include a use-case assessment, prototype demonstration, and recommendations for future context-aware agent development.
Technical Skills
- Advanced Sensing
- Augmented Reality/Virtual Reality
- Data Analysis
- Data Science
- Human Factors Engineering/Human Systems Integration
- Natural Language Processing
- Computer Science
- Computer Modeling/Simulation
- Python, MatLab, 3D data analysis and modeling
