CognitiveEMS: A Cognitive Assistant for Emergency Medical Services

University of Virginia
Table #11
Day 1: Technology Demonstrations | 25-Jun-2024 | 3:30 pm
Day 2: Breakout Sessions and Technology Demonstrations | 26-Jun-2024 | 4:00 pm
Day 2: Morning Technology Demonstrations | 26-Jun-2024 | 8:00 am
Day 3: Afternoon Technology Demonstrations | 27-Jun-2024 | 4:00 pm
Day 3: Breakout Sessions and Technology Demonstrations | 27-Jun-2024 | 10:45 am
Day 3: Morning Technology Demonstrations | 27-Jun-2024 | 8:00 am

CognitiveEMS: A Cognitive Assistant for Emergency Medical Services

Imperial Ballroom

CognitiveEMS is a context-aware, augmented reality (AR), cognitive assistant system for cooperative situational awareness in medical emergencies deployed on Edge. CognitiveEMS integrates AR smart glasses and smartwatch devices with data analytics for real-time context inference based on multimodal sensor data (audio, video, hand motion) to provide just-in-time context-dependent feedback to responders during training. In this demo, a working prototype of the system with real-time streaming and processing of multimodal data during cardiovascular emergencies will be showcased. Preliminary results on real-time speech-to-text conversion, medical information extraction, and responder activity recognition will also be demonstrated.