CognitiveEMS: A Cognitive Assistant for Emergency Medical Services

CognitiveEMS is a context-aware, augmented reality (AR), cognitive assistant system for cooperative situational awareness in medical emergencies deployed on Edge. CognitiveEMS integrates AR smart glasses and smartwatch devices with data analytics for real-time context inference based on multimodal sensor data (audio, video, hand motion) to provide just-in-time context-dependent feedback to responders during training. In this demo, a working prototype of the system with real-time streaming and processing of multimodal data during cardiovascular emergencies will be showcased. Preliminary results on real-time speech-to-text conversion, medical information extraction, and responder activity recognition will also be demonstrated.