DARPA Taps Raytheon Intelligence & Space to Create Life-savi
Stay informed with our
free newsletters

This news is classified in: Defense Cyber Defense / IT Soldier

May 6, 2022

DARPA Taps Raytheon Intelligence & Space to Create Life-saving Medical Tool

  • AI combat medical assistant will guide field personnel in emergencies

The tool will:

  • provide real-time, hands-free guidance for 50-different medical procedures
  • increase proficiency and help reduce treatment errors in challenging environments
  • enable medics to focus their efforts using AI and Augmented Reality

A Raytheon BBN-led team will develop an artificial intelligence tool, Medical Assistance, Guidance, Instruction and Correction, or MAGIC, to assist combat field medics in 50 medical skills applied during common procedures. The medical assistant is being developed under a DARPA award.

To train the AI, the team will collect and label combat medical data sets comprising:

Military Cyber Security Market Report 2024-2034

Military Cyber Security Market Report 2024-2034

Forecasts by Deployment Mode (Cloud-based, On-premise), by Component (Hardware, Software, Services), by End-user (Army, Navy, Air Force, Cyber Commands), by Security Type (Network Security, Endpoint Security, Application Security, Cloud-based Security, Data Security), by Solutions (Threat Intelligence and Response Management, Identity and Access Management (IAM), Intrusion Detection and Prevention Systems (IDPS), Security Information and Event Management (SIEM), Firewall, Other) AND Regional and Leading National Market Analysis PLUS Analysis of Leading Companies AND COVID-19 Impact and Recovery Pattern Analysis

Download free sample pages
  • more than 2,500 videos recorded in stereo to provide 3D data.
  • nearly 50 million images to identify the correct sequence of procedures.

The tool will use DARPA Perceptually-enabled Task Guidance program’s consumer off-the-shelf augmented reality goggles, which harness the AI to use visual and audible sensors that track tasks and guide field medics in performing procedures correctly and efficiently. The built-in cameras of the AR goggles observe the user's actions, and AI verifies that steps are followed correctly, providing assistance—on request or when intervention is needed—in the form of auditory suggestions or visual overlays in the headset. Those prompts can include next steps, follow-on actions, or critical measurements such as elapsed time or dosing.

“The combat medical environment is challenging and chaotic,” explained Brian VanVoorst, Raytheon BBN scientist. “Our goal for the Raytheon BBN MAGIC AI tool is to help support personnel to provide guidance as needed without disrupting their concentration.”

Raytheon-BBN is teamed with Valkyries Austere Medical Solutions for this work.

The first demonstration of the new tool is planned in 18 months. Training data collected for the program will be shared with the research community.


Raytheon Technologies Corporation
View original News release

Zero Trust Government Symposium 2024

Zero Trust Government Symposium 2024

National Harbor, MD
Jul 17 - 18, 2024

View agenda
Urban Operations Summit

Urban Operations Summit

National Harbor, MD
Jul 10 - 11, 2024

View agenda