DARPA Taps Raytheon Intelligence & Space to Create Life-savi
Stay informed with our
free newsletters

DARPA Taps Raytheon Intelligence & Space to Create Life-saving Medical Tool

  • AI combat medical assistant will guide field personnel in emergencies

The tool will:

  • provide real-time, hands-free guidance for 50-different medical procedures
  • increase proficiency and help reduce treatment errors in challenging environments
  • enable medics to focus their efforts using AI and Augmented Reality

A Raytheon BBN-led team will develop an artificial intelligence tool, Medical Assistance, Guidance, Instruction and Correction, or MAGIC, to assist combat field medics in 50 medical skills applied during common procedures. The medical assistant is being developed under a DARPA award.

To train the AI, the team will collect and label combat medical data sets comprising:

Soldier Modernisation - Market and Technology Forecast to 2030

Soldier Modernisation - Market and Technology Forecast to 2030

Market forecasts by Region and by System with subsegments by: Vision System, Body Protection System, C3 System, Power System, and Weapons. Technology and Market Overview, Impact and Opportunity Analysis, and Leading Companies Profiles

Download free sample pages More information
  • more than 2,500 videos recorded in stereo to provide 3D data.
  • nearly 50 million images to identify the correct sequence of procedures.

The tool will use DARPA Perceptually-enabled Task Guidance program’s consumer off-the-shelf augmented reality goggles, which harness the AI to use visual and audible sensors that track tasks and guide field medics in performing procedures correctly and efficiently. The built-in cameras of the AR goggles observe the user's actions, and AI verifies that steps are followed correctly, providing assistance—on request or when intervention is needed—in the form of auditory suggestions or visual overlays in the headset. Those prompts can include next steps, follow-on actions, or critical measurements such as elapsed time or dosing.

“The combat medical environment is challenging and chaotic,” explained Brian VanVoorst, Raytheon BBN scientist. “Our goal for the Raytheon BBN MAGIC AI tool is to help support personnel to provide guidance as needed without disrupting their concentration.”

Raytheon-BBN is teamed with Valkyries Austere Medical Solutions for this work.

The first demonstration of the new tool is planned in 18 months. Training data collected for the program will be shared with the research community.


Publishdate:
May 6, 2022
Raytheon Technologies Corporation
View original News release

DoD/VA & Government Health IT Fall Summit 2025

DoD/VA & Government Health IT Fall Summit 2025

Washington, DC
Oct 22 - 23, 2025

View agenda
Future Armoured Vehicles Survivability Conference 2025

Future Armoured Vehicles Survivability Conference 2025

London, United Kingdom
Nov 17 - 19, 2025

View agenda