CAMBRIDGE, Mass. – A Raytheon BBN-led team will develop an artificial intelligence tool for combat field medics, the company announced.
The Medical Assistance, Guidance, Instruction and Correction tool will assist combat field medics in 50 medical skills used in common procedures. The tool is being developed with the help of a Defense Advanced Research Projects Agency award.
To train the tool, the Raytheon team will collect and label combat medical data sets including more than 2,500 videos recorded in stereo to provide 3D data. The team will also collect nearly 50 million images to identify the correct sequence of procedures.
The tool will use the DARPA’s Perceptually-enabled Task Guidance program’s augmented reality goggles, which harness artificial intelligence to use visual and audible sensors that track tasks and guide field medics in performing procedures correctly and efficiently. The goggles’ built-in cameras observe the user’s actions, and artificial intelligence verifies that steps are followed correctly, aiding in the form of auditory suggestions or visual overlays in the headset.
Raytheon-BBN is teaming with Valkyries Austere Medical Solutions on the project.