United States

Military healthcare training is a complex endeavor, combining a variety of instructional techniques and training technologies. Augmented and virtual reality hold the promise of advancing healthcare training, improving learning outcomes, and increasing student immersion and engagement. This presentation will focus on research efforts in the areas of human computer interaction, haptics, and augmented reality applications for healthcare training. Challenges in this area will be highlighted, along with avenues of future research.

TEAR 3M 2021

Virtual and Augmented Reality for Military Healthcare Training

healthcare; medical; training; haptics; interface

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

Technology Transfer, or T2, is the intentional sharing of knowledge, expertise, facilities, equipment, and other resources for application to military and nonmilitary systems. In this session, the NIWC Pacific T2 Office will provide a short T2 overview brief to create a better understanding of T2, enabling more successful partnering opportunities. The brief will open with a brief history of T2, T2’s role, and how a number of the “how to work with the government” briefs are connected by, or leverage, T2. The second part of the brief will describe relevant T2 tools, namely agreements NIWC Pacific uses to conduct T2, highlighting the salient points that may help you work with the federal government.

NIWC Pacific Technology Transfer Brief

We will present a unified authoring system that enables non-technical SMEs to capture knowledge of facilities, equipment and processes to produce digital twins for personalized training on both VR and AR devices. Our approach leverages recent advances in AI (vision and language) with the goal of improving time, cost and quality of content development while substantially expanding SME participation and efficiency.

Authoring tools for AR/VR Enabled Personalized Training

The affordances of augmented and virtual reality are being leveraged through a tool, zSpace, to deliver learning experiences for schools, business, and indiustry. By using zSpace, learners are able to do things that would otherwise be too dangerous, impossible, counterproductive, and/or expensive to do. Further, the results of integrating a collaborative AR/VR tool will be examined.

Breaking Barriers: Learning through AR/VR Experiences

Current large-scale live military training exercises leverage notecards (MILES casualty cards) to preset injuries for medics to respond to. To add realism to the medic training environment, a Modular Multimodal Casualty State and Care Toolkit was developed to present realistic medical scenarios to medics when injuries are sustained in training exercises. The system consumes injury and shot data from a training network, translates those to injuries to patients, creates a realistic physiology model of that patient to present to medics and allows them to treat injuries using augmented reality medical equipment. The system supports all stages of medic training from bag loadouts to individual and group-based after-action review. The Hololens-based AR training system will be presented to demonstrate guided learner modes (walk phase), field scenario mode, and after-action review. This work is funded under contract W81XWH19C0015 (COR Lee Sciarini, PhD, MSC USN)

Augmented Reality Medical Training for Field Exercises and Beyond

The SBIR/STTR is a robust program designed to help small businesses address government needs while promoting commercialization. This session is dedicated to providing a primer on the program with tips on getting involved and getting engaged with the Naval Information Warfare Systems Command (NAVWAR).

NAVWAR SBIR/STTR Program Overview

David Watters and Anthony Duca discuss the different technologies and methods used to rapidly scan objects, spaces, and larger geographies into a virtual space for remote, real-time collaboration, with full spatial co-presence, for planning, training, and visualization using Desktop 3D, XR headsets, and mobile solutions.

Transform How You Plan: Rapid Scanning and Collaborative XR Visualization

Once an augmented reality strategy is selected, it is critical that early deployments are successful in order to reach scale. This presentation will share best practices that Scope AR has deployed with their customers in a prescriptive way, in order to manage expectations, and successfulle reach the desired outcomes.

Flattening the HypeCycle With AR

The Virtual Equipment Environment (V2E) is a government-owned (GOTS) parts assembly and disassembly engine that allows us to easily virtualize your existing CAD models, tech manuals, or training material into a virtual immersive trainer.



NIWC Pacific, BEMR Lab:” Virtual Equipment Environment (V2E)”

HyperTunnel® is a mixed reality (MR) remote collaboration system that enables front-line workers to summon an expert in a different location into a real time, immersive and shared digital twin to collaborate, provide guidance and instructions on the task at hand. The system also serves as a training and simulation environment. 

The solution provides the following capabilities: 
• Scan Remote Worksite: Leverage input from scanners, cameras, microphones and other sensors that might be available at the remote worksite.
• Create Digital Twin at HQ: captured data is used to reproduce a real-size immersive digital representation of the worksite at a central location.
• Match / Enhance shared Scenes: AR remote worksites and VR digital twins are synched, tracked and enhanced by AI focusing on relevant objects and actions.
• Annotate and Demonstrate: Immersed users can place virtual objects and annotations, provide guidance and demonstrate actions in the shared space.

HyperTunnel - Teleporting Expertise Anywhere

The DoD and its branches face a convergence of challenges. As trusted career experts and depot artisans retire in increasing numbers, product variety and complexity accelerate. Traditional methods for scaling expertise are no longer sufficient. But there are companies who are innovating—overcoming these challenges to increase service quality and efficiency. How are they doing it?

Premium content

Downloads

Next from TEAR 3M 2021

NIWC Pacific Technology Transfer Brief

Similar lecture

VE Mentor: A Mixed-Reality Training System with a Secure Cloud Solution