The world is experiencing a mass shift to virtual technologies. As we migrate from physical to virtual presences, people across industries are becoming more aware of the possibilities and capabilities of immersive technologies, including the enhancement of training and simulation. While most of the world is still exploring the incredible potential of this technology to deliver a fully contextualized experience, the immersive technology industry is already moving quickly beyond the world’s current understanding. Various companies have been tackling large scale problems to enhance virtual and augmented reality. Specifically, a select few are creating immersive training and simulation solutions such as Head Mounted Displays (HMDs) that are operable in any environment, full body suits that are creating the ability to tracking your body in space, Brain Computer Interfaces (BCIs) that understand patterns in the human brain, and software creation engines that allow all of this to happen! For this discussion, we have brought together thought-leading technologists that are working within the art of the possible to introduce the next generation of enhanced immersive training capabilities.
[vc_video link=”https://www.youtube.com/watch?v=W0c5irggNG0&t=3033s” css=”.vc_custom_1587738464257{padding-top: 2rem !important;padding-bottom: 2rem !important;}”][vc_column_text]
Featured Speakers
Sebastian Loze
Simulations Industry Manager, Epic Games / Unreal Engine
Unreal Engine, Epic Game’s software creation platform, provides the ability to create interactive and immersive experiences. Unreal allows developers to digitally recreate real life experiences and exercises in virtual environments and are at the forefront of the life cycle of simulation.
Dimitri Mikhalchuk
Co Founder and Chief Revenue Officer, TESLASUIT
TESLASUIT’s revolutionary full body, sensor integrated suits create the ability to focus on creating realism with the interaction of physical elements of simulation. Taking it a step further, the technology is influencing neural elasticity, the amount of memory our brain will allocate to learning and training, which has never been done before! Humans’ pace of life is changing with the evolution of technology so that we now expect more efficiencies in the way we learn and train and the TESLASUIT is actively working on providing real solutions to meet those needs.
Adam Molnar
Co Founder and Head of Partnerships, Neurable
Neurable is one of the leading companies in neurotechnology working on BCIs, integrated with VR devices, and are creating ways to measure human cognitive performance which translates to immersive environments. Their team is working to quantify aspects of the cognitive experience in immersive simulation to understand human cognitive states that have been, historically, based on more qualitative and subjective means. The Neurable team is making large strides in building new systems to ingest and analyze attention, cognitive load and neural efficiencies to significantly enhance and personalize training.
Urho Kontori
Founder and Chief Product Officer, Varjo Technologies
Varjo offers a variety of incredibly capable products in virtual and mixed reality. Varjo was created with the goal of revolutionizing the training, simulation and design markets. The three pillars of focus for Varjo are:
Providing high resolution viewing experiences. Perfecting acute human eye resolution is key for virtual training and VR at large.
Eye tracking capability which allows gathering of analytics on passive viewing performance.
Mixed reality is the core at which the company continues to focus it’s effort. Their XR-1 allows for video passthrough MR and selective occlusion of the physical environment, hands, tools or other objects to be seen and interact with a virtual environment.
The combination of all of these technologies and capabilities allow for the creation of the ultimate immersive training environment.
Value of Immersive Technology
There are three key pillars for the value of immersive technology:
Significant cost savings,
A reduction in a timeframe to learn; broken down to receive, retain and deploy data, and
Ability to measure in an unprecedented capacity.
Beyond the initial, more obvious, values that immersive technology offers, companies like Varjo, TESLASUIT, Neurable and Unreal Engine are making incredible strides to advance immersive technology capabilities by providing even more value through intense data collection and analyzation that have never been achieved before the world of immersive technology. These capabilities will ultimately allow the simulation industry to spend less and get more out of training. Once we collectively arrive at the conclusion that immersive technology is a holistically better way to train, we can then advance the basis of the technology with capabilities such as those represented in this discussion. We can do things like map the body’s perfect motion through space, understand cognitive load, track and measure passive focal attention and even automate the training environment based on the combination of all of these factors.
Budget always becomes the driving force in simulation and, because of that, immersive training is the most obvious solution to curb budgetary constraints. In fact, many programs anticipate being able to cut their training costs significantly with the incorporation of immersive training. When it comes to cost savings and revenue generation for the industry, it starts with the software creation engines. One of the things that Epic Games did to reduce costs was to make their creation platform, Unreal Engine, free to developers to help incentivize creation and interaction between the community in order to spur faster innovation in immersive.
Personalized analytics is another big part of what these immersive enhancement companies are offering to advance training. As immersive technology companies, we constantly ask ourselves how we can act as an interpretation layer to feed into the training system in a manageable and understandable way. Handling a large amount of data has been tricky in the traditional simulation systems. We have a responsibility as leaders in the space to move beyond the raw data and numbers into discovering new findings and understandings to gather and interpret that information. To help facilitate this, the solution providers in this discussion are working to integrate with other hardware and software providers to make sure that users and developers are able to use the immersive reality tools of their choice to create the appropriate simulations for specific use cases. Monolithic solutions in simulation do not exist anymore so the industry needs to make sure to be inclusive of all the hardware and software solutions, in order for creators to be able to combine the best of these various solutions.
We traditionally learn with translation methods such as by reading text, watching video, viewing photos or lectured in a classroom environment. In doing this, the trainee will naturally fill in the gaps for how the information they are learning fits in with the actual context of a certain scenario. Immersive technology allows us to recreate that original context to get the most amount of fidelity and realism and to facilitate higher levels of comprehension and lower levels of distraction. The user is then able to recall that original context a lot faster and alot more accurately in their minds. We can recreate original context by keeping in the important aspects of the scenarios that allows users to learn and leave out aspects of original context that are distractions and limit our ability to learn. These attributes are significant enhancers to traditional means of learning and training.
Adaptive Virtual Environments
The industry has achieved the ability to give the users a realistic, embodied experience for the ultimate training tool. The teams in this discussion are working on ways to take these personalized experiences to new levels by automating the environment so it is objectively tailored to the user or trainee’s performance, with the ability to track, measure and manipulate cognitive state, focal focus areas at any given point in time and what the user is doing at any given point in time. Brightline Interactive’s Performance Adaptive Virtual Engine (PAVE) is enabling virtual training scenarios to be adaptive to a user’s active or passive performance. The simulation learns both the individual user behavior, as well as the trends of the collective so we can uncover aspects of training effectiveness that have not yet been addressed or answered. Cognitive human performance is a big focus within the Department of Defense. The understanding of an individual’s passive performance, combined with automated tailoring of training, has created opportunities to perfect individualized training at scale.
In addition to enabling better training for end users, with automated virtual systems, we are able to create next generation instructors by reducing manpower and logistics, and removing unnecessary distraction from the instructors. We now have the opportunity to bring instructors into the contextualized training experience in order to maximize instructor effectiveness of transitioning knowledge from one human to the next. The industry is helping instructors learn how to interact with these new tools and how to best use these tools to maximize impact.
There are significant ways that immersive technology will continue to enhance training and simulation effectiveness. Thanks to our guests on this episode of Pivot Fast, we will continue to push the boundaries of these capabilities to create robust, smart training systems.