« return to case studies list

Video See-Through for Out-the-Window Simulation


Application:Out-the-Window Simulation
Equipment:nVisor SX, InertiaCube 2 head-tracker, custom video hardware
Provider:MOVES Institute at the Naval Postgraduate School
HMD mounted camera captures cockpit interior with blue screens over window, then video mixing chroma-key hardware injects virtual images over blue areas for OTW simulation.

Students and faculty at the MOVES Institute at the Naval Postgraduate School in Monterey, Ca. are using head mounted display technology to evaluate a novel appended training system. The system uses chromakey-based augment reality to turn any vehicle into a training platform. The vehicle?s (in this case a helicopter?s) windscreen is covered with chromakey material. A camera mounted on an HMD worn by the trainee provides the chromakey foreground image. This image is mixed with a computer generated scene. The computer generates the scene based on a tracker that sense the direction the operator is looking. Areas in the camera image that match the chromakey color (the windscreen, or out the window view) are replaced with the computer generated imagery. This composite image is then display to the operator in the HMD. When the operator looks out the vehicle?s window he sees a computer generated environment. Everything else in the operator?s view appears as it normally would. A brief Flash presentation that includes a video of the system in operation can be found here: http://www.nps.navy.mil/cs/ research/vehelo/vehelodemo2.swf.

Click here for more information about the nVisor SX60.

« return to case studies list