Optical positional tracking for goggles uses a camera (or cameras) and a known set of markers to determine the position of the camera relative to the markers. Positional tracking can be done using the visible spectrum but is more commonly done using infra-red markers and a camera that is sensitive to IR light.
There are two main options:
- Inside-out tracking: where the camera is based on the goggles and the IR markers are placed in stationary locations (e.g. on the computer monitor, on the wall, etc.)
- Outside-in tracking: where the camera is placed in a stationary location and the IR markers are placed on the goggles.
|Sensics dSight panoramic HMD with IR targets for “outside in” tracking|
How do these approaches compare?
- Tracking volume: in both cases, at least some of the targets need to be visible to the camera. When the user rotates the head, an “inside-out” system needs targets that are physically far apart. If the targets are, for instance, placed on the bezel of a notebook PC, it is easy to see how head rotation could easily take these targets out of the field of view of the camera. A wider lens could be used in the camera, but this would reduce the tracking precision as each camera pixel would now cover a greater physical space in the world. In the “outside-in” system, targets could be placed on most sides of the goggle, allowing reasonably large rotation while still having targets visible on the camera. Advantage: outside-in
- Tracking inside an entire room: if we want to allow mobility within a room, an ‘inside-out’ system would require additional markers on the walls, whereas an ‘outside-in’ system would require additional cameras. Both systems would require room calibration to make sure the target and/or cameras are placed in a known position. Additional cameras require additional processing power. Slight advantage: inside-out
- Where is data being processed? In “inside-out’ tracking, the camera data is either processed on the goggle or the camera is connected to a computer that is either carried by the user or stationary and connected via a wire. In ‘outside-in’ tracking, the data is processed on a computer that could be stationary. Advantage: outside-in
- Can this be used with a wireless goggle? If the goggle is not tethered to a computer, “inside-out” tracking requires that the data is either processed locally or that the camera signal is sent wirelessly to a base station. In contrast, an ‘outside-in’ approach does not require wireless data of the camera. At most, a synchronization signal can be sent to the IR LEDs to make sure they flash in sync with the camera. Advantage: outside-in
- Ability to combine with augmented reality system. Sometimes, the goggle will already have an on-board camera (or cameras) for the purpose of augmented reality and/or 3D reconstruction. In that case, using the same camera for positional tracking may have some cost advantages if positional tracking can be used with visible targets or if the camera already has IR sensitivity. Advantage: inside-out
What has been your experience?