Masking

Masking page contains all mixed reality masking related options.

• Type
  • Can be used to select which masking setup will be used to merge mixed reality image together with the VR image.
  • Depending on the selected type, other options for the specific masking setup will be available
  • Overlay
    • Places the mixed reality image in front of the VR image, so the mixed reality image will always be visible. This will show the full mixed reality passthrough image inside the headset.
  • 3D mesh
    • Uses a custom 3D mesh placed in the virtual space (relative to tracking origin) for mixed reality masking.
    • All parts of the 3D mesh will be filled with the mixed reality image, while the surroundings will be filled with the VR image.
    • 3D Mesh File
      • Shows path to the selected 3D mesh file.
      • If no 3D mesh file is selected, only the VR image will be shown inside the headset.
      • Clicking the Select button will allow you to select a custom 3D mesh file from your PC.
        • Only .obj or .fbx file formats are supported.
        • The 3D mesh file should only contain triangulated mesh objects, and it should not contain any material or texture information.
      • Clicking the Reload button will reload the currently selected 3D mesh file. This should be used if the 3D mesh file content was changed outside of the running VR application.
      • Clicking the Delete button will delete saved path to selected 3D mesh file (this will not delete the 3D mesh file from your PC).
    • Show Mesh
      • Can be used to show a simple visualization of the currently used 3D mesh.
      • Mesh visualization will only be visible when the mixed reality itself is enabled.
      • By default only a wireframe visualization of mesh edges will be shown, but if the Fill Mesh option is also selected the full mesh will be displayed instead.
    • Fill Mesh
      • Show full mesh visualization instead of default wireframe visualization,
      • This option is only available when Show Mesh option is selected.
    • Mesh Color
      • Can be used to change color of the 3D mesh visualization.
    • Adjustment
      • Can be used to change position, rotation, and scale of the 3D mesh (relative to tracking origin).
      • Restore Defaults button can be used to reset all offsets to their default values.
    • Tracking
      • Can be used to utilize a secondary SteamVR/Lighthouse tracker for 3D mesh position tracking.
      • When this option is enabled you can select Lighthouse Tracker ID from a list of all available SteamVR trackers.
      • The origin of the 3D mesh will then be relative to the position of the selected tracker, any Adjustment offsets will also apply.
  • Background
    • Places the mixed reality image behind the VR image.
    • Requires using a compatible VR application with see-through parts of the virtual image (for example an OpenXR application utilizing the OpenXR alpha blend mode).
• Chroma Key
  • Uses a specified color of the mixed reality image for chroma key masking.
  • Only parts of the mixed reality image which fit the specified color will show the VR image, other parts will only show the mixed reality image.
  • This option can also be combined with 3D mesh mask or with the background mask, in those cases chroma key algorithm will only be applied on the mixed reality image inside the mask.
  • Color
    • Can be used to select a custom specific color for the chroma key masking.
    • Clicking the Load button will allow you to load a previously saved color from a file on your PC.
    • Clicking the Set button will allow you to select a custom color manually.
    • Clicking the Save button will save the currently used chroma key color into a .color file, so it can be loaded later.
  • Hue Tolerance
    • Can be used to adjust the hue tolerance of the chroma key algorithm.
    • If this option is set to higher values, the chroma key algorithm will use a bigger range of color hues around the specified color for masking.
  • Saturation Tolerance
    • Can be used to adjust the saturation tolerance of the chroma key algorithm.
    • If this option is set to higher values, the chroma key algorithm will use a bigger range of color saturations around the specified color for masking.
  • Value Tolerance
    • Can be used to adjust the value tolerance of the chroma key algorithm.
    • If this option is set to higher values, the chroma key algorithm will use a bigger range of color values around the specified color for masking.
• Inverted Chroma Key
  • Uses a specified color of the mixed reality image for inverted chroma key masking.
  • Only parts of the mixed reality image which fit the specified color will be visible, other parts will only show the virtual image.
    • For example for physical cockpit scenario, this can be used to visualize pilots’ hands based on color even when they are located outside of the masked cockpit.
  • This option is currently only available when 3D mesh masking type is selected.

This page was last modified on February 2nd, 2026 at 17:37

< PreviousNext >