People Occlusion Beta segments people in real time for collaboration within virtual settings. Understand gains and limits in multi-user training.
Direct answer
Varjo Base 4.16 People Occlusion Beta uses AI segmentation to display real team members over a completely virtual environment. The feature can improve coordination and safety in in-person training, but still requires validation of contours, depth, latency and lighting.
What is People Occlusion?
Version 4.16 of Varjo Base introduced AI segmentation in beta that identifies people seen by the XR-4 cameras and composes them over the virtual scene. The proposal is to allow nearby participants to remain visible without rebuilding the entire physical environment.
Why face-to-face collaboration matters
Instructors and peers use gestures, body positioning, and eye contact to coordinate activities. In fully enclosed VR, these signals disappear. Reintroducing people can reduce collisions and make it easier to navigate side-by-side tasks.
Occlusion is a spatial problem
A convincing visual cut needs to respect who is in front of and who is behind virtual objects. Unstable contours, delay or incorrect depth break presence and can confuse actions. Hair, tools, and similar clothing in the background are important test cases.
How to evaluate a pilot
Test lighting, distance, number of people, fast movement and objects in hands. Measure perceived latency, segmentation errors, and impact on task completion. Maintain a safe mode in case the person is no longer detected.
Nexus Reading
The border between VR and reality becomes more selective. Instead of choosing virtual everything or full passthrough, companies can reveal only the people essential to the task, preserving focus without isolating the team.
FAQ
Does the resource show the entire real environment?
No. The proposal is to segment people and insert them into the virtual scenario.
Is it available in final production?
Varjo presents it as a beta in Varjo Base 4.16.
Need to change the application?
Varjo reports operation via Varjo Base, without a customized API in the application for the mode described.
Essential guides to delve deeper into the decision
This editorial analysis was produced by Nexus from the official sources below, consulted on September 7, 2026. The text is original and interprets practical implications for companies.
- Varjo — Using AI to see your crew in VR: functioning, availability and declared uses of People Occlusion Beta.
- Varjo — Varjo Base release notes: official record of software versions and limitations.
Date reported by the main source: July 2, 2026.