Quest Visual Sources

Passthrough visibility is not the same thing as camera access.

Rusty XR keeps Meta Quest compositor passthrough, app-visible camera frames, environment depth, scene understanding, MediaProjection, and operator casting in separate buckets. That separation keeps public examples honest about what an app can render, sample, measure, or merely inspect.

The Core Split

A normal Meta passthrough layer is a runtime/compositor-owned layer. Apps can request it, place it in the composition order, and apply documented style parameters, but that does not make the final eye-aligned passthrough image a sampleable app texture.

Raw camera paths are different. Camera APIs can expose frames, timestamps, intrinsics, and pose metadata for custom overlays or computer-vision work. Those frames still have to be aligned, projected, and validated by the app.

Why Rusty XR Carries This

Rusty XR owns the public contracts and examples that need this vocabulary: passthrough style descriptors, camera metadata, depth-frame descriptors, MediaProjection boundaries, diagnostic scorecards, and companion-tool handoffs. Downstream apps keep private renderer behavior and device-specific tuning.

Source Classes

SourceWhat it providesWhat it does not provide
Native compositor passthroughA runtime-owned mixed-reality background layer with documented style controls.Raw or final passthrough pixels for app shaders.
Passthrough Camera / Camera2-style APIsApp-visible camera frames plus metadata when permission, device support, and policy allow it.The already-warped user-facing compositor view.
Environment depthRuntime-generated depth texture and per-frame metadata for occlusion, grounding, and diagnostics.Raw depth-sensor feeds or private compositor fusion buffers.
MediaProjectionA consented final-display stream for inspection, debugging, or companion tooling.Raw stereo camera streams or a privileged compositor hook.
Casting, scrcpy, and screenrecordOperator-visible evidence of what reached the display path.Calibration-grade camera, depth, or pose data.

Public Claim Rules

  • Say "runtime/compositor passthrough" when the app is submitting a passthrough proxy layer.
  • Say "raw camera" only when the app receives sampleable frames and metadata.
  • Say "environment depth" when the data comes from the public depth API contract.
  • Say "final-display inspection" for MediaProjection, casting, screenrecord, or companion streams.
  • Treat patents and view-synthesis papers as design context, not proof of a shipped runtime implementation.

References

ReferenceRole
Meta native Android mobile passthroughOfficial compositor-passthrough developer surface.
Khronos XrCompositionLayerPassthroughFBOpenXR passthrough composition-layer contract.
Meta Passthrough Camera API overviewOfficial app-visible camera-access surface.
Meta Depth API overviewOfficial public environment-depth surface.
Chaurasia et al., Passthrough+Public view-synthesis context for camera-to-eye passthrough reconstruction.
NeuralPassthroughAdjacent learned view-synthesis context, not a runtime disclosure.