Broadcast Tech calls GhostFrame one of the highlights of NAB 2023

GhostFrame showing how it hides live video in LED walls that’s invisible to the eye yet visible through a camera

According to Broadcast Tech, one of the highlights of NAB 2023 was GhostFrame showing how it hides live video in LED walls that’s invisible to the eye yet visible through a camera.

GhostFrame used NAB 2023 to demonstrate how it enables multiple backgrounds to be captured at the same time during virtual production shoots. GhostFrame makes it possible for numerous backgrounds to be filmed live simultaneously, while the actors only see a single background on the LED Volume Stage display. The additional backgrounds are ‘hidden’ in the display, using a blend of patented technology, software and hardware components from GhostFrame founders – AGS, ROE Visual and Megapixel VR. Together, the technology combines hidden chroma key compositing, hidden tracking, and multiple source video feeds into a single production frame.

The creative team chooses which elements are visible to the human eye on the LED Volume Stage and which backgrounds are visible only to the camera. At NAB 2023, GhostFrame demonstrated four different backgrounds being captured simultaneously – one showing a car driving in the daytime down the Las Vegas strip, another showing a car driving down the strip at night, a third video showing an expansive desert backdrop and a fourth feed capturing the actor in front of a green screen display. Mirrors in the studio, and other metallic objects in the foreground showed real-time reflections of the different backgrounds, so each of the four scenes being captured looked exactly as they would do in a normal virtual production shoot.

From a technical point of view, GhostFrame works through advanced nanosecond alignment of video subframes and the camera shutter. By controlling the LED panel's subframe output, cameras can align the shutter angle and capture the desired moment in time within a frame.

Peter Angel of GhostFrame partner AGS, told Broadcast Tech at NAB 2023: “Some of the potential applications for GhostFrame include enabling multi-camera broadcasts from a virtual production environment; regionalisation, where different languages and brands are displayed depending on the territory; a plethora of creative effects and options in both virtual production and live events; and to capture a greenscreen version for everything that’s shot, providing complete flexibility for the production.”