Having the correct lighting is an important aspect of video production, not only does it allow video creators to light the subject of the video correctly - ensuring the absence of distracting shadows or unnecessary reflections on reflective objects, it also allows content creators to convey the right artistic expression. The requirements of selecting the correct lighting temperature, strength (light intensity), and lighting effects are determined by the lighting arrangement and the way lighting is applied at the location, making it difficult to modify what has already been shot in post-production. Therefore, lighting modifications require reshoots, which require a lot of effort and cost.
For a typical video production involving a single subject, the lighting set-up is typically a three-point lighting arrangement to produce a three-dimensional (3D) lighting effect. This three-point lighting comprises the main light, fill light, and finally, background light.
This technology offer comprises a specialised lighting apparatus that constitutes a set of light emitters and light receivers, and matching/modelling software that maps the reflectance of the object and the background to allow lighting conditions to be changed post-production in a realistic manner, preserving the texture and natural lighting effect between the foreground and background. This technology makes it possible to create images as desired by the creator without the need for special equipment or knowledge of lighting, from a single specialised light.
Specialised Lighting Apparatus:
Matching and Modelling Software:
For video production, reflection maps and image data are recorded, and each is matched to enable virtual lighting. The procedure is as follows:
For 3D modeling, reflection maps and image data of the object and background are recorded, and each is matched to enable the simulation by matching the illuminance of the object and background. The procedure is as follows:
The expansion of video distribution services and social networking services has led to the diversification of video expression. There are limits to what can be expressed with a camera alone, and demand is increasing for expanded video expression through the use of lighting.
Compared to existing techniques that estimate illuminance from images, more accurate illumination data can be obtained by observing actual illuminance using special lighting. This allows arbitrary lighting effects to be added to the post-production of images, thus reducing the cost and man-hours required for reshoots. Additionally, no lighting expertise is required, allowing free-form lighting expression.
This technology also addresses the gap between product images that are captured for e-commerce products with the actual product. The technology's ability to naturally combine background lighting with subject lighting, combined with augmented reality (AR) technology, allows for an accurate reproduction of the product's appearance within the purchaser's environment, enabling an immersive experience. Additionally, when applied to second-hand products, surface defects such as stains, and scratches are made visible, ensuring that buyers are aware of such abnormalities when purchasing such items.
The technology owner is keen to collaborate with technology partners to manufacture the specialised lighting and develop a Software Development Kit (SDK) for the photometric stereo illuminance mapping technique that can be integrated into video editing software or ray tracing computation of three-dimensional (3D) spaces.