✦
Summary
LightLab is a diffusion-based method for fine-grained, parametric control over light sources from a single image. It can change the intensity and color of visible light sources, the intensity of ambient lighting, and can insert virtual light source into the scene. The method uses the diffusion model's photorealistic prior to implicitly simulate complex light effects such as indirect illumination, shadows, and reflections, directly in image space, using paired examples depicting controlled illumination changes.
Key Features
Parametric control over light sources
Adjustable intensity and color of light sources
Insertion of virtual point lights
Control over ambient lighting
Physically plausible lighting edits
Self-occlusions and shadows simulation
Color Control feature
Lightswitch feature
About LightLab
LightLab enables a rich set of lighting controls that can be used sequentially to create complex lighting effects. Users can adjust the intensity and color of each light source by moving the sliders. The method generates physically plausible lighting edits across diverse settings, and outperforms existing methods quantitatively and based on user preference. By leveraging the linearity of light, LightLab disentangles a target light from the scenes ambient lighting, and then generates a parametric sequence of images with varying light intensities and colors.
LightLab provides several features, including Lightswitch, which gives parametric control over the intensity of light sources, and Color Control, which allows users to create colored illumination according to user input. Additionally, LightLab can insert virtual point lights (with no geometry) into the scene, and enables control over light that enters through windows, which is not easily controlled physically. The method also generates physically plausible lighting edits, including self-occlusions and shadows that match the lamps position and angle.
