Research Output

From Faces to Outdoor Light Probes

  Image‐based lighting has allowed the creation of photo‐realistic computer‐generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer camera, without specialized calibration targets or equipment. Our insight is to use a person's face as an outdoor light probe. To estimate HDR light probes from LDR faces we use an inverse rendering approach which employs data‐driven priors to guide the estimation of realistic, HDR lighting. We build compact, realistic representations of outdoor lighting both parametrically and in a data‐driven way, by training a deep convolutional autoencoder on a large dataset of HDR sky environment maps. Our approach can recover high‐frequency, extremely high dynamic range lighting environments. For quantitative evaluation of lighting estimation accuracy and relighting accuracy, we also contribute a new database of face photographs with corresponding HDR light probes. We show that relighting objects with HDR light probes estimated by our method yields realistic results in a wide variety of settings.

  • Type:

    Article

  • Date:

    22 May 2018

  • Publication Status:

    Published

  • Publisher

    Wiley

  • DOI:

    10.1111/cgf.13341

  • ISSN:

    0167-7055

  • Library of Congress:

    QA76 Computer software

  • Dewey Decimal Classification:

    006.6 Computer graphics

  • Funders:

    The Walt Disney Company Ltd

Citation

Calian, D. A., Lalonde, J., Gotardo, P., Simon, T., Matthews, I., & Mitchell, K. (2018). From Faces to Outdoor Light Probes. Computer Graphics Forum, 37(2), 51-61. doi:10.1111/cgf.13341

Authors

Keywords

Image-based lighting, photo-realistic computer-generated content, shading, 3D graphics,

Monthly Views:

Available Documents

  • pdf

    From Faces to Outdoor Light Probes

    10MB
    Number of Downloads in the past year: 3

    This is the peer reviewed version of the following article: Calian, D. A., Lalonde, J., Gotardo, P., Simon, T., Matthews, I., & Mitchell, K. (2018). From Faces to Outdoor Light Probes. Computer Graphics Forum, 37(2), 51-61. doi:10.1111/cgf.13341, which has been published in final form at https://doi.org/10.1111/cgf.13341. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions

  • Downloadable citations

    HTML BIB RTF