TBGAN [23] ﬁrst introduced a deep generative network
for facial reﬂectance, based on ProgressiveGAN [34] and
[44] introduced a more powerful model, based on Style-
GAN [35]. However, both works did not showcase ﬁtting
capabilities. An extension of the latter [48], introduced a
set of multiple networks, with a StyleGAN2 [36] base, that
can be used to generate shape and albedo from images with
arbitrary illumination and expression. While close to our
work, our method uses a single and more powerful diffusion
model, inferring not only the diffuse albedo, but also the
specular albedo and normals. Moreover, our work inpaints

only the occluded facial areas, preserving the visible part of
the texture and achieves higher reconstruction ﬁdelity.
Relightify-Relightable3DFacesfromaSingleImageviaDiffusionModels