NeRF-XL: Scaling NeRFs with Multiple GPUs
We present NeRF-XL, a principled method for distributing Neural Radiance
Fields (NeRFs) across multiple GPUs, thus enabling the training and rendering
of NeRFs with an arbitrarily large capacity. We begin by revisiting existing
multi-GPU approaches, which decompose large scenes into multiple independently
trained NeRFs, and identify several fundamental issues with these methods that
hinder improvements in reconstruction quality as additional computational
resources (GPUs) are used in training. NeRF-XL remedies these issues and
enables the training and rendering of NeRFs with an arbitrary number of
parameters by simply using more hardware. At the core of our method lies a
novel distributed training and rendering formulation, which is mathematically
equivalent to the classic single-GPU case and minimizes communication between
GPUs. By unlocking NeRFs with arbitrarily large parameter counts, our approach
is the first to reveal multi-GPU scaling laws for NeRFs, showing improvements
in reconstruction quality with larger parameter counts and speed improvements
with more GPUs. We demonstrate the effectiveness of NeRF-XL on a wide variety
of datasets, including the largest open-source dataset to date, MatrixCity,
containing 258K images covering a 25km^2 city area.
662b29690ee2fbf66814a3fb
Ruilong Li
admin_assigned
2024-04-26T09:43:52.539Z
65ae0e61c14c3cf579024e73
/avatars/976066e1c1823345f3adc98e231569ae.svg
Ruilong Li
user
ruilongli
662b29690ee2fbf66814a3fc
Sanja Fidler
662b29690ee2fbf66814a3fd
Angjoo Kanazawa
admin_assigned
2024-04-26T09:44:06.153Z
6478cf7150ff7001631679c3
/avatars/65ec385a9cc44c972e6caf952e759ff1.svg
Angjoo Kanazawa
user
akanazawa
662b29690ee2fbf66814a3fe
Francis Williams
admin_assigned
2024-04-26T09:44:27.570Z
6581e26005c177eea396fb6e
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/kM0Gm4e3tXmE1WyFLNcaU.jpeg
Francis Williams
user
fwilliams
NeRF-XL: Scaling NeRFs with Multiple GPUs
We present NeRF-XL, a principled method for distributing Neural Radiance
Fields (NeRFs) across multiple GPUs, thus enabling the training and rendering
of NeRFs with an arbitrarily large capacity. We begin by revisiting existing
multi-GPU approaches, which decompose large scenes into multiple independently
trained NeRFs, and identify several fundamental issues with these methods that
hinder improvements in reconstruction quality as additional computational
resources (GPUs) are used in training. NeRF-XL remedies these issues and
enables the training and rendering of NeRFs with an arbitrary number of
parameters by simply using more hardware. At the core of our method lies a
novel distributed training and rendering formulation, which is mathematically
equivalent to the classic single-GPU case and minimizes communication between
GPUs. By unlocking NeRFs with arbitrarily large parameter counts, our approach
is the first to reveal multi-GPU scaling laws for NeRFs, showing improvements
in reconstruction quality with larger parameter counts and speed improvements
with more GPUs. We demonstrate the effectiveness of NeRF-XL on a wide variety
of datasets, including the largest open-source dataset to date, MatrixCity,
containing 258K images covering a 25km^2 city area.
NeRF-XL enables the scalable training and rendering of large-capacity NeRFs across multiple GPUs, demonstrating improved reconstruction quality and speed on extensive datasets.
Neural Radiance Fields (NeRFs) multi-GPU approaches distributed training rendering formulation parameter counts scaling laws MatrixCity