3.2. Cross-time rendering for temporal consistency
If we optimize our dynamic scene representation by com-
paring ˆCi with Ci alone, the representation might overﬁt
to the input images: it might perfectly reconstruct those
views, but fail to render correct novel views. This can hap-
pen because the representation has the capacity to recon-
struct completely separate models for each time instance,
without utilizing or accurately reconstructing scene motion.
Therefore, to recover a consistent scene with physically plau-
sible motion, we enforce temporal coherence of the scene
representation. One way to deﬁne temporal coherence in
this context is that the scene at two neighboring times i
and j should be consistent when taking scene motion into
account [19, 35, 67].

In particular, we enforce temporal photometric consis-
tency in our optimized representation via cross-time render-
ing in motion-adjusted ray space, as shown in Fig. 3. The
DynIBaR-NeuralDynamicImage-BasedRendering