Undesirable result on example image

[ZiYang-xie]

Hi, thanks for the great work.

I have trained the model with the example panorama image kitchen you provided.
However the result seems pretty bad.
Looks like the depth estimation or the inpainting model failed to some extend.
Do you have any clue of this issue?

Input Image

Reconstruction Result

video.mp4

[ZiYang-xie]

Most part of the pointcloud reconstructed from the monocular depth estimator looks good to me.
However, I think it might be challenge for the inpainting model to restore the occluded area behind the kitchen island?

[ZiYang-xie]

BTW, The fridge looks normal in the pointcloud but why it seems to be distorted in reconstruction views?

[Only-Wion]

How did I get the pointcloud, was it generated by PeRF or did you process it yourself, I need the pointcloud