Cuda backend low FPS

[Shiyu-Xing]

Thanks for the great contribution for the community.
When I was rending a 3D gaussians scene with the tool, the fps sometimes drop to less than 10, this happens especially when you rotate or move the virtual cam.
Is this fps drop expected? Any hints on how to fix it?

[Shiyu-Xing]

With ogl backend, everything fine