kubernetes/kubernetes#128170 introduce Activate(), which is basically the same as what PodsToActivate does.
Currently, we're maintaining the complicated implementation for PodsToActivate, which should be very simplified if we move to framework.Handle.Activate(...).