"Stuttering" KPA as USB audio

Does anybody also get an intermitent sound from the KPA when you play back music using the KPA as USB audio? Like stuttering.
It happens to me every so often and I know no other solution than switching it off and on again.
With the same set up, I've had the KPA work perfect as interface but also perform this stuttering sound every now and then when playing back music or any audio from my laptop.
It makes you wanna switch back to using the KPA as before and not as an interface.

For now, my theory is that if I load up Rig Manager or switch the KPA on while there's audio playing from my Mac it might trigger these breaks and interruptions in the playback. So I try to have the the Rig Manager and the KPA load up and ready before I play any audio.