Shorter cables didn't help. What did help was setting the sample rate to 88200. With that sample rate, the audio was clear. I'll just use that sample rate going forward.
I attached some audio of what playing some strings sounds like with 9600 sample rate and the Focusrite clock. There are some small crackles, then it loses audio for short bursts.
