Stick with whatever sample rate you have been using before. No matter if it's 44.1kHz or 48kHz. A gazillion of productions/recordings have been (and continue to be) made over the past decades using these sample rates and they're absolutely fine.
Sigh...
I wasn't talking about music production or recording. He said the headphone out of his Kemper sounds better than his sound card so I suggested trying a higher sample rate into the sound card. That's all this has been about. And Monkey_Man even wrote...
It's possible that the interface produces a slightly-better result due to an intentional sweet spot.
...before suggesting to not try it. If this was about recording only, I wouldn't have suggested the 96k sample rate. All that being said, it all points at the fact that Caste75 had SPACE on through his Kemper headphone out but not into his interface and that seems to have solved his problem anyway.