Maybe your audio apps need some more CPU priority.
Try this:
sudo echo -e '@audio - rtprio 95\n@audio - memlock 1024' > \
/etc/security/limits.d/50-audio.conf
This gives anything running in the audio group realtime priority.
Create and add yourself to the audio group if needed. Debian has done this for you already.
