Any way to disable drift if not using the screensaver

I have the screensaver disabled. I get the drift on my 2nd screen while music is playing and when it is idle (the time is displayed). Any way to turn...