I know this reply is extremely late, considering 4.20 was released months ago, but this is now working correctly (or at least the way I expect it to) in 4.20. Custom screen colors are left alone, no changes unless COLOR commands are called.

Thanks so much for fixing this Ruud, you're the best!