Yup, this is supported as of Centova Cast v2.2.4. (Well, it's always been supported with IceCast, and works much better if you're using IceCast, but it's possible using ShoutCast as of v2.2.4).
Instructions for enabling it are
in the KB. It's not enabled by default for ShoutCast as it's a bit of a clunky solution and could drive your DJs nuts if they take too long to connect in live after disconnecting the autoDJ.