So I created a DJ login and then deleted it, restarted my auto dj and noticed that the deleted dj login still works even after I restarted the auto dj.

thoughts , suggestions?

check if dj still persists in raw sc_trans configuration

Another thing is what you mean by saing that "old" dj logins still work ?

Do you mean broadcasting or logging in to Centova panel.

If you mean broadcasting then it looks like AutoDJ hasn't been restarted (i know you said that you restarted it).
Try to kill sc_trans process and then see.
You can check as well what dj's are currently able to broadcast by making sc_trans api call:  ListDJS