Chastity and orgasm denial discussion

I am a dom (as you all probably know) and I have a sub. He is chaste, but not currently locked. Due to lots of damage and other issues he has been unlocked for a while, but he is still obedient, and still chaste. He is also my collared submissive, and has worn a collar since the beginning of Feburary, the collar has never been removed and I have no plans to remove it. The collar is held in place by a grub screw which has been thread locked in place because it kept working loose, that grub screw is controlled (apart from by the thread lock) a tiny alum key that I hold. Now this technically is a key albeit not a standard shape key, and it does unlock and lock something that is very much linked to chastity, although not a device around his genetals but round his neck … Having said all that, I still consider myself as his keyholder, I do hold the key to his collar … do you think I am right to still consider myself his keyholder or do you think that I’m not because he isn’t currently wearing a chastity device … Many thanks for your imput MB