Silenced unknown callers not getting voicemail

I have silence unknown callers turned on. I’ve had 2 callers text to say voicemail is full and not allowing them to leave messages. My voicemail is not full and known callers are allowed to leave messages. How do I allow silenced callers to access voicemail?