This sounds like a routing problem with your outgoing service provider or the company holding the DID.
You need to do some additional tests:
- Does the problem occur on outbound calls from your particular provider to other numbers??
- Does the problem occur on inbound calls from other providers (i.e., from a mobile phone or another VOIP provider)?
It seems unlikely to me that this is related in any way to your system.