Its a long time coming but I would like to thank everyone for their help with this problem.
It was a few days ago when I revisited this problem and reading a few other potential solutions to this issue when I thought I'd try Ring Groups with Misc Destination instead of Follow Me, A bit of messing around and finally it worked. I also tried setting up DISA and got that to work too.
But there's a problem, on Inbound Routes I change Set Destination to Ring Groups and my ring group, that works as expected, Now if I then set it to DISA, that works, but here is the problem, if I then set it back to Ring Groups, then Ring Groups does no longer work even though the setting are the same and my other dial patterns don't work with my other DID numbers either, this seems to break things for other inbound/outbound calls and I don't know why.
Does anyone know anything about this???