I got most one-way audio issues resolved by using a STUN server whenever possible.
Only issue are calls from my wife's office SIP phone (Yealink) to my office SCCP phone (Cisco). It works fine if I call her, but it doesn't work the other way. I will post an update if I can find a solution.
Migration is almost complete now! 
Well, I guess I would still like to migrate BroadVoice to PJSIP one day...