If you are experiencing one way voice particularly on incoming calls the most probable cause is SIP ALG. While originally designed to resolve a NAT related problems, with no standard implementation many routers and software based firewalls corrupt the SIP message by attempting to rewrite part of the SIP message. Frustratingly the one-way voice issues will often only occur on a single number and will clear once the router has been reset.
As a general rule all VoIP service providers recommend disabling SIP ALG (see VoIP Org).