there can be many reason for "One way speech" but QoS is not going to help (to get rid of it), it helps with the "quality" only.
One way voice could be related to configuration, VLans, Ports being blocked, Firmware for phones, Patches on the BCMs, Codec mismatch, speed and duplex Lan port settings.
Sometimes it's simple stuff like a Subnet mask typo if you don't use DHCP... some users phones don't go to the default gateway if the subnetmask is wrong and therefore you have "oneway voice"
if you have the problem intermittently, do a sniffer trace to see if you are getting the RTP Voice streams, if you are missing one side, check where it stops and why by moving the sniffer closer to the source (who's ever the voice is missing)....
slow agonizing process but that way you will have a direction to follow.
__________________________________________________________
Find a job you love and you'll never work a day in your life. - Confucius