Mike
Whether the voip packets are generated within the router is dependent on what the function of that router is. For instance, if you're deploying IP telephony, all the IP phones assign a precedence of 5 (usually the default) to all voice. In this instance, the router isn't generating voice traffic is simply needs to recognise (or classify) the traffic and then assign it to a priority queue.
SOme Voip implementations typically utilise voice-enabled routers which may generate voice traffic. In this instance, the router must assign or mark its traffic with a precedence of 5 so that other devices (i.e. non voice routers) can recognise it as voice traffic.
So, in summary, if you're using IP Phones, you don't need to set ip precedence on the voice packets. Step 2 onwards (in the link I provided) are the bits you are interested in.
If you aren't using IP Phones and your routers are voice-enabled, then you must mark the generated voice packets with an IP Precedence of 5. Step 1 onwards will be the bits you are interested in.