Be a little more specific about what you need hardware access to the COM port for, and what specific device.
Generally speaking, direct hardware writes/reads will not be possible without an intermediary: a virtualization device driver.
If you give details on the make, model, and/or software requiring access it would help use a lot to answer your question.