That's really hard to tell without some more troubleshooting. Are you experiencing any other trouble?
I'd start with wiring a jack in your conference room directly to a CO, and set them up with an analog conference phone to see if the problem continues.
On that note, are you using POTS, or digital co's?