...press command or control + shift and click on the frames that hold the page numbers on your document pages, this overrides master items and you can then delete it...
...or, yes, as you state you can also create masters that don't have numbering involved at all...
andrew