Yes, most small routers are configured via the web, so it does not matter which platform or mix of platforms you use.
The internet uses TCP/IP, so both the Mac and Windows uses that protocol to get to the internet. Sharing the internet does not mean they can share local files, but they can if needed.
I tried to remain child-like, all I acheived was childish.