You are not receiving DNS server entries.
Do an ipconfig /all and see that:
1. You have an appropriate DHCP assigned address;
2. That the Gateway points to the router, usually 192.168.1.1
3. That your DNS table is populated with WAN-side DNS server entries
If any of the above is not true, you do not have an acceptable connection to the wireless router.
If you are making static IP entries, you need to specify the Gateway address (the router) and the DNS entries manually. You can use the router address as the single DNS entry if you choose, it will provide DNS proxy services to the WAN-side DNS servers.