New Router setup unable to web browse..

[newby]

I have an FC4 setup as a Router & DHCP server. I also have 2 other PC's. One is a linux PC in which I can perform an nslookup on all websites & ping all devices on my network, except the windows PC. The 2nd is a windows PC which I can ping all devices on the network, but I can't perform an nslookup. Neither PC can web browse. Both PC's are successfully getting their Ip addresses from the server.

What am I missing?

[ryantechie]

check the output of ipconfig command in windows command. try manually specifying the DNS servers in the windows machine

[newby]

SO I should type in my ISP's DNS server addresses?

[ryantechie]

yes add it in yours windows client