DSL connection Stagnation?

[Stifle]

I have a strange problem with my internet connection.
My setup is 2 PC's connected to a Linksys BEFSR41v4 router (firmware version 1.04.01) and the router is connected to the DSL modem.
My ISP uses PPPoe Protocol to allow me to connect.

The problem, my connection seems to stagnate and become seemingly disconnected when i browse with Internet explorer, this also affects some other internet connecting programs, but not all of them.

Example: I can run a Teamspeak server and connect to that server with friends and never have a problem talking to them. but at the same time I am talking to them i keep getting the "Error; page not found"; error with internet explorer.
I have also noticed no connection problems with Halflife 2 applications, ie counterstrike.
I have problems with my connection in other games such as Guild Wars.

I dont know if i accidentally changed an option when trying to set up the local network. I am leaning more towards a software problem with the one PC as the other PC never has this problem.

Also. when i restart the PC, the internet works properly for a short period before behaving erratically

any help would be greatly appreciated

[GHSTECH]

make sure you dsl modem is not in router mode. check this by plugging directly to the modem and bring up the internal page with 192.168.0.1 or 192.168.1.1 you should be able to change it from router to bridge mode.

[CeeBee]

Set your router to "dial" the pppoe connection, make sure you don't have any pppoe software that is trying to dial from any of those PC's, verify that the router is set in "gateway" mode to perform NAT. Also check that the DHCP server is enabled on the router and both your computers are set for DHCP.