My internet keeps cutting out

So, I have Uverse and it works pretty well.  I have a rather large house and the 2Wire WiFi is not enough to get everywhere, especially since my kids have Macs and the radios don't seem to have the same range as our PCs.  Anyway, i have installed a WiFi router on each floor to keep things easy.  Recently, i extended the network to another room from one of the TV boxes.  I have a basic 4 port, Gigabit switch right after the Uverse Box.  From there, i go to a PlayStation, DVD player and an Apple TV box.  THe last port, i ran a 100 ft. CAT6 cable to a remote part of the house.  It is on that device, that i keep losing my internet connection.  It seems wierd, because if i just run the 100 ft. cable directly from the Uverse box to the remote room, it does not cut out or lose connectivity, so i know that it is not the wiring or distance.  It seems that going through the switch is what messes it up, but i have tried two different Gigabit switches (both brand new) and nothing.  Everything else seems to work right and not lose connectivity.  Any thoughts?