Ok got a major networking file transfer issue when transfering ~2+gb files to a windows server machine, to start - here are the specs:
Intel Celeron 420 (1.6ghz)
WD 160gb (OS HDD)
3 x 1tb WD GreenPower SATA running off a HARDWARE RAID5 CARD (Shared Folders)
Intel Pro/1000 PCIe 1x GBe network card Windows Storage Server 2003 R2
Q6600 @ 3.5
Realtek GBe (onboard)
Vista Ultimate SP1 (with all updates)
Now when i send files that are larger then 2gb the transfer will start at 90+mbps but after about ~1.5gb it will suddenly slow down to ~5 mbps at best, as if the network transfer from my Vista machine gets buffered to my servers ram and floods that till it runs out of ram and just ends up thrashing the HDD's (even when the transfer is finnished the hdd led's still flicker away). See image below of network transfer graph.
Things iv tried with no change what so ever:
Disabled volume shadow
Disabled write cache to all hdd's
Enabled write cache to all hdd's
All sorts of registry tweaks (paging etc)
Change system priority to foreground and background tasks
Enlarged the page file (not even used - hdd lead for OS doesnt even flicker etc)
Disabled the page file
Ethernet - different drivers (client and server), force modes like 1000TX etc
I need some new ideas on how to solve this issue! its just write issues - driving me nuts! :S
Have you tried transferring a 2+ Gig file to the servers OS drive - the 160 gig one - to see if the problem happens on that drive also?
If not then I would say its something with the raid card. Are all drives in the raid good? No failed drive or smart errors.
Yup OS drive is fine, so yeah you might be right there - raid card perhaps, but this is the thing - got 2 servers that do it! My other server - E5200, and a RocketRaid2300 (not totally hardware) - exactly the same issue.
Its pissing me off big time
The arrays are totally build+verified, reads fine but wont write well at all.
Iv had a freenas server read/write at 50mb/s without hassle in *software* RAID5 before i went to Windows Server and a hardware raid card (and the other, the rocketraid 2300)
lol i remembered why i dont bother asking questions here...
Short answer - RAID5 is slow, the file transfer is buffered to the server's ram till its full (hence the 90+mb/s) for about 1.5gb (2gb server memory minus onboard video memory, system resources and reserves = 1.5gb usable) - the RAID5 is so slow it buffers to ram and fills it till there is no ram available and transfer rates drop to real speeds of RAID5 (poor)
good to see there are no more pros here on the forums - wont bother asking questions here again