How to increase RAM allocated for network file transfer

Toggle sidebar Toggle sidebar
J

Jerami1981

Honorable
Sep 4, 2013
5
0
10,510
I am trying to understand how the system allots memory to aid in the transfer of files across the network, and find out if it is possible for me to increase the settings. I noticed when transferring large files (20+ GB) that I will max out my network connection speed for about 3 seconds, a small portion of available memory will drop, then the connection stops transferring, and after the ram recovers a little, the transfer fires back up again. It continues this process until the transfer is done.RAM is by no means ever exhausted. I also watched the particular disk activity, and it maintains a constant 140 MB/s write speed, so its not like the disk is taking a break when the file transfer pauses. It is obvious that it is clearing out the full RAM cache before resuming. I would like to enable enough RAM to avoid this, if possible, but have no clue where I would look to do so. Any pointers, or advice would be welcome. I am currently writing to drives mounted under Microsoft Server 2016.
 
Solution
varis
Is the behaviour identical if you transfer the same file from one file system to the other on the local server? I think it's the disk cache anyway, apparently it wants to write the new data before continuing.

The real bottleneck is your HDD (SDD?), but if you could increase disk cache you could get some relief.

I'd try asking for that on the software forums, since it's a Windows problem.
Sort by date Sort by votes
varis

varis

Distinguished
Nov 9, 2010
400
0
18,810
Is the behaviour identical if you transfer the same file from one file system to the other on the local server? I think it's the disk cache anyway, apparently it wants to write the new data before continuing.

The real bottleneck is your HDD (SDD?), but if you could increase disk cache you could get some relief.

I'd try asking for that on the software forums, since it's a Windows problem.
 
Upvote 0 Downvote
Solution
J

Jerami1981

Honorable
Sep 4, 2013
5
0
10,510
Internal transfers range from 141-155 MB/s. The transfer is not using the disk cache, its somehow using system memory. I will post this over in the software forum. Thanks for the direction.
 
Upvote 0 Downvote
varis

varis

Distinguished
Nov 9, 2010
400
0
18,810
Modern operating systems automatically cache the data that is written to disk before actually writing it. It's faster to write to the RAM than the actual physical disk - disadvantage is that there might be data loss if power suddenly goes out.
 
Upvote 0 Downvote
You must log in or register to reply here.

TRENDING THREADS

Latest posts

Moderators online

Share this page

COMPANY
RESOURCES
FOLLOW
Top Bottom