I am upgrading my RAM to 64gb Corsair Vengeance Series so that I can do Machine Learning / Deep Learning. I came across a post where it says even though you have a fast RAM, it has somehow bottleneck such as DMA Bandwidth. (quote and link below)
what is the DMA bandwidth of this ram ?
PCPartPicker part list / Price breakdown by merchant
Memory: Corsair Vengeance LED 64GB (4 x 16GB) DDR4-3000 Memory ($499.99 @ Newegg)
Total: $499.99
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2017-03-03 02:35 EST-0500
Blog Link
what is the DMA bandwidth of this ram ?
PCPartPicker part list / Price breakdown by merchant
Memory: Corsair Vengeance LED 64GB (4 x 16GB) DDR4-3000 Memory ($499.99 @ Newegg)
Total: $499.99
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2017-03-03 02:35 EST-0500
Blog Link
The memory bandwidth of your RAM determines how fast a mini-batch can be overwritten and allocated for initiating a GPU transfer, but the next step, CPU-RAM-to-GPU-RAM is the true bottleneck – this step makes use of direct memory access (DMA). As quoted above, the memory bandwidth for my RAM modules are 51.2GB/s, but the DMA bandwidth is only 12GB/s!