10Gb NIC not running at full 10Gb

SaulG · Jan 2, 2017

I recently purchased 2 Mellanox 10Gb NICs with a 10Gb SFP+ cable connecting my server to my PC. It is detected and connects at full 10Gb/s. I setup a 6.5GB RAM disk on each computer for testing and used a 6GB test file. The transfer will go from 500Mb/s to 600Mb/s tops. Network usage is at 50% and CPU is around 40% (for each computer)
I have a Dell Poweredge 1950 with 4 WD Black 320GB disks in RAID 10 and 16GB DDR2 RAM.
PC is a FX 8320 and 10GB of DDR3 RAM
Not quite sure whats's going on.
And help, tips or anything would be great!
Thank you in advance!

jsmithepa · Jan 2, 2017

if you are running W10, are those NIC drivers W10-specific or are you running some W7/Vista compatible drivers?

nzalog · Jan 2, 2017

SaulG :

Just want to point out you're probably trying to say 500 to 600 MB/s if the network is being utilized 50%. Not trying to nit pick but there is a big difference between 600Mb/s and 600MB/s, 600Mb/s on a 10Gb network is more of a problem than 600MB/s.

1MB/s (megabyte per second) = 8Mb/s (megabits per second).

Are you set to full duplex?
What model cards?

SaulG · Jan 3, 2017

nzalog :

SaulG :

Just want to point out you're probably trying to say 500 to 600 MB/s if the network is being utilized 50%. Not trying to nit pick but there is a big difference between 600Mb/s and 600MB/s, 600Mb/s on a 10Gb network is more of a problem than 600MB/s.

1MB/s (megabyte per second) = 8Mb/s (megabits per second).

Are you set to full duplex?
What model cards?

I'm using the drivers Windows installed for me...
Thank you, nzalog I did mean MB/s, my bad.
They are in full duplex. Shouldn't they be in that mode by default?
I'll verify when I get home though.

Rhinofart · Jan 18, 2017

I have the exact same cards as you. I think your proc in the 1950 is bottlenecking your transfer rate. On my 980x over to my i7 quad, I'm getting consistent 780 MB/s without using RAMdisks. 2 x 1TB SSD in stripe on the 980x over to 6 x 512GB SSD in RAID 6 connected via Thunderbolt connection on the i7 Quad
980x 2x1TB SSD -->Mellanox 10GB SFP+ <--Direct Connection--> Mellanox 10GB SFP+ -->MacMini Thunderbolt Expansion Chassis --> Thunderbolt Cable -->Promise Pegasus R6 with 6 512GB SSDs in RAID 6.

SaulG · Jan 24, 2017

Rhinofart :

I kinda thought the CPU was a bottleneck but I didn't really think it would be the real issue. I'm saving up for a better server (Dell R710 with dual Xeon E5504 CPUs) Thanks guys and my apologies for taking a long time to reply...

Search

10Gb NIC not running at full 10Gb

SaulG

Reputable

jsmithepa

Polypheme

nzalog

Respectable

SaulG

Reputable

Rhinofart

Distinguished

SaulG

Reputable

TRENDING THREADS

Latest posts

Moderators online

Share this page