Overclock.net › Forums › Components › Hard Drives & Storage › SSD › 951 NVMe drives running very SLOW!
New Posts  All Forums:Forum Nav:

951 NVMe drives running very SLOW!

post #1 of 5
Thread Starter 

Hey guys,

 

Just built my new rig (details bottom of post).

I have two Samsung 951 NVMe drives - one in the dedicated M.2 socket (256GB SSD) and one on an expansion card connected to the PCIex 4_1 socket (128GB SSD).

The 128GB drive (OS) is running OK - way short of review benches - but seems fast enough.
The 256GB drive (Programs) on the M.2 slot is incredibly slow - it's currently benching slower than my Samsung Evo SSD connected through regular SATA.
And it really shows.

 

I did a user benchmark and compared the drives against identical systems:

128GB benching at 120% - average 170% - highest 216%
256GB benching at 64% - average 198% - highest 264%


Crystalmark scores for the 256GB drive:

   Sequential Read (Q= 32,T= 1) :   417.645 MB/s
  Sequential Write (Q= 32,T= 1) :   326.922 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   407.576 MB/s [ 99505.9 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   323.379 MB/s [ 78950.0 IOPS]
         Sequential Read (T= 1) :   387.798 MB/s
        Sequential Write (T= 1) :   308.925 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    45.959 MB/s [ 11220.5 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :    94.739 MB/s [ 23129.6 IOPS]

  Test : 1024 MiB [D: 16.6% (39.7/238.3 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/02/08 11:26:29
    OS : Windows 10 Professional [10.0 Build 10586] (x64)
 
I'm at a loss to understand what's going on - BIOS (2101) is reporting both drives as NVMe.

 

I set SATAExpress_1 SRIS Support in the BIOS to disabled which improved the speed (slightly) of the 128GB but no change to the 256GB.
Installed the Intel drivers as i believe Samsung doesn't make NVMe drivers.

 

AFAIK the 5820 CPU has 28 lanes - i'm running one GPU on the 16_1 - which should leave 12 lanes free - so i expected the two M.2 drives to pick up 4 lanes each.
It seems like the expansion card with the 128GB is getting 4 lanes but the 256GB in the actual M.2 socket isn't!

Although no idea why the 256GB should be running much slower than my EVO connected through regular SATA.

 

The only ideas i have are:

Should I move the expansion card with the 128GB to another PCIex scocket i.e. 16_2 or 16_3?
I have a samsung Evo connected to SATA port 7 on Sata controller 2 - could that be interfering with the M.2 socket bandwidth - maybe if i moved it to another port/controller?


Any suggestions or ideas totally appreciated.... Cheers

 

Spec:

Intel i7 5820K (base clock)
Asus Sabertooth X99
16GB Corsair Vengeance 2666
EVGA SC 980ti GPU
EKWB Predator 360 Liquid (CPU and GPU)
Samsung SM951 128GB M.2 PCI-e NVMe SSD (OS)
Samsung SM951 256MB M.2 PCI-e NVMe SSD (Programs)
Samsung Evo 250GB SSD (Documents)
2 x 3GB Western Digital Red HDD (RAID 1) (MEDIA)
Coolermaster Haf-X

Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
post #2 of 5
The PCIex 4_1 slot is a 2.0 2x electrical slot connected to the PCH, not the CPU. It will never run these drives at maximum speed.

The M.2 slot is a 3.0 4x slot connected directly to the CPU and should be much faster. I'm not sure what the issue is with this drive, though I'd check firmware, drivers, partition alignment, and give the drive some time between filling it and benching it as TRIM and garbage collection may need time to work.
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
post #3 of 5
Thread Starter 

Hey Blameless,

 

Thanks for posting.. You sir are a true gent..

 

so i'm a noob ofc - assumed that the 4_1 slot had 4x lanes :-)

 

Switched the expansion card to the 16_2 socket (happily don't use SLI) and it's made a huge difference.

 

The 128GB on the expansion card is only up by about 10% but the 256GB on the M2 socket is now 4-5 times faster :-). Which is bizarre but obviously the 4_1 must have been sharing bandwidth with the M.2.

 

   Sequential Read (Q= 32,T= 1) :  2211.907 MB/s
  Sequential Write (Q= 32,T= 1) :  1247.971 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   502.158 MB/s [122597.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :   379.140 MB/s [ 92563.5 IOPS]
         Sequential Read (T= 1) :  1568.646 MB/s
        Sequential Write (T= 1) :  1263.520 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    49.787 MB/s [ 12155.0 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :   171.636 MB/s [ 41903.3 IOPS]

  Test : 1024 MiB [D: 16.6% (39.7/238.3 GiB)] (x5)  [Interval=5 sec]
  Date : 2016/02/08 13:40:48
    OS : Windows 10 Professional [10.0 Build 10586] (x64)
 

the difference is really noticeable on the PC.

 

Speeds are still down a bit but will check drivers, firmware and give it some times as you say. Partition alignments checks out fine..

 

cheers mate!

Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
post #4 of 5
Quote:
Originally Posted by lordtyrion View Post

Which is bizarre but obviously the 4_1 must have been sharing bandwidth with the M.2.

Odd, using the M.2 is supposed to disable the last 16x (physical) slot, which should be connected directly to the CPU.
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
post #5 of 5
Thread Starter 

You're quite right - checked the motherboard manual again and its PCIEX 16_3 that should be affected by M.2.

 

The strange things is that when the expansion card was in the slower 4_1 socket it was getting x4 lanes but with a reduced speed (i guess because it didn't have direct CPU lanes?) but the dedicated M.2 socket was only getting x 2 lanes. Then i switched the exp card to 16_2 and it's now running at full speed and the dedicated M.2 is running at x4 lanes..

 

Furthermore moving the 3rd SSD (evo) from the secondary SATA controller group (Marvell or something like that) to the primary controller (Intel) allowed both NVMe drives to run faster by another 5-10% lol.

 

The Sabertooth's obviously have their quirks!

Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
Beast
(15 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 5820K @ 4Ghz boost Asus Sabertooth X99 EVGA 980Ti SC+ with EKWB waterblock 16GB Corsair Vengeance 2666 
Hard DriveHard DriveHard DriveHard Drive
Samsung SM951 M.2 PCIex NVMe Samsung SM951 M.2 PCIex NVMe Samsung Evo Western Digital Red 
CoolingOSMonitorKeyboard
EKWB Predator 360 Windows 10 Dell Ultrasharp 27 Steel Series 
PowerCaseMouse
Corsair RM850i Haf-X Logitech  
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: SSD
Overclock.net › Forums › Components › Hard Drives & Storage › SSD › 951 NVMe drives running very SLOW!