Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › PERC 5/i RAID Card: Tips and Benchmarks
New Posts  All Forums:Forum Nav:

PERC 5/i RAID Card: Tips and Benchmarks - Page 247

post #2461 of 7150
has anyone seen problems with PERC 5/I under heavy load? i'm getting a CPU reset machine check on occasion when I'm running heavy sequential read/write with 32GB files. once CPU resets, i get kernel panics (CentOS 5.3 Linux) and its game over.

other than that, the sequential writes are impressive, at about 350-400MB/s (RAID5 8x SATA WD RE3). read performance on the other hand has been disappointing... 90~200MB/s depending on record size. also, at least in Linux, using NRA (no read ahead) seems to give about a 10% boost in read performance... wondering if Linux's read-ahead cache and the controller's read-ahead are stepping on each other?

Is 128K stripe size really the largest stripe size available in RAID5 on this card? Seems awefully small... would like at least 512K.
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2462 of 7150
Quote:
Originally Posted by BLinux View Post
has anyone seen problems with PERC 5/I under heavy load? i'm getting a CPU reset machine check on occasion when I'm running heavy sequential read/write with 32GB files. once CPU resets, i get kernel panics (CentOS 5.3 Linux) and its game over.
how you know that this is CPU reset ? maybe card is overheating and crash system ? have you installed extra cooling on/over card's chipset ?
post #2463 of 7150
Quote:
Originally Posted by RobiNet View Post
how you know that this is CPU reset ? maybe card is overheating and crash system ? have you installed extra cooling on/over card's chipset ?
i know it's a CPU reset because the remote management card keeps logs of this and the last crash screenshot. all 8 temp sensors are well within operational range. not a cooling issue.

any comments on the read speed? I would think I should easily be able to get more than 200MB/s on sequential reads with 8x 7.2K SATA drives...
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2464 of 7150
Quote:
Originally Posted by BLinux View Post
i know it's a CPU reset because the remote management card keeps logs of this and the last crash screenshot. all 8 temp sensors are well within operational range. not a cooling issue.
but do you have temp sensor directly on PERC 5/i chipset ? do you have stock/custom heatsink on PERC 5/i chipset ?

Quote:
Originally Posted by BLinux View Post
any comments on the read speed? I would think I should easily be able to get more than 200MB/s on sequential reads with 8x 7.2K SATA drives...
check logs of PERC 5/i - maybe one of drives is off-line ...
post #2465 of 7150
Hey everyone, I bought a perc 6/i from someone here on the forms and just recently got all my parts together to build my new NAS server. I hooked everything up and first boot the system booted and everything worked perfect. I got into the BIOS config for the perc and configured a single VD RAID 5 across four 1TB drives. I then initialized it, which took a little over 2 hrs which I left over night. Came back this morning, and ran a network install from my PXE ubuntu server but during the formatting process of the install it failed at 33% and errored out. I rebooted and tried again but received the same.

I shut it down completely, and restarted, but now I receive the following error after the card initializes:

Memory/battery problems were detected

Dell site says the following about the error:

This message occurs under the following conditions:

* the adapter detects that the cache in the controller cache has not yet been written to the disk subsystem
* the boot block detects an ECC error while performing its cache checking routine during initialization
* the controller then discards the cache rather than sending it to the disk subsystem because the data integrity cannot be guaranteed

To resolve this problem, allow the battery to charge fully. If the problem persists, the battery or adapter DIMM might be faulty. In that case, contact Dell Technical Support.

My question is this, has anyone seen this before? Google has turned up random issues where people replace the BBU's and RAM (which is not possible on this card since it is integrated) and some fix it and some don't. Any ideas on how to troubleshoot this? I still can't format the drive during my OS install at all

I am also wondering if a bad drive could cause this, or maybe the cables. I do not know how to check the status of the battery either from the card BIOS, so if anyone can advice on that one that would be great.

-J
AMD Lost Me Again
(13 items)
 
  
CPUMotherboardGraphicsRAM
i5-2500K Asus P8P67 Deluxe MSI HD 6950 G.Skill 1600 CL9 RipJaws 
Hard DriveOSMonitorPower
G.Skill 120GB Phoenix Pro SSD Windows 7 x64 Enterprise SAMSUNG 2253BW Black 22" 2ms SeaSonic x650 
CaseMouseMouse Pad
Silverstone Raven RV-02 Logitech G9 Ratz Pad 
  hide details  
Reply
AMD Lost Me Again
(13 items)
 
  
CPUMotherboardGraphicsRAM
i5-2500K Asus P8P67 Deluxe MSI HD 6950 G.Skill 1600 CL9 RipJaws 
Hard DriveOSMonitorPower
G.Skill 120GB Phoenix Pro SSD Windows 7 x64 Enterprise SAMSUNG 2253BW Black 22" 2ms SeaSonic x650 
CaseMouseMouse Pad
Silverstone Raven RV-02 Logitech G9 Ratz Pad 
  hide details  
Reply
post #2466 of 7150
BLinux, what firmware are you running?
post #2467 of 7150
Quote:
Originally Posted by rampage101 View Post
BLinux, what firmware are you running?
Latest Dell firmware. Any known issues?

Just to be more detailed:

# omreport storage controller
Controller PERC 5/i Integrated (Slot 3)

Controllers
ID : 0
Status : Ok
Name : PERC 5/i Integrated
Slot ID : PCI Slot 3
State : Ready
Firmware Version : 5.2.2-0072
Minimum Required Firmware Version : Not Applicable
Driver Version : 00.00.04.01-RH1

Minimum Required Driver Version : Not Applicable
Number of Connectors : 2
Rebuild Rate : 30%
BGI Rate : 30%
Check Consistency Rate : 30%
Reconstruct Rate : 30%
Alarm State : Not Applicable
Cluster Mode : Not Applicable
SCSI Initiator ID : Not Applicable
Cache Memory Size : 512 MB
Patrol Read Mode : Auto
Patrol Read State : Stopped
Patrol Read Rate : 30%
Patrol Read Iterations : 1
Abort check consistency on error : Not Applicable
Allow Revertible Hot Spare and Replace Member : Not Applicable
Auto replace member on predictive failure : Not Applicable
Load balance : Not Applicable
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2468 of 7150
Quote:
Originally Posted by dude051 View Post
Hey everyone, I bought a perc 6/i from someone here on the forms and just recently got all my parts together to build my new NAS server. I hooked everything up and first boot the system booted and everything worked perfect. I got into the BIOS config for the perc and configured a single VD RAID 5 across four 1TB drives. I then initialized it, which took a little over 2 hrs which I left over night. Came back this morning, and ran a network install from my PXE ubuntu server but during the formatting process of the install it failed at 33% and errored out. I rebooted and tried again but received the same.

I shut it down completely, and restarted, but now I receive the following error after the card initializes:

Memory/battery problems were detected

Dell site says the following about the error:

This message occurs under the following conditions:

* the adapter detects that the cache in the controller cache has not yet been written to the disk subsystem
* the boot block detects an ECC error while performing its cache checking routine during initialization
* the controller then discards the cache rather than sending it to the disk subsystem because the data integrity cannot be guaranteed

To resolve this problem, allow the battery to charge fully. If the problem persists, the battery or adapter DIMM might be faulty. In that case, contact Dell Technical Support.

My question is this, has anyone seen this before? Google has turned up random issues where people replace the BBU's and RAM (which is not possible on this card since it is integrated) and some fix it and some don't. Any ideas on how to troubleshoot this? I still can't format the drive during my OS install at all

I am also wondering if a bad drive could cause this, or maybe the cables. I do not know how to check the status of the battery either from the card BIOS, so if anyone can advice on that one that would be great.

-J
There are a couple of possibilities I can think of, but I'm not sure which one or any are really applicable, but food for thought at least:

1. some consumer grade HDD from Western Digital are known to "fall out" of a raid array and come back online. if you have a WD HDD, I would look into this possibility.

2. you might want to also know that Linux cannot boot from > 2TB boot drive. in order to support > 2TB, you'll need to use GPT tables, and although Linux can support GPT and mount very large volumes, it can't boot off something that large. You'll need to create a vdisk for the operating system that is less than 2TB and then use the rest for a "data" vdisk.

3. the error message you got I think might be because your writes during install failed and remained in cache but couldn't go to disk; something might be blocking. if you can boot to a liveCD and use either the Dell OMSA or MegaCli tool to check the battery, you should be able to get better idea if the battery is ok or not. if you have a battery that won't hold charge, that is replaceable. bad cache RAM would be a major bummer...
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2469 of 7150
BLinux, if your using 128k stripes (which from memory you get no other choice with Dell F/W) then I'd as a test run flash to LSI 7.066 and give that a test run.

I don't know of any known issues with the Dell .72 F/W, other than that its slower than LSI.
post #2470 of 7150
Quote:
Originally Posted by rampage101 View Post
BLinux, if your using 128k stripes (which from memory you get no other choice with Dell F/W) then I'd as a test run flash to LSI 7.066 and give that a test run.

I don't know of any known issues with the Dell .72 F/W, other than that its slower than LSI.
Thanks for the suggestion... I might give that a try, but I have to look into how that affects my PERC 5/I card since it is running in a Dell PowerEdge server.

You are correct about the 128K stripes, that was the largest option I could get from the BIOS setup at least. I know with PERC 6/I, you could get up to 1024K stripes, but 512K was the fastest for sequential I/O.
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: RAID Controllers and Software
Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › PERC 5/i RAID Card: Tips and Benchmarks