Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › PERC 5/i RAID Card: Tips and Benchmarks
New Posts  All Forums:Forum Nav:

PERC 5/i RAID Card: Tips and Benchmarks - Page 250

post #2491 of 7172
just an update: a few days ago i posted about my read speeds being slow (100-200MB/sec) even though my write speeds were fast (300-400MB/sec). I finally figured out what it was: I had to tune the read-ahead caching on the logical volume device *in addition* to tuning it similarly on the actual block device, which is set to 32MB.

Here are the results from iozone:



the iozone command was:

iozone -b results.xls -s 12g -r 4m -S 2048 -i 0 -i 1 -t 2

in this test i'm mostly interested in sequential I/O, using 4mb blocks, 2 threads, and writing 12GB files. (the system has 16GB, so 2x12GB=24GB should be plenty to get me outside of filesystem caching effects)

setup is:
PERC 5/I, 512MB cache + BBU
8x 500GB HDD (WD RE3, 16MB cache) in RAID5
Stripe size=128kb
read ahead = *no read ahead* (NRA) - using the read-ahead of the OS
cache policy = cached
write cache = write-back
disk cache = enabled

OS: CentOS 5.3 64bit
Filesystem: XFS, formatted to match the underlying RAID geometry
Mount options: rw,noatime,logbufs=8,logbsize=256k,nobarrier
Read-Ahead Cache: 32MB
I/O Scheduler: noop (letting the RAID device figure things out)

The read speeds are now up to 525MB/sec which is *MUCH* better than the 150~200MB/sec i was getting before. Granted, this is not fully tuned yet, but it's at least acceptable performance.
Edited by BLinux - 5/24/09 at 8:05pm
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2492 of 7172
Is anyone running multiple SSD's on the perc 5/i?
post #2493 of 7172
Quote:
Originally Posted by stebie View Post
I think the lack of cache was (partially) the problem. At random times, when there was heaps of I/O (in our application, it was a Windows Server 2003 - AD, file server, DNS, DHCP, etc.), the server would freeze. Even the local console was inaccessible - was given nothing but a grey background. The only way to prevent it from freezing was, as silly as it sounds, disabling resident AV on the server. Even then, there were times the system stopped responding for 2 or so minutes, then magically begin responding.

As there was no cache onboard, the card was set to its default write-through caching option.

EDIT: The setup was a RAID-1 config with two 80GB WD SATA HDDs.
Thanks for the info.

From looking around a bit, I believe the 5iR card turns off the on-drive cache by default, with no way to re-enable it in the bios. I haven't found any indication that the 6iR (or my HP card) does this (or maybe the bios allows you to turn it on/off). I hope this is what caused your problem, and so hopefully the 6iR and my HP won't perform as badly.

I have my fingers crossed...
post #2494 of 7172
Quote:
Originally Posted by BillDavis View Post
Is anyone running multiple SSD's on the perc 5/i?
I would also like to know this - I want to put 2-4 of the cheaper JMicron-based SSDs on the PERC in RAID0 to replace my SAS array. I am hoping the cache will remove the stuttering problem and give me SLC/Vertex type performance for much lower cost.

Tuning the cache for optimising writes should remove the stutter, and the near-instant seeks should still give very high transfer rates.
post #2495 of 7172
So any answers on my previous post?

I'm also interesting what additional preferings LSI firmware has over Dell one.
Sry, was discussed more than once.
Edited by AaronStalin - 5/24/09 at 11:45pm
post #2496 of 7172
Quote:
Originally Posted by AaronStalin View Post
So questions are:
1) Does anybody really think, that just 667mhz memory chips need any monstro passive heating? As i seen LSI 8408E and any other RAID controllers don't use ANY heatsinks;
Actually, it is 400Mhz PC2-3200. But, I don't think cooling it is necessary. Keep in mind, OCN folks here tend to like "overkill" and create a large margin of safety. Would it be better to cool it, yes. Is it necessary for stability, probably not unless your case is packed full of really hot devices.

Quote:
Originally Posted by AaronStalin View Post
2) Will it enough if i'll just plug some small heatsink to LSI's ARM processor with thermal glue?
I don't even think you really need additional heatsink as long as you have proper air flow going over the stock card and you don't have a box full of really hot devices right next to the PERC card. I have my PERC5/I in an older generation (before the PERC 5/I was available) Dell server and there's a fan that blows over the PCI devices running at 1400 RPM... you can barely feel the airflow with your hand, but the temp sensors in that section of the mobo have never indicated any issues (usually 18-25C, only a few degrees higher than ambient room temp). Adding additional heatsinks would give you a greater margin of safety for sure, and it's cheap to do. I haven't done it yet, but I may if I find a low profile heatsink I can use. (I have two other cards surrounding the PERC 5/I so space is limited.

Quote:
Originally Posted by AaronStalin View Post
3) I see many monsters on IOP333 of user's cards? Do i really need such? I'm interesting in finding something cheap heatsink that will fit instead of stock Foxconn NH195.
Do you really need: probably not as long as you have airflow going over the card. If you don't, then probably should add something. If I had to choose between adding a fan or a heatsink, I would add the fan first; the airflow is more important. If you can do both, great!

Quote:
Originally Posted by AaronStalin View Post
4) Should i use original firmware or Dell one, as my OS supports both of these cards?
I'm sticking to the original Dell firmware for now. I don't know how the LSI firmware will interact with my Dell server and there's also the issue of LSI firmware and Dell bootloader causing corruption (unverified) that I want to look into further before I go to LSI firmware. I was initially concerned about the Dell firmware's performance, but after some tuning I was able to get the level of performance I consider acceptable (see a few posts up). I think Dell firmware can perform well enough (almost 500MB/sec read and 400MB/sec write on sequential I/O). So now that I can achieve that level of performance, I don't feel a need to try the LSI firmware. You can use the MegaCli tools with the Dell firmware and the MegaCli tools give you access to more features that the Dell tools do not.


Quote:
Originally Posted by AaronStalin View Post
I can set up fan too, but it will little hurt, as i presume this RAID controller hasn't any PWM fan connector, and no AUTOMATIC fan control of course.
So i'll be glad, if anyone say what 40mm fan will enough.

LSI stock products never uses ones. Only cards that used were Areca ones, but those had thermal sensor, fan failure sensor and i think more.

BTW, i use 40x40x28 Delta fan on my North bridge, to have enough cooling when it's under upper voltages, but as it's PWM-controlled, it's never runs on 15k rpm at nominal vMCH settings Thinking about buy one for my CPU, but in future, i don't really need it right now.

Running open-stand now, but when i'll insert all HW in a case, i'll be using JUST stock installed case fans, or something low-blow, no Deltas or hi-rpm Titans and Scythes.
I think the important part regarding this card as-is from Dell, is that you need some airflow going over it. The more the better, and if you can add some additional cooling with heatsinks, the better. But if you're asking for bare minimum and what you can get away with, I think as long as you have some airflow over the stock card from Dell, you'll be fine.

For me, since I can't find any heatsinks that will work yet, I've been thinking of drilling holes in the PCI bracket since the airflow in the server goes from front to back. The hot air going over the card is a bit stuck as the vents on the back of the server require the air to hit the cards, move up, and then out. I think I can get better exhaust if the air can move over the cards and straight out the back through vented PCI bracket. It's a cheap way to get the hot air out...
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2497 of 7172
just for comparison, i ran the same iozone benchmark on a PERC 6/I with the same set of hard drives. Here are the results I got:



basically about 50-100MB/sec faster than PERC 5/I across the board on writes. Ironically, the PERC 5/I has 512MB cache + BBU while the PERC 6/I has 256MB cache + BBU. I'm not sure that increasing controller cache does much, though it's a cheap upgrade.


Edited by BLinux - 5/24/09 at 8:09pm
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
post #2498 of 7172
BLinux:
Thank you for such exhaustive answers!

Quote:
I was initially concerned about the Dell firmware's performance
My main target in getting this controller was not performance, but redundancy. It was cheapest card (and with high level, and full LSI architecture, the solution like Areca, LSI MegaRAID's, but not such crap as 3ware or Adaptec) that i can ability to get. And, wow!, how lucky, it was available in my town WHEN i wanted it.

I hate software unportable raids like RAIDframe or LVM solutions, there are non-portable, while some of LSI hardware supported by mass of OSes.

So performance is not my target at this time, i've used slowest IDEs for even eight years. I use this card now for two RAID1 level raids. And for such configurations, this card is more than i needed. I don't think that IOP processor uses much until of RAID5 and upper, which heavily based on XOR-operations.

I didn't make any tests of course, as i hope HDDs are working not slower at least than on ICH9 for example.
post #2499 of 7172
Quote:
Originally Posted by BLinux View Post
just for comparison, i ran the same iozone benchmark on a PERC 6/I with the same set of hard drives.

...

basically about 50-100MB/sec faster than PERC 5/I across the board on writes. Ironically, the PERC 5/I has 512MB cache + BBU while the PERC 6/I has 256MB cache + BBU. I'm not sure that increasing controller cache does much, though it's a cheap upgrade.
Did you solve the craching issue you have with the PERC5? Also does the 6i exhibit the same problems?

It is good to see a direct comparison between the 2 cards (especially as the 6i came out in front - that is the card I have waiting for my server ). Thanks for the results.
post #2500 of 7172
Quote:
Originally Posted by the_beast View Post
Did you solve the craching issue you have with the PERC5? Also does the 6i exhibit the same problems?
No, that issue hasn't been resolved, but i've been avoiding the scenarios that can trigger it. The crashing problem doesn't happen under normal usage, only under extreme I/O in the benchmark.

Quote:
Originally Posted by the_beast View Post
It is good to see a direct comparison between the 2 cards (especially as the 6i came out in front - that is the card I have waiting for my server ). Thanks for the results.
Although the PERC 6/I does seem better than the PERC 5/I, it's only slightly faster for about double the cost. But, so far I've only crudely tuned the read-ahead cache; with further tuning it might be possible to gain more speed.
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
TAIPEI
(10 items)
 
AURORA
(13 items)
 
 
MotherboardGraphicsRAMHard Drive
ASRock X99 Extreme11 EVGA GTX 980 Superclocked 32GB 8x4GB Corsair LPX Samsung XP941  
Hard DriveCoolingOSMonitor
Western Digital 3TB RE Noctua NH-D15 Fedora 21 Linux Samsung S27D590C 
PowerCase
Seasonic SS-1200XP Cooler Master Cosmos II 
CPUMotherboardGraphicsRAM
Dual Quad-core L5430 2.66Ghz 12mb cache Intel 5000 chipset ATI ES1000 64GB FBDIMM DDR2 PC2-5300 667Mhz 
Hard DriveOSPower
WD3000FYYZ PERC H700 w/ 512MB cache CentOS 7.2.1511 950W x2 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: RAID Controllers and Software
Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › PERC 5/i RAID Card: Tips and Benchmarks