Overclock.net banner

[Build Log] Terrorbyte V2 - 105TB Home Server

30K views 203 replies 28 participants last post by  deafboy 
#1 ·
My little Terrorbyte server started off as an innocent offspring of my mind in the physical form of this. However, as time progressed and tech got faster and cheaper...and I became more devious, my plans expanded and thus, my simple home server has developed into...

This, the build thread for Terrorbyte V2!



As I progress in building and configuring up my server I'll be posting pics and info that may or may not be helpful or entertaining. Feel free to ask any questions, throw me suggestions, or just sit there quietly like a ninja ghost and stalk me like 90% of the internet does.
tongue.gif


Main goals/uses

  • Experimentation and learning
  • VMs
  • Lots of storage

Progression
Day 1: Got my C1100, first impressions
Update 2: Got my Norco 4224, Trouble with the Dell C1100 + Fix
Update 3: Got my SAS expanders
Update 4: Got my LSI 9261-8i
Update 5: Finally got my SAS cables, got back a RMA'd SSD for the OS, and set up the system...IT'S ALIVE!
Update 6: RAID 0, 1, 5, 6, 10, and 50 benches with 6x 2TB drives
Update 7: Crazy Network and transfer speeds. 0_o
Update 8: RAID 6 8x 2TB drives
Update 9: Got a 3TB backup drive + Benches
Update 10: Got a 5x 500GB drive + a 1TB Samsung F3 for free of a client
biggrin.gif

Update 11: Got HP 1800-24G + Update to Terrorbyte V2.1 begins
Update 12: New mobo installed, installed Server 2012 R2, and more fun
Update 13: New 8x 3TB RAID 0 and RAID 6 array benches, Power draw testing, and storage layout reconfiguration.
Update 14: Added 8x HGST He8 HDDs + 1TB SSD + Benches

Currently the setup is as follows...

I originally purchased a Dell Poweredge C1100 with 2 L5520 CPUs & 72GB RAM for $435 and connected it to the Norco chassis via SAS cables and an expander. Now, however, I bought a mobo to put in the Norco case and stripped the Dell of its two CPUs and 48GB of its RAM and finally got everything into the Norco. I sold the Dell to regain some $.
biggrin.gif


Total Spent: ~$2,724

System w/out Storage: ~$1,232

Das Terrorbyte v2.1!

CPU: 2x L5520

RAM: 48GB Nanya 1066MHz ECC RDIMM

Mobo: SuperMicro X8DTi-F - $140

Coolers: SuperMicro SNK-P0040AP4
RAID card: LSI 9261-8i RAID card with BBU - $200, replacement BBU - $70
SAS expander: Intel RES2CV240 - $115

Cables: 7x 1 Meter SAS Cable SFF-8087 to SFF-8087 - $60
PSU: Corsair TX650 V2 - $80

Chassis: Norco RPC-4224 - $350

120mm fan wall - $18

3x Be Quiet! 120mm Silent Wings 2 - Free

2x SilenX EFX-08-15 80mm Effizio Fans - $15

Athena Power Cable-PCI6EPS428 6" PCI-E Converter - $9

Network
HP Procurve 1800-24G - $95

OS
Server 2012 Datacenter R2 - Free

VMs:

  • Server 2012 R2 x5
  • Win 10 x2
  • Win 8.1

Current HDD configs (105TB + 128GB)
No RAID -> 128GB - OS, 480GB - VMs, 1TB - Share

  • 128GB Samsung 830 - $67
  • 480GB SanDisk Extreme 2 - Free (Work)
  • 1TB Edge Boost Micro - Free (Work)

RAID 5 -> 4x 2TB Archive 1

  • 2x Samsung Spinpoint F4 - $160
  • 2x WD Red - $200

RAID 5 -> 4x 2TB Archive 2

  • 2x Hitachi Deskstar 7K3000 - $180
  • 2x Toshiba DT01ACA200 - $160

RAID 6 -> 8x 3TB for Movies and Backup

  • 3x Seagate Barracuda 7200.14 ST3000DM001 - $270
  • 5x Toshiba DT01ACA300 - $455

RAID 6 -> 8x 8TB for Movies and Backup

  • 8x HGST He8 - Free (Work)
 
See less See more
4
#3 ·
Got the Dell Poweredge C1100 all hooked up for some testing.
smile.gif


This thing is awesome, I can't believe I actually have something with so much RAM and threads. Previously i thought the 32GB of RAM in my desktop was a lot, now it seems so miniscule. lol It is crazy how they are able to pack so much in to such little space with this server. The size definitely took me by surprise when I first opened the package and took it out, it is so big, yet so thin.
http://www.flickr.com/photos/seanwebsterhd/9454442526/
Canon 60D IMG_4789.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9454443616/
Canon 60D IMG_4790.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9454444884/
Canon 60D IMG_4791.jpg by Sean Webster Photo, on Flickr

DAT RAM O___O
http://www.flickr.com/photos/seanwebsterhd/9454446304/
Canon 60D IMG_4792.jpg by Sean Webster Photo, on Flickr

Pretty good score, wish I could OC this thing now lol

Quote:
Originally Posted by seross69 View Post

Do you mind me asking what you gave for the C1100??
$435 shipped.
Quote:
Also why a managed switch??
More features and options for me to tweak and mess with. lol

I just ordered the 2 Intel 24port SAS expander cards, I got the 2 for $300. That's what i get for pushing the seller lol.
biggrin.gif
 
#5 ·
Quote:
Originally Posted by Zankza View Post

Can you please explain to me what is use of data deduplication with the hyper-v? they do not reduce or deduplication VHDs.
I usually got all my ISOs on there and some program installer files, so i'm thinking it should help a little with them. Plus it helps for VMs I use infrequently. I'm just experimenting.
 
#8 ·
Man, yesterday was crazy. First off I want to give some info on the Dell C1100 I got.

1. I turned it off and it wouldn't turn back on...I was like wut. 0__o So I tried doing a few things to boot it up, check all the connections and cleared CMOS. Finally it booted, but then I setup the BIOS and it didn't boot again. It just powered up for a second then powered down, literally on/off. So, I googled around and found this: http://en.community.dell.com/techcenter/cloud/f/4442/t/19512575.aspx

Updated everything. Reconfigured the BIOS and it worked.
biggrin.gif


Now however, with the newest BIOS the fans are louder at idle and it warms up my already warm room here in South Florida.
frown.gif


So far I really like it, it is going to be sweet when it is all set up and configured how I like.

Here are some moar pix:
http://www.flickr.com/photos/seanwebsterhd/9466929431/
Canon 60D IMG_4801.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466928859/
Canon 60D IMG_4809.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466928113/
Canon 60D IMG_4810.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466927373/
Canon 60D IMG_4812.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466926639/
Canon 60D IMG_4814.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466925303/
Canon 60D IMG_4817.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9469706726/
Canon 60D IMG_4827.jpg by Sean Webster Photo, on Flickr

2. Found that a hard drive caddy latch was broken.
sad-smiley-002.gif


Good news is that I am getting a new non broken one next week, that ebay seller is awesome.
biggrin.gif




Canon 60D IMG_4799.jpg by Sean Webster Photo, on Flickr

3. Got the Norco RPC-4224 today. It is pretty heavy without anything in it, about the weight of my current home server filled.
biggrin.gif


http://www.flickr.com/photos/seanwebsterhd/9466924077/
Canon 60D IMG_4835.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9469705510/
Canon 60D IMG_4837.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9466922255/
Canon 60D IMG_4840.jpg by Sean Webster Photo, on Flickr

http://www.flickr.com/photos/seanwebsterhd/9469704880/
Canon 60D IMG_4839.jpg by Sean Webster Photo, on Flickr

4. I'm trying to figure out where i can put this stuff in my house lol. I want to shove it in the kitchen in the pantry where the clothes washers are, but me mumzy ain't gonna have it.
mad.gif
So I need to either deal with the noise and heat or sneak it in there one night and route network cables around the house.

5. The two SAS expanders and the LSI RAID card are shipped and should be here next week, I may get something saturday.
 
#9 ·
Quote:
Originally Posted by Zankza View Post

Alright, cause u had me a bit all excited about the data deduplication cause I have revodrive installed in my servers, storage space is never quite same so I try almost every trick there is to reduce size.
basically if the data on the volume is read more than written to it will be good for data deduplication. Try it out on your setup and see how it goes.
Quote:
Originally Posted by xNovax View Post

Very interesting. I will definitely be watching this.

I would have trouble dropping $350 on a case.
frown.gif
Yea man, it literally hurt my wallet doing so...i'm still on a college students budget with no job lol.
 
#11 ·
#14 ·
Quote:
Originally Posted by xNovax View Post

Quote:
Originally Posted by Sean Webster View Post

nanya nt4gc72b4na1nl-be

http://www.memory4less.com/m4l_itemdetail.aspx?itemid=1442237231
Mine came with samsung dimms. They probably perform the same.
Nice, maybe run some benches like maxx mem Pi2. I'll run it too when I plug it in in a bit.

Quote:
Originally Posted by PR-Imagery View Post

I'll be waiting for bandwidth numbers and benchmarks on the storage setup
thumb.gif
wink.gif


I'll be getting 1Gb/s throughput to all my PCs until I upgrade to 10Gb/s in a few years. Storage speeds should be good. I'm thinking about 400-600MB/s for the RAID 6 array with 6 2TB HDDs, maybe better. With a 10-12 drive RAID 6 I hope to see double that. I may throw my desktop RAID 0 set up in there and change it to RAID 5 with my 4 1TB drives.
 
#15 ·
Quote:
Originally Posted by Sean Webster View Post

Nice, maybe run some benches like maxx mem Pi2. I'll run it too when I plug it in in a bit.
wink.gif


I'll be getting 1Gb/s throughput to all my PCs until I upgrade to 10Gb/s in a few years. Storage speeds should be good. I'm thinking about 400-600MB/s for the RAID 6 array with 6 2TB HDDs, maybe better. With a 10-12 drive RAID 6 I hope to see double that. I may throw my desktop RAID 0 set up in there and change it to RAID 5 with my 4 1TB drives.
Im on holidays, maybe when I get home I will run it.
 
#17 ·
Quote:
Originally Posted by Sean Webster View Post

I'll be getting 1Gb/s throughput to all my PCs until I upgrade to 10Gb/s in a few years. Storage speeds should be good. I'm thinking about 400-600MB/s for the RAID 6 array with 6 2TB HDDs, maybe better. With a 10-12 drive RAID 6 I hope to see double that. I may throw my desktop RAID 0 set up in there and change it to RAID 5 with my 4 1TB drives.
Hmm. Not bad I guess; I've got raw 4k media in mind
 
#18 ·
Quote:
Originally Posted by xNovax View Post

Im on holidays, maybe when I get home I will run it.
thumb.gif


Quote:
Originally Posted by Nexo View Post

Wow this must of cost you like a lot all together.
Yea, kinda. I could have probably done it cheaper, but I wanted the system a certain way and maintain a certain level of performance as well.

The whole thing without drives is ~$1500 without drives.
Quote:
Originally Posted by PR-Imagery View Post

Hmm. Not bad I guess; I've got raw 4k media in mind
Get a couple RAID 0 arrays set up with some SSDs or some of the Seagate 1TB/platter HDDs.
biggrin.gif
 
#19 ·
Them Pics look awesome, going to follow this until the end. Might learn something from you too over Skype
thumb.gif
 
#20 ·
Quote:
Originally Posted by Sean Webster View Post

I'll be getting 1Gb/s throughput to all my PCs until I upgrade to 10Gb/s in a few years. Storage speeds should be good. I'm thinking about 400-600MB/s for the RAID 6 array with 6 2TB HDDs, maybe better. With a 10-12 drive RAID 6 I hope to see double that. I may throw my desktop RAID 0 set up in there and change it to RAID 5 with my 4 1TB drives.
That's seems a bit optimistic with the RAID 6 array. It will most likely be in the 300-400 MB/s range with the 6 disk RAID 6 array. Don't let the raid controller's cache fool you. Run your benchmarks at greater than 512MB.
 
#21 ·
Got my SAS expanders, I'll make an updated post with pics later tonight when I'm free.
Quote:
Originally Posted by jibesh View Post

Quote:
Originally Posted by Sean Webster View Post

I'll be getting 1Gb/s throughput to all my PCs until I upgrade to 10Gb/s in a few years. Storage speeds should be good. I'm thinking about 400-600MB/s for the RAID 6 array with 6 2TB HDDs, maybe better. With a 10-12 drive RAID 6 I hope to see double that. I may throw my desktop RAID 0 set up in there and change it to RAID 5 with my 4 1TB drives.
That's seems a bit optimistic with the RAID 6 array. It will most likely be in the 300-400 MB/s range with the 6 disk RAID 6 array. Don't let the raid controller's cache fool you. Run your benchmarks at greater than 512MB.
Yea, right now I'm getting 450-500MB/s in RAID 5 when benchin with 8MB. You're right, I'll be a little less than what i said lol. My WD10EZEXs should be able to do better tho....if I get more, but the price to capacity is not worth it.
 
#22 ·
#23 ·
#24 ·
Beautiful card, aye? I love my 9261-8i.
 
#25 ·
Aye, I really am liking the looks of it. Right now I have the bracket taken off and it is sagging and need to fine a standard/long bracket to secure it in the C1100.
 
This is an older thread, you may not receive a response, and could be reviving an old thread. Please consider creating a new thread.
Top