Overclock.net › Forums › Case Mods & Cases › Builds & Case Mods › Case Mods › Case Mod Work Logs › APOLLO (2CPU LGA1366 Server | InWin PP689 | 24 Disks Capacity) - by alpenwasser
New Posts  All Forums:Forum Nav:

APOLLO (2CPU LGA1366 Server | InWin PP689 | 24 Disks Capacity) - by alpenwasser - Page 2

post #11 of 30
Thread Starter 
Mounting the PSU, Testing LSI Controller


Finally, UPDATE TIME! smile.gif

Yeah, it's taking a lot longer to finish this than I'd initially hoped (doesn't
it always with these sort of projects...). But I've been working on it in the last
few weeks and now finally have something to share. smile.gif



PSU Fitting Issue

The PSU slides into this case through an opening from behind, and since the case
isn't really made for normal ATX-sized PSUs (but server PSUs instead, it's a
rather tight fit. To be more specific: The PSU in its stock config does not fit,
the screws for the fan grill and the fan grill itself bump up against the
case. An easy fix though, just needed to remove the fan grill on the PSU.

(click image for full res)
aw--apollo--2014-04-01--01--psu-bad-fit.jpeg

And voilà:

(click image for full res)
aw--apollo--2014-04-01--02--psu-good-fit.jpeg

Furthermore, since normal server PSUs usually blow air through along their
longitudinal axis, there is no ventilation hole on the case for a fan on the top
of the PSU, which most of today's PSUs have. Not to worry, I still had an old
Aquacomputer rad grill laying around. A bit of dremeling should be able to fix
this problem. Marking for cutting:

(click image for full res)
aw--apollo--2014-04-01--03--psu-cutout-markings.jpeg

And with the grill mounted:
(click image for full res)
aw--apollo--2014-04-01--04--psu-cutout.jpeg


Bracket Collision

Another issue with mounting a PSU in the case that wasn't intended to be mounted
in this case: The bracket for the PSU does not quite line up correctly with the
power inlet.
(click image for full res)
aw--apollo--2014-04-01--05--psu-back-collision.jpeg


The power plug can still be connected, but the PSU sits crooked in the case and
it's a huge pain to mount like this.

(click image for full res)
aw--apollo--2014-04-01--06--psu-back-collision.jpeg


Again, a little bit of cutting was required:

(click image for full res)
aw--apollo--2014-04-01--07--psu-plug-cutout.jpeg


To give you an idea of how the PSU fits into the case:
(click image for full res)
aw--apollo--2014-04-01--08--psu-mounted.jpeg

(click image for full res)
aw--apollo--2014-04-01--09--psu-mounted.jpeg


Needed to hook up some HDDs to test the LSI controller. Looks very ghetto, worked
like a charm. smile.gif

(click image for full res)
aw--apollo--2014-04-01--10--hardware-testing.jpeg

(click image for full res)
aw--apollo--2014-04-01--11--ghetto-disk-stack.jpeg


Next Up...

Manufacturing the drive cages, the so-called pièce de resistance... biggrin.gif


So long
-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #12 of 30
Ok... I'm interested.
    
CPUMotherboardGraphicsRAM
Q8400 DFI LP DK P45-T2RS eVGA GTX 650 Kingston 
Hard DriveOptical DriveOSMonitor
2.8TB Total LG Super DVD Burner SATA VII Enterprise x64 Gateway FHD2401 
PowerCaseMouseMouse Pad
Corsair VX550W NZXT Source 210 White Logitech G400 Razer Kabuto 
Audio
Creative Audigy 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
Q8400 DFI LP DK P45-T2RS eVGA GTX 650 Kingston 
Hard DriveOptical DriveOSMonitor
2.8TB Total LG Super DVD Burner SATA VII Enterprise x64 Gateway FHD2401 
PowerCaseMouseMouse Pad
Corsair VX550W NZXT Source 210 White Logitech G400 Razer Kabuto 
Audio
Creative Audigy 
  hide details  
Reply
post #13 of 30
Thread Starter 
Quote:
Originally Posted by legoman786 View Post

Ok... I'm interested.

Thanks! smile.gif


It's not going to be super pretty (not worth the time and money, especially since I don't
really have either at the moment rolleyes.gif ), but it will hold 24 3.5" disks in the final config,
which I'm hoping should be enough for the foreseeable future and provide some sort
of eye-candy at least for storage fetishists. biggrin.gif
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #14 of 30
Thread Starter 
The Disk Racks


A.k.a. the main part of this undertaking. smile.gif


As mentioned elsewhere, one of the two main problem of our current server is
that it only has seven HDD slots, and they're already all filled up. The only
way to get more storage is to install larger disks, which isn't really all that
optimal.

One of the main points of this build was to have more disk slots. The PP689 only
offers four in its stock form, which you can upgrade to a maximum of thirteen
drives. You would need to buy another four-disk enclosure (which btw. I could
not find anywhere to buy), and a five-disk enclosure for the 5.25" bays. Since
13 drives aren't really that many, and since these enclosures aren't exactly
cheap, I decided to go another route.

It took me a while to figure out how to do it, but in the end this is what I
came up with. I had very generous help from one of my neighbours, who has a mill
and a lathe at his disposal, as well as plenty of time (he's a pensioneer biggrin.gif ).


So off we went:


The Mill


(click image for full res)
aw--apollo--2014-04-02--01--mill.jpeg


First Steps

(click image for full res)
aw--apollo--2014-04-02--02--milling.jpeg


(click image for full res)
aw--apollo--2014-04-02--03--progress.jpeg


The Mill can also serve as a drill press. The drill chuck he looks ridiculously
huge when you put a small drill bit into it (he said they didn't have the
smaller model in stock when he needed to buy his, so he went with the large
one). biggrin.gif

(click image for full res)
aw--apollo--2014-04-02--04--drill-chuck.jpeg


Stumbled upon this when going through my pics. My dog's girlfriend, basically
(she's a labrador and belongs to another one of our neighbours). I was
dogsitting here for an evening a few weeks back. She can be a bit hyperactive at
times, but is a very lovely dog. smile.gif

(click image for full res)
aw--apollo--2014-04-02--05--sleepy.jpeg


Drilling and Milling

Lots of holes needed to be drilled for the pop rivets that were going to hold it
all together.

(click image for full res)
aw--apollo--2014-04-02--06--drill-drill-drill.jpeg

(click image for full res)
aw--apollo--2014-04-02--07--drill-drill-drill.jpeg


Milling out the slots for the screwheads:

(click image for full res)
aw--apollo--2014-04-02--08--mill-mill-mill.jpeg


Phase I Complete

The side panels of the disk racks completed. Testing with some broken old HDDs
I had laying around to make sure it all fits as it should. It does. smile.gif

(click image for full res)
aw--apollo--2014-04-02--09--cage-panels.jpeg

(click image for full res)
aw--apollo--2014-04-02--10--cage-panels.jpeg

(click image for full res)
aw--apollo--2014-04-02--11--cage-panels.jpeg


Rail Detail

This is how the construct looks on the side where you slide in the disks. You
can see the pop rives I used to assemble it, the slots which are pictured being
milled above for the screwheads and the screws on the disks. You can also see
the recesses into which the screws mounted on the HDDs lock. The system works
very well.

(click image for full res)
aw--apollo--2014-04-02--12--cage-rail-detail.jpeg

(click image for full res)
aw--apollo--2014-04-02--13--cage-rail-detail.jpeg


Ventilation

Obviously, 24 HDDs are going to put out some heat, so some ventilation is
required. I'm using six Papst fans for that. The fans will be bolted onto the
panels with some L profiles. Unfortunately, 120 mm fans have 105 mm hole
distance, and HDDs are ~100 mm wide, so it's not possible to mount the fan on
both sides, only two screws can be used. It's not really a problem though, two
screws tightened down nicely give sufficient stability.

(click image for full res)
aw--apollo--2014-04-02--14--fan-rail.jpeg

(click image for full res)
aw--apollo--2014-04-02--15--fan-rail.jpeg

(click image for full res)
aw--apollo--2014-04-02--16--fan-rail.jpeg

(click image for full res)
aw--apollo--2014-04-02--17--fan-rail-detail.jpeg


Mounting Brackets

The panels are mounted to the bottom and top of the case with screws. To have
some leeway in adjusting things, there are slots instead of round holes in some
places.

(click image for full res)
aw--apollo--2014-04-02--18--disk-rack-mounting-bracket.jpeg


Top:

(click image for full res)
aw--apollo--2014-04-02--19--disk-rack-mounting-bracket.jpeg


Bottom:

(click image for full res)
aw--apollo--2014-04-02--20--disk-rack-mounting-bracket.jpeg


Fan Mounting

Since the fan screws need to be tightened rather heavily, the screws exert quite
a bit of pressure on the fan frames. To prevent the fan frames from being
crushed and/or breaking, we made some brass bushings that take the brunt of the
pressure.

(click image for full res)
aw--apollo--2014-04-02--21--fan-bushings.jpeg


And Mounted

And finally the disk racks are mounted inside the case. smile.gif

(click image for full res)
aw--apollo--2014-04-02--22--disk-racks.jpeg

(click image for full res)
aw--apollo--2014-04-02--23--disk-racks.jpeg


Disk Mounting

The Disks just slide into the slots and lock into place in the recesses you can
see above. Since I can't tighten the screws, I'm using Loctite to prevent them
from falling out due to vibration. I tried to get some screws similar to those
Lian Li use for their HDD mounting, but the only ones I could find were so
expensive that they'd have cost me more than 100 USD. So yeah, nope...

(click image for full res)
aw--apollo--2014-04-02--24--disk-screws.jpeg



There's still lots to do, but that was by far the most work intensive part of
this build, took us quite a while to get it done. And no, it won't be painted or
anything, the server will stand in a closed room in our appartment anyway. I'd
have loved to make it all pretty and nice, but at the moment I just don't have
the time.


So long, and until next time. smile.gif
-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #15 of 30
Thread Starter 
Chipset Cooling, Adventures in Instability


As some may be aware, I originally had some issues when trying to
get this machine to run stable. While stress testing with mprime,
it repeatedly and reproduceably crashed after less than an hour,
sometimes even already after a few minutes. Each time after
crashing, it took me several tries and about 10 to 20 minutes to
get the board to POST again.

After some troubleshooting and running a few diagnostics, it
turned out that the 5520 chipset was running really hot. It's
temperature threshold as indicated by the system is 95 degrees
Celsius, and when I was last able to check on it before a crash,
it had already passed 85 deg C, so I suspected that it was bumping
up against the threshold, upon which the board did an emergency
shutoff and mandated a cooldown period until it would run again.

As an emergency fix, I took the 80 mm San Ace fan that came with
the case and mounted it to the chipset heatsink with some waxed
cotton cord, and voilà somewhere slightly above 70 deg C maximum.
smile.gif

Unfortunately I forgot to take pictures of that rather ghetto
setup before dismantling it again and replacing it with something
more solid, but I have managed to blow up some sections from
another picture that should at least give you an idea of how it
looked.


Some Improvisation

Apologies for the horrid picture quality, as said this is a blowup
from a picture of which this section is only a small part.
(click image for full res)
aw--apollo--2014-04-03--01--chipset-fan-ghetto.jpeg


A More Permanent Solution

The chipset heatsink is just your run of the mill alu heatsink held
on by a spring clamp with some hooks.

(click image for full res)
aw--apollo--2014-04-03--02--chipset-heatsink.jpeg


And the naked chipset after cleaning off the TIM. That stuff was a
***** to get off, it had dried up rather significantly.

(click image for full res)
aw--apollo--2014-04-03--03--chipset-naked.jpeg


Since the 80 mm fan is quite a bit larger than the chipset
heatsink itself, I needed to either replace the heatsink or modify
it in order to be able to mount the fan to it. I took a
rather crude, but very effective approach: I took an L piece of
aluminium, drilled two holes across the heatsink, cut some M4
threads on those two holes (which worked despite the holes only
going through the fins and not being continuous), then bolted the
L piece to the heatsink with two M4 screws. Works like a charm. smile.gif

Don't mind the unclean alu bits from the drilling and cutting on
the heatsink between the fins, it wasn't really possible to
properly clean that off and make the holes as clean as one usually
does.

(click image for full res)
aw--apollo--2014-04-03--04--chipset-heatsink-bolts.jpeg


And from the other side...

(click image for full res)
aw--apollo--2014-04-03--05--chipset-cooler-bolts.jpeg


The fan itself is held down by three screws, two in the L piece...

(click image for full res)
aw--apollo--2014-04-03--06--chipset-fan.jpeg


... and one in the corner of the heatsink itself. The bent fins
are from drilling and cutting the thread, they got a bit
structurally weak at their edges due to that. Doesn't impair
functionality, so not such a big deal since it won't be visible
anyway.

(click image for full res)
aw--apollo--2014-04-03--07--chipset-fan-third-bolt.jpeg


And the whole package:

(click image for full res)
aw--apollo--2014-04-03--08--chipset-fan-unit.jpeg


The heatsink unit mounted on the M/B. You need to unmount the fan
to do that. You can again see the bent fins here.

(click image for full res)
aw--apollo--2014-04-03--09--chipset-heatsink-mounted.jpeg


And mounted, with the fan:

(click image for full res)
aw--apollo--2014-04-03--10--chipset-cooling-unit.jpeg



That's it for today, thanks for stopping by. smile.gif


-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #16 of 30
Thread Starter 
Disk Ventilation


Although disks have become quite frugal when it comes to
power consumption these days (at least some of them) and HDD
cooling is not really a huge issue for most people, packing
24 disks as closely together as in this build will cause
heat issues without ventilation. There is no need for 3k rpm
Delta fans though, a whiff of cool air breezing over the
disks should do the job nicely.

For this purpose, as you may have seen in some previous
pics, I have chosen 6 120 mm Papst fans, specifically the
4412 GLL model, and am running them at 7 V. The fans draw
air in through a vent area, and it then gets passed through
the M/B compartment and out the back.

Each fan is fixed to a rail riveted to one of the disk rack
panels with two screws.


You've seen this before, but for completeness' sake I'm
adding the pics of the bushings used to prevent the fan
frames from being crushed to this update as well:

(click image for full res)
aw--apollo--2014-04-02--21--fan-bushings.jpeg


I exchanged the copper screws for some silver ones, and in
the process added some dampening foam between the mouning
rails and the fan frame.

(click image for full res)
aw--apollo--2014-04-10--01--disk-fan-dampening.jpeg


The whole fan panel assembly:

(click image for full res)
aw--apollo--2014-04-10--02--disk-fans.jpeg


While doing some test runs, I noticed that a rather large
amount of air was being expelled through the front of the
case instead of going into the M/B compartment and out the
back (I wasn't really surprised by this seeing as how open
the front was). Obviously, this was not optimal. So I took a
1.5 mm panel of alu and bolted it to the front.

Because the existing front has a few folds in it, I needed
to do some cutting on the case first.


(click image for full res)
aw--apollo--2014-04-10--03--front-panel-folds.jpeg

(click image for full res)
aw--apollo--2014-04-10--04--front-panel-marked.jpeg

(click image for full res)
aw--apollo--2014-04-10--05--cut-preparation.jpeg

(click image for full res)
aw--apollo--2014-04-10--06--front-panel-mounted.jpeg


After having done that, I turned my attention to the side
panel, making an opening for the ventilation. I thought of
several ways of doing this, but all of them were a bit more
complicated than I'd have liked them to be. Cutting such a
big hole with a dremel isn't really practical, so I
considered doing it with our jigsaw, but after doing a few
test cuts I didn't really like the result as I couldn't get
a straight enough cut. And the cut needed to be clean,
because there's no space to fit a U channel over the edge,
and I don't really like the idea of covering it up on the
outside.

Anyway, the guy just used a nice big angle grinder for the
cut, and since he's a metal worker by trade, it turned out
almost perfectly straight (not 100%, but it's still cut by
hand, after all wink.gif). After that, I painted the bare edge
with some model paint to not have the blank metal staring at
me.

I thought about painting the mesh, but at the moment I don't
really have the time, plus I kind of like the look of this
bare piece of alu, so I've left it as-is.

(click image for full res)
aw--apollo--2014-04-10--07--side-panel-vent-raw.jpeg


The mesh doesn't cover the whole fan area (nor is it very
open with those rather narrow slots), but there is no need
for high-power ventilation here, so this is not a big deal.

(click image for full res)
aw--apollo--2014-04-10--08--side-panel-vent-test-fit.jpeg

It's fixed to the inside of the panel with some double-sided
adhesive tape.

(click image for full res)
aw--apollo--2014-04-10--09--side-panel-vent-mesh.jpeg


And in its final config:

(click image for full res)
aw--apollo--2014-04-10--10--side-panel-vent-final.jpeg


Drive temperatures hover between 28 deg C and 35 deg C at
the moment, ambient is about 23 deg C. smile.gif


Until next time,
-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #17 of 30
Thread Starter 
Triple Fan Unit



As hinted at earlier, the airflow in this build will go from
the front compartment through the middle wall into the M/B
compartment and out the back.

This is pretty much how the stock configuration works,
except in that the air gets in through the front panel, not
through the side panel.

Unfortunately I forgot to take pics of the stock config, but
luckily tweaktown.com did a review on this case and took them
for me. biggrin.gif


Source article where I got the image from can be found here.

In the stock config, the 92 mm fans are mounted inside
some plastic fan cages that allow quick and toolless fan
replacement in case of failure.

(click image for full res)
aw--apollo--2014-04-12--00a--stock-config-tweaktown.jpeg


And without the fan cages:

(click image for full res)
aw--apollo--2014-04-12--00b--stock-config-tweaktown.jpeg


Originally I just screwed the fans to two aluminium L
profile bars.

(click image for full res)
aw--apollo--2014-04-12--01--triple-fan-unit.jpeg

(click image for full res)
aw--apollo--2014-04-12--02--triple-fan-unit.jpeg

(click image for full res)
aw--apollo--2014-04-12--03--triple-fan-unit.jpeg


It was fixed to the middle wall with double-sided adhesive
tape. It's very strong stuff, so the fan unit falling off
was not a concern. Additionally, the tape has some thickness
to it, which should provide some dampening between the fan
unit and the middle wall.

(click image for full res)
aw--apollo--2014-04-12--04--triple-fan-unit-taped.jpeg


Unfortunately, due to some bumps on the middle wall getting in
the way, the tape on the rear angle didn't make proper contact
with the wall. It held, but not very well.

Additinoally, I noticed that there were rather strong
vibtrations on the middle wall. It turned out that the tape
did indeed offer some decoupling, but it also did not
offer any additional strength to the middle wall (i.e. no
additional stiffness), which meant the wall could easily
vibrate.

(click image for full res)
aw--apollo--2014-04-12--05--triple-fan-unit-adhesive-failure.jpeg


So, I took the unit out, and while I was at it, I also cut
out some recesses for the fans which I didn't bother doing
before. I also put some dampening foam between the fans and
the alu angles.

(click image for full res)
aw--apollo--2014-04-12--06--triple-fan-unit-improvements.jpeg


Aaand of course I mounted the fans the wrong way
round. Sigh.

(click image for full res)
aw--apollo--2014-04-12--07--triple-fan-unit-welp.jpeg


Disassemble again, reassemble.

(click image for full res)
aw--apollo--2014-04-12--08--triple-fan-unit-better.jpeg


Also: Foam between the alu angles and the wall itself:
(click image for full res)
aw--apollo--2014-04-12--09--triple-fan-unit-padding.jpeg


This time I bolted it to the wall with some screws. Much
more solid now, no more vibrations. smile.gif

(click image for full res)
aw--apollo--2014-04-12--10--triple-fan-unit-mounted.jpeg


How it looks from the other side:

(click image for full res)
aw--apollo--2014-04-12--11--triple-fan-unit-final.jpeg


Cheers,
-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #18 of 30
Thread Starter 
Storage Topology & Cabling


Storage Topology


In case you can't read the text, the full res version should
be more easily readable.

(click image for full res)
aw--apollo--2014-04-13--storage-topology.png


The idea behind the storage topology is based on the concept
Any one of the three LSI controllers can fail and I still
have all my data available.

You'll see below that I haven't yet gotten around to
installing the Velociraptor.

I use coloured zip ties to mark the cables that go to the
different controllers.

BLUE = controller 0
YELLOW = controller 1
GREEN = controller 2


Tidiness

There isn't really any space to hide the cables, so this was
rather tricky and required three attempts until I was
satisfied with the result. In the end I hid the extra cable
behind the triple fan unit, good thing they're 38 mm fans,
which makes the space behind them just about large enough to
fit the extra cable bits.

The power cables for the disks are two cables that came with
the PSU and onto which I just put a lot more connectors
while taking off the stock connectors because those were
neither placed in the correct locations nor facing in the
right direction.


Looks harmless, right? Yeah...

(click image for full res)
aw--apollo--2014-04-13--01--cables-harmless.jpeg


And the disks:
(click image for full res)
aw--apollo--2014-04-13--02--disks.jpeg


OK then, first try:
(click image for full res)
aw--apollo--2014-04-13--03--all-cables.jpeg

I soon realized that this wasn't going to work. The problem
was that I had the disks arranged in the same way as the
will be set up in the storage pool layout, so the disks
which go into the same storage pool were also mounted below
each other. Sounds nice in theory, but if you want to
have disk from each pool distributed among the different
controllers, you'll get quite the cable mess.

(click image for full res)
aw--apollo--2014-04-13--04--cabling-round-1.jpeg

(click image for full res)
aw--apollo--2014-04-13--05--cabling-round-1.jpeg


Second Try

Next try, this time I arranged the disks to that the cables
to the controllers could be better laid out. Since I wanted
to set up all the cables for all the disk slots, even ones
that will stay empty for now, I had to shuffle the disks
around when laying out the cables.

(click image for full res)
aw--apollo--2014-04-13--06--cabling-round-2.jpeg

(click image for full res)
aw--apollo--2014-04-13--08--cable-hydra.jpeg

(click image for full res)
aw--apollo--2014-04-13--09--cable-crossruns.jpeg


Better. But I still wasn't quite happy, mainly because...

(click image for full res)
aw--apollo--2014-04-13--10--cables-done.jpeg

(click image for full res)
aw--apollo--2014-04-13--11--disks-distributed.jpeg

(click image for full res)
aw--apollo--2014-04-13--12--cables-detail.jpeg


... of this:

(click image for full res)
aw--apollo--2014-04-13--13--cables-nest.jpeg


Third Try


This time I made sure the cables stayed tidy on both ends
while hiding the mess (which cannot be avoided since all
cables are the same length but lead to different end points,
obviously) behind the triple fan unit.

(click image for full res)
aw--apollo--2014-04-13--15--hiding-space.jpeg


The loop of extra cable length for the top cable loom:

(click image for full res)
aw--apollo--2014-04-13--16--hiding-space.jpeg


And the cable loom for controller 0, from the disk side...

(click image for full res)
aw--apollo--2014-04-13--17--cable-loom-controller-0.jpeg


and the M/B side. Much better IMHO. smile.gif

(click image for full res)
aw--apollo--2014-04-13--18--cable-loom-controller-0.jpeg


The bottom controller had a bit more extra cable length to hide, so
that part is a bit messier.

(click image for full res)
aw--apollo--2014-04-13--19--cable-loom-controller-2.jpeg

And the middle one:
(click image for full res)
aw--apollo--2014-04-13--20--cable-loom-controller-1.jpeg


Tada! While not perfect (I'd need longer cables for that to
make cleaner runs, but I'm not buying more cables just for
the sake of that for a build that has a closed side panel),
with this iteration of my cabling I'm now rather happy:

(click image for full res)
aw--apollo--2014-04-13--21--disk-rack-cables-overview.jpeg

(click image for full res)
aw--apollo--2014-04-13--22--disk-rack-cables-closeup.jpeg

(click image for full res)
aw--apollo--2014-04-13--23--disk-rack-cables-closeup.jpeg


And the other side. Much better than before methinks. smile.gif

(click image for full res)
aw--apollo--2014-04-13--24--mb-cmpt-overview.jpeg

(click image for full res)
aw--apollo--2014-04-13--25--mb-cmpt-closeup.jpeg


The SATA cable for the system SSD:

(click image for full res)
aw--apollo--2014-04-13--26--system-drive-sata-cable.jpeg


And the controller LEDs when there's some activity:

(click image for full res)
aw--apollo--2014-04-13--27--controller-lights.jpeg


Now if you'll excuse me, there's a dinner waiting to be
cooked. smile.gif


Cheers,
-aw
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
post #19 of 30
Very nice build, I love the HDD rack you did, made me think about making something similar for my server. Also I'm pretty sure that I'm gonna steal your chipset cooler idea, it's ridiculous how hot that chip gets.

I'm curious though about your choice to go Arch instead of something more enterprise focused like CentOS or Debian.
Footrest
(17 items)
 
server
(17 items)
 
HTPC
(12 items)
 
CPUMotherboardGraphicsRAM
2 x Xeon L5520 Supermicro X8DTL-i HD4550 Samsung 6x4GB ECC 
Hard DriveHard DriveCoolingOS
3 x 2TB WD Green 160GB WD Blue Hyper 212+ and EVO ESXi 
OSOSOSPower
unRaid pfSense Ubuntu CX430v2 
CaseOtherOther
CM Elite 331 TP-Link TG-3269 Sil3512 Sata controller 
CPUMotherboardRAMHard Drive
i3-2100T Asus P8H61-I Geil Black Dragon 1333 2x2GB PXE Network boot 
Optical DriveCoolingOSMonitor
OEM Slim DVD Burner Scythe Big-Shuriken OpenElec Panasonic TX-P42G30E 42" HDTV 
KeyboardCase
Lenovo n5901a Silverstone SG-05 
  hide details  
Reply
Footrest
(17 items)
 
server
(17 items)
 
HTPC
(12 items)
 
CPUMotherboardGraphicsRAM
2 x Xeon L5520 Supermicro X8DTL-i HD4550 Samsung 6x4GB ECC 
Hard DriveHard DriveCoolingOS
3 x 2TB WD Green 160GB WD Blue Hyper 212+ and EVO ESXi 
OSOSOSPower
unRaid pfSense Ubuntu CX430v2 
CaseOtherOther
CM Elite 331 TP-Link TG-3269 Sil3512 Sata controller 
CPUMotherboardRAMHard Drive
i3-2100T Asus P8H61-I Geil Black Dragon 1333 2x2GB PXE Network boot 
Optical DriveCoolingOSMonitor
OEM Slim DVD Burner Scythe Big-Shuriken OpenElec Panasonic TX-P42G30E 42" HDTV 
KeyboardCase
Lenovo n5901a Silverstone SG-05 
  hide details  
Reply
post #20 of 30
Thread Starter 
Quote:
Originally Posted by Aximous View Post

Very nice build, I love the HDD rack you did, made me think about making something similar for my server.

Thanks, I appreciate the compliment! smile.gif
Quote:
Originally Posted by Aximous View Post

Also I'm pretty sure that I'm gonna steal your chipset cooler idea, it's ridiculous how hot that chip gets.

Yes, ridiculous indeed. I noticed that when I started playing with my SR-2, the fan on
that thing was very busy. Good thing I now have a watercooler on that chipset, but I
didn't really feel like going W/C for this bulid. wink.gif
Quote:
Originally Posted by Aximous View Post

I'm curious though about your choice to go Arch instead of something more enterprise focused like CentOS or Debian.

Two reasons primarily, the first one being my familiarity with it. I know there are people
who tend to go "Ah, Arch, bleeding edge, unstable!" and all that. But in all honesty, I've
been using it as my daily driver on several machines for three years now, and I've had
only one case of actual proper system breakage, and that was related to Gnome. And
even then, I just did a clean reinstall and was back up and running within about two
hours with all my settings and stuff from before.

I know my way around Arch well enough to feel comfortable with it and be efficient-ish
when needing to troubleshoot, which I can't say for Debian (or FreeBSD, which I actually
also considered at some point and did play around with on another machine for a while),
or other distros (I could learn, of course, but at the moment I'm a bit pressed for time with
college and all, I need this thing up and running sooner rather than later).

Secondly, ZFS support is very good on Arch, whereas I've read a few posts around some
forums which said that ZFS under Debian-based distros is... hinky. I haven't personally
tried it, so I can't speak from personal experience on that one though. I have been using
ZFS on Arch on another machine for about nine months now and it's been working very
well, so I thought I'd deploy it on this machine too.


So basically, "If it ain't broke, don't fix it." biggrin.gif
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
ZEUS
(14 items)
 
HELIOS
(7 items)
 
 
CPUMotherboardRAMHard Drive
Intel i7 2600k MSI Z77A-GD65 Kingston HyperX Western Digital RE4 
Hard DriveCoolingCoolingCooling
Western Digital Red EKWB Supreme HF Alphacool NexXxos UT60 360 mm Corsair SP120 Quiet Edition 
CoolingOSMonitorKeyboard
Aquacomputer Aquastream Standard Arch Linux 64 Bit Dell 24" 1920x1200 Qpad Mk85 
PowerCase
BeQuiet 550W Fractal Design R4 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Case Mod Work Logs
Overclock.net › Forums › Case Mods & Cases › Builds & Case Mods › Case Mods › Case Mod Work Logs › APOLLO (2CPU LGA1366 Server | InWin PP689 | 24 Disks Capacity) - by alpenwasser