Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Best Linux Distro For Cluster
New Posts  All Forums:Forum Nav:

Best Linux Distro For Cluster

post #1 of 44
11/8/12 at 8:05pm
Thread Starter 
  • Joined: Nov 2012
  • Location: 127.0.0.1
  • Posts: 1,553
  • Rep: 201 (Unique: 149)
  • Reviews: 3
  • Trader Rating: 12
  • Folding Team Rank: 456
  • Folding Team Name: Just Be Cause
  •  
    Name Team Rank Points / May Work Units / May
    DizZz 456 5,705,344 / 1,266,314 1,039 / 153
     
  • Select All Posts By This User
Hey OCN. I'm developing a small (7) node cluster at school and am wondering what the best option is for the operating system. I've been reading around on other forums and the general consensus seems to be a red hat derivative like CentOS or Scientific Linux. Thoughts?
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 2 x Sapphire HD 7990 (soon) G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 2 x Sapphire HD 7990 (soon) G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
post #2 of 44
11/8/12 at 9:53pm
rocks may be worth looking at.

http://www.rocksclusters.org/wordpress/
Reply
Reply
post #3 of 44
11/9/12 at 7:35am
SuSE also has some clustering tools - though I've never used them personally.

Would you mind updating this thread with details about the type of cluster you build (etc) as I'd be really interested to hear your progress.
Reply
Reply
post #4 of 44
11/9/12 at 7:57am
Thread Starter 
  • Joined: Nov 2012
  • Location: 127.0.0.1
  • Posts: 1,553
  • Rep: 201 (Unique: 149)
  • Reviews: 3
  • Trader Rating: 12
  • Folding Team Rank: 456
  • Folding Team Name: Just Be Cause
  •  
    Name Team Rank Points / May Work Units / May
    DizZz 456 5,705,344 / 1,266,314 1,039 / 153
     
  • Select All Posts By This User
Quote:
Originally Posted by Plan9 View Post

SuSE also has some clustering tools - though I've never used them personally.
Would you mind updating this thread with details about the type of cluster you build (etc) as I'd be really interested to hear your progress.

I am planning to make a Beowulf Cluster and i will definitely keep this thread updated. I have the nodes but just have to finalize on what OS i want to use. The nodes have pentium 4 processors with 2gb of ram so im not sure if they can handle suse since it is a pretty dense distro.

More info here:
http://en.wikipedia.org/wiki/Beowulf_cluster
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 2 x Sapphire HD 7990 (soon) G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 2 x Sapphire HD 7990 (soon) G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
post #5 of 44
11/10/12 at 1:40am
7 x Pentium 4's == 7 cores x ~3Ghz
Cost of running will be high due to power consumption
And the P4's deep pipeline may be problematic depending on what the task is.

My opinion would be to go a single box with a mid range Xeon (4 core hyperthreaded or a 10 core if you can)
I assume your task is parrallelisable (can be ran in many threads/cores)

The Xeon will monster it, it also has a much faster FSB, much higher memory capacity and a better instruction set... Unless your re-purposing the P4's due to money...
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
post #6 of 44
11/10/12 at 1:51am
  • Joined: Jan 2007
  • Location: North Lakes, QLD
  • Posts: 427
  • Rep: 36 (Unique: 33)
  • Folding Team Rank: 1,754
  •  
    Name Team Rank Points / May Work Units / May
    Chickenman 1,754 636,140 / 0 185 / 0
     
  • Select All Posts By This User
Generally people do these things because they can and have old machines lying around not because it's the best thing to do tongue.gif
Damn Watermelon
(16 items)
  		  
CPUMotherboardGraphicsRAM
I7 2600K Gigabyte P67A UD3R B3 GTX 660 Ti + CM Seidon 120M CLC. Kingston HyperX 1600 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
OCZ Agility3 Seagate Green Seagate Green LG Blu-ray combo 
CoolingOSMonitorKeyboard
Cooler Master Hyper 212 Evo Win8 64bit Samsung S23B300 Black 
PowerCaseMouseMouse Pad
Thermal Take TP 750 Fractal Arc Midi Logitech G400 Desktop 
View all
  hide details  
Reply
Damn Watermelon
(16 items)
  		  
CPUMotherboardGraphicsRAM
I7 2600K Gigabyte P67A UD3R B3 GTX 660 Ti + CM Seidon 120M CLC. Kingston HyperX 1600 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
OCZ Agility3 Seagate Green Seagate Green LG Blu-ray combo 
CoolingOSMonitorKeyboard
Cooler Master Hyper 212 Evo Win8 64bit Samsung S23B300 Black 
PowerCaseMouseMouse Pad
Thermal Take TP 750 Fractal Arc Midi Logitech G400 Desktop 
View all
  hide details  
Reply
post #7 of 44
11/10/12 at 2:28am
Quote:
Originally Posted by Chickenman View Post

Generally people do these things because they can and have old machines lying around not because it's the best thing to do tongue.gif

Yeah I know, I'm into old hardware too smile.gif

Just throwing it out there in case this was for some "production" use.
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
post #8 of 44
11/10/12 at 3:13am
Quote:
Originally Posted by dushan24 View Post

Yeah I know, I'm into old hardware too smile.gif
Just throwing it out there in case this was for some "production" use.

I maybe reading between the lines, but the impression I got was that this was part of an IT course at college
Reply
Reply
post #9 of 44
11/10/12 at 5:47am
@dushan24
Quote:
Originally Posted by DizZz View Post

Hey OCN. I'm developing a small (7) node cluster at school ...

Bit of a giveaway, don't you think? tongue.gif
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
post #10 of 44
11/10/12 at 7:10am
Yes yes, I concede.

Come on though guys, back on topic.
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
Subjugate the Weak
(19 items)
  		  
CPUMotherboardGraphicsGraphics
Intel Core i7 860 Asus P7P55D-E Pro MSI GTX560 Ti TwinFrozr II SLI MSI GTX560 Ti TwinFrozr II SLI 
RAMHard DriveHard DriveHard Drive
Corsair 8GB DDR3 1600MHz CL9 XMS3 (2 x 4GB) OCZ Vertex 3 SSD Western Digital Caviar Black 1TB 7200RPM 64MB C... Western Digital Caviar Green 1TB ~5900RPM 64MB ... 
Optical DriveCoolingOSMonitor
Lite-On 24x DVD-RW CoolerMaster V8 Windows 7 Professional SP1 3 x Samsung S22B350H 
KeyboardPowerCaseMouse
Ducky Shine II Corsair HX850 CoolerMaster Storm Enforcer Logitech M500 
Mouse PadAudio
Razer Goliathus Microsoft LifeChat LX 3000 
View all
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Linux, Unix
Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Best Linux Distro For Cluster