Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Best Linux Distro For Cluster
New Posts  All Forums:Forum Nav:

Best Linux Distro For Cluster - Page 2

post #11 of 44
11/11/12 at 1:45pm
@OP

You could start with an Ubuntu Server install and then add in the cluster packages afterwards. Ubuntu Server is pretty lightweight, so most of the RAM will be for your data. What kind of applications do you plan on running? This will determine your cluster topology.
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
post #12 of 44
11/11/12 at 4:35pm
  • Joined: Feb 2012
  • Location: Halifax N.S. Canada
  • Posts: 3,387
  • Rep: 128 (Unique: 98)
  • Reviews: 3
  • Folding Team Rank: 3,081
  •  
    Name Team Rank Points / May Work Units / May
    JLloyd13 3,081 139,050 / 0 70 / 0
     
  • Select All Posts By This User
Quote:
Originally Posted by parityboy View Post

@OP

You could start with an Ubuntu Server install and then add in the cluster packages afterwards. Ubuntu Server is pretty lightweight, so most of the RAM will be for your data. What kind of applications do you plan on running? This will determine your cluster topology.

why ubuntu?? why not debian, or centos?
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
post #13 of 44
11/12/12 at 6:49am
Thread Starter 
  • Joined: Nov 2012
  • Location: 127.0.0.1
  • Posts: 1,596
  • Rep: 206 (Unique: 153)
  • Reviews: 3
  • Trader Rating: 13
  • Folding Team Rank: 437
  • Folding Team Name: Just Be Cause
  •  
    Name Team Rank Points / May Work Units / May
    DizZz 437 6,039,013 / 1,599,983 1,078 / 192
     
  • Select All Posts By This User
yeah i got this old hardware for free so buying xeons isnt an option unfortunately. the pentium 4's have HT and are running at 3.4ghz. as for the operating system i think im going to use scientific linux since it is so expandable and has a lot of support.
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 3 x EVGA GeForce GTX 780 SC w/ ACX Cooler G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 3 x EVGA GeForce GTX 780 SC w/ ACX Cooler G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
post #14 of 44
11/12/12 at 7:00am
Quote:
Originally Posted by DizZz View Post

yeah i got this old hardware for free so buying xeons isnt an option unfortunately. the pentium 4's have HT and are running at 3.4ghz. as for the operating system i think im going to use scientific linux since it is so expandable and has a lot of support.

A word of warning, I seem to recall HT in the old P4's was total garbage and could actually break some multi-thread applications. Hopefully this wouldn't be an issue for a cluster (in fact, there's a chance I could be making this up entirely lol), but if you do run into some strange anomalies then it might be worth disabling HT in the node's BIOS'.
Reply
Reply
post #15 of 44
11/12/12 at 7:08am
  • Joined: May 2011
  • Location: Studying in Blacksburg, VA; Hometown: Raleigh, NC
  • Posts: 586
  • Rep: 32 (Unique: 28)
  • Reviews: 1
  • Folding Team Rank: 137
  • Folding Team Name: Slammers
  •  
    Name Team Rank Points / May Work Units / May
    benpack101 137 19,955,259 / 976,675 4,685 / 106
     
  • Select All Posts By This User
This sounds like is going to be an interesting little project, keep us updated, turn this into a work log!

And although my experience is quite limited, I would suggest CentOS!
Phantom 1.0
(16 items)
 
PAIN
(11 items)
  		 
CPUMotherboardGraphicsRAM
Intel Core i7 3930K P9X79 PRO NVIDIA GeForce GTX 560  Samsung  
RAMHard DriveHard DriveOptical Drive
Samsung  Crucial M4 64GB SSD Seagate Barracuda 1TB ASUS 24x DVD Burner 
CoolingOSOSMonitor
NH-D14 Windows 7 Ultamite 64 bit Fedora 17 ASUS VW246H Glossy Black 24" HDMI Widescreen LC... 
KeyboardPowerCaseMouse
Logitech Combo mk520 Seasonic X Series 650W NXT Phantom 410 Logitech Combo mk520 
View all
CPUMotherboardGraphicsRAM
Intel Core i7 2600K P8Z68-V PRO GEN3 NVIDIA GeForce GTX 560 Ti  Samsung  
RAMHard DriveHard DriveCooling
Samsung  Seagate Barracuda HDD Crucial M4 SSD Corsair H80 
OSPowerCase
Windows 7 Enterprise Seasonic M12II 750w Plexiglass 
View all
  hide details  
Reply
Phantom 1.0
(16 items)
 
PAIN
(11 items)
  		 
CPUMotherboardGraphicsRAM
Intel Core i7 3930K P9X79 PRO NVIDIA GeForce GTX 560  Samsung  
RAMHard DriveHard DriveOptical Drive
Samsung  Crucial M4 64GB SSD Seagate Barracuda 1TB ASUS 24x DVD Burner 
CoolingOSOSMonitor
NH-D14 Windows 7 Ultamite 64 bit Fedora 17 ASUS VW246H Glossy Black 24" HDMI Widescreen LC... 
KeyboardPowerCaseMouse
Logitech Combo mk520 Seasonic X Series 650W NXT Phantom 410 Logitech Combo mk520 
View all
CPUMotherboardGraphicsRAM
Intel Core i7 2600K P8Z68-V PRO GEN3 NVIDIA GeForce GTX 560 Ti  Samsung  
RAMHard DriveHard DriveCooling
Samsung  Seagate Barracuda HDD Crucial M4 SSD Corsair H80 
OSPowerCase
Windows 7 Enterprise Seasonic M12II 750w Plexiglass 
View all
  hide details  
Reply
post #16 of 44
11/12/12 at 8:36am
  • Joined: Feb 2012
  • Location: Halifax N.S. Canada
  • Posts: 3,387
  • Rep: 128 (Unique: 98)
  • Reviews: 3
  • Folding Team Rank: 3,081
  •  
    Name Team Rank Points / May Work Units / May
    JLloyd13 3,081 139,050 / 0 70 / 0
     
  • Select All Posts By This User
Quote:
Originally Posted by Plan9 View Post

Quote:
Originally Posted by DizZz View Post

yeah i got this old hardware for free so buying xeons isnt an option unfortunately. the pentium 4's have HT and are running at 3.4ghz. as for the operating system i think im going to use scientific linux since it is so expandable and has a lot of support.

A word of warning, I seem to recall HT in the old P4's was total garbage and could actually break some multi-thread applications. Hopefully this wouldn't be an issue for a cluster (in fact, there's a chance I could be making this up entirely lol), but if you do run into some strange anomalies then it might be worth disabling HT in the node's BIOS'.

I seem to recall half the problem behind the P4 HT was lack of optimization from the software.

@benpack CentOS and scientific linux are almost exactly the same. both rebuilds of Red Hat
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
post #17 of 44
11/12/12 at 10:40am
Quote:
Originally Posted by jrl1357 View Post

why ubuntu?? why not debian, or centos?

Simply because I'm not familiar with them, and I know that Ubuntu Server comes with very little pre-installed. It's not quite in the Arch/Gentoo/LFS league, but it's pretty skinny. smile.gif
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
post #18 of 44
11/12/12 at 10:53am
Thread Starter 
  • Joined: Nov 2012
  • Location: 127.0.0.1
  • Posts: 1,596
  • Rep: 206 (Unique: 153)
  • Reviews: 3
  • Trader Rating: 13
  • Folding Team Rank: 437
  • Folding Team Name: Just Be Cause
  •  
    Name Team Rank Points / May Work Units / May
    DizZz 437 6,039,013 / 1,599,983 1,078 / 192
     
  • Select All Posts By This User
Quote:
Originally Posted by parityboy View Post

Simply because I'm not familiar with them, and I know that Ubuntu Server comes with very little pre-installed. It's not quite in the Arch/Gentoo/LFS league, but it's pretty skinny. smile.gif

thanks ill look into that
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 3 x EVGA GeForce GTX 780 SC w/ ACX Cooler G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
Beast
(8 items)
 
Green Smoke
(13 items)
 
Macbook Pro
(6 items)
 
CPUMotherboardGraphicsRAM
2 x Intel Xeon E5 2660 ASUS Z9PE-D8 WS 3 x EVGA GeForce GTX 780 SC w/ ACX Cooler G.Skill Ripjaws X Series 64gb 2133mhz 
Hard DriveCoolingOSPower
Samsung 840 Pro 128gb 2 x Thermaltake Water 2.0 Pro Debian w/ pf-kernel 3.9 Corsair AX1200i 
View all
CPUMotherboardGraphicsRAM
Intel i7 2700k @ 5.2ghz MSI Z77A-GD80 2 x Sapphire 7970 Dual-X OC @ 1275mhz G.Skill Ripjaws X Series 16gb 
Hard DriveCoolingOSMonitor
Corsair Force GT 180gb SSD Thermaltake Water 2.0 Extreme Windows 7 Ultimate BenQ XL2420T 
KeyboardPowerCaseMouse
Ducky OCN Edition Corsair AX1200i Cooler Master HAF 932 Cyborg R.A.T. 7 
Mouse Pad
Razer Scarab 
View all
CPUGraphicsRAMHard Drive
Intel C2D P8700 2.53ghz NVIDIA GeForce 9400M  2x4gb 1067mhz Intel 520 Series 180gb 
OSMonitor
Arch Linux 15" {1440x900} 
View all
  hide details  
Reply
post #19 of 44
11/12/12 at 10:56am
  • Joined: Feb 2012
  • Location: Halifax N.S. Canada
  • Posts: 3,387
  • Rep: 128 (Unique: 98)
  • Reviews: 3
  • Folding Team Rank: 3,081
  •  
    Name Team Rank Points / May Work Units / May
    JLloyd13 3,081 139,050 / 0 70 / 0
     
  • Select All Posts By This User
Quote:
Originally Posted by parityboy View Post

Quote:
Originally Posted by jrl1357 View Post

why ubuntu?? why not debian, or centos?

Simply because I'm not familiar with them, and I know that Ubuntu Server comes with very little pre-installed. It's not quite in the Arch/Gentoo/LFS league, but it's pretty skinny. smile.gif

I suggest debian netinstall. even lighter, but very easy. much better then any 'thin' ubuntu crap
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
The Daily (K)Module
(14 items)
  		  
CPUMotherboardGraphicsRAM
AMD Phenom II X4 B55 Biostar A880GZ  AMD Radeon HD 4250 iGPU 8GB (2x4GB) Patriot Sector 5 DDR3 
Hard DriveHard DriveHard DriveOptical Drive
Seagate Barracuda 1TB (ST1000DM003) Western Digital Caviar SE 250GB Seagate External 1TB LG DVD Burner 
OSOSOSPower
Debian GNU/Linux 6.0.6 'Squeeze' 64-bit Arch Linux 64-bit FreeBSD 9.0 64-bit LPS Ultra 550 watt 
Case
Thermaltake V4  
View all
  hide details  
Reply
post #20 of 44
11/12/12 at 11:36am
Ubuntu hater eh? What have you got against Ubuntu Server?
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
Mythica
(14 items)
  		  
CPUMotherboardGraphicsRAM
Intel i3 530 Gigabyte GA-H55M-D2H Palit nVidia GT430 Corsair Dominator 4GB TW3X4G1333C9A 
Hard DriveHard DriveOSMonitor
Hitachi Deskstar 7K500 Samsung HD204UI Linux Mint 13 HP L1800 
KeyboardPowerCaseMouse
Trust EasyScroll Silverline Corsair HX520 Lian-Li PC-A04B Logitech Trackman Wheel 
View all
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Linux, Unix
Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Best Linux Distro For Cluster