Overclock.net › Forums › Specialty Builds › Servers › Enterprise level Bandwidth question
New Posts  All Forums:Forum Nav:

Enterprise level Bandwidth question

post #1 of 4
Thread Starter 
Let's say you have a server farm and you could host all the data that for instance a bunch of newspapers wanted to upload to your farm. In order for the public to access that data, how much uploading bandwidth would be needed for a site that is similar to say nytimes.com or archive.org, what kind of upload speed would you need in order to support a huge simultaneous user base like that, I would think that you would need more than a u-verse line, wouldn't you need some serious bandwidth, like a custom deal with Cox or AT&T to support a website that large. How do the big sites like Facebook, Twitter, nytimes, archive.org all get that information out, where is that upload bandwidth coming from and how does one get into a project like that, server farm with tons of info made public for people to access.

+Rep for help, thoughts, ideas.
post #2 of 4
Most huge web systems are edge served (via companies like akamai, in fact if you open tcpview or a similar program, you'll find you'll be making a lot of connections to akamai). It basically means it's not all hosted in one place, kinda like load balancing, but it also creates redundancy.

A lot of media content (flash etc.) is also typically hosted on seperate servers to increase load times and decreases per server load.

I don't know what companies are using in the US, but here in the UK ethernet products are still mainstream for most companies (ethernet to the exchange), but large hosting companies have contracts to feed off of fiber backbones that can provide earthshattering bandwidth.
space heater
(29 items)
 
S-HVH-01
(11 items)
 
PfSense
(5 items)
 
CPUMotherboardGraphicsRAM
Intel 2500k 4.7GHz  Asus P8P67 Pro(B3) 2 x Club3D 280X 3GB 16GB g.skill 1600MHz C9 
Hard DriveHard DriveHard DriveHard Drive
Samsung 840 Pro 256GB 4 x 2TB Barracudas in RAID10 2 x WD Blue 1TB RAID0 2 x 3TB Seagate Barracuda 
Hard DriveHard DriveOptical DriveCooling
8 x 146GB HP 10k SAS - various RAID levels RAID Controller LSI 9260-8i 512MB LiteOn IHAS124 Noctua NH-D15 
OSMonitorMonitorMonitor
8.1 Enterprise Acer GD245HQ (120hz) LG W2420P LG IPS231P 
MonitorMonitorKeyboardPower
HP ZR24w LG 32LH3000 (w/IPS) Razer Blackwidow Antec TruePower New 750W 
CaseMouseAudioAudio
Corsair 750D Modified original G5 Asus Xonar PCIe Sennheiser HD595 
AudioAudioAudioAudio
Tannoy Mercury 5 NAD C165BEE Bowers & Wilkins 683 Cambridge Audio DACMagic+ 
CPUCPUMotherboardRAM
Intel® Xeon® Processor E5-2630 v3 (20M Cache, 2... Intel® Xeon® Processor E5-2630 v3 (20M Cache, 2... Lenovo RD650 128GB DDR4 ECC REG 
Hard DriveHard DriveHard DriveHard Drive
720ix 12Gbps SAS RAID Controller with 1GB FBWC RAID 0 - 2 x Intel S3500 120GB SSD (deduped VHD... Intel 530 120GB SSD RAID 10 - 8 x Seagate 146GB 10k SAS  
OSPowerCase
Windows Hyper-V Server 2012 R2 2 x LiteION 750W 80PLUS Platinum RD650 24x2.5" chassis 
CPURAMHard DriveOS
Intel® Xeon® Processor X5650  8GB ECC 2 x 146GB SCSI RAID1 PfSense 2.2b 
Other
Intel 4 x 1GbE 
  hide details  
Reply
space heater
(29 items)
 
S-HVH-01
(11 items)
 
PfSense
(5 items)
 
CPUMotherboardGraphicsRAM
Intel 2500k 4.7GHz  Asus P8P67 Pro(B3) 2 x Club3D 280X 3GB 16GB g.skill 1600MHz C9 
Hard DriveHard DriveHard DriveHard Drive
Samsung 840 Pro 256GB 4 x 2TB Barracudas in RAID10 2 x WD Blue 1TB RAID0 2 x 3TB Seagate Barracuda 
Hard DriveHard DriveOptical DriveCooling
8 x 146GB HP 10k SAS - various RAID levels RAID Controller LSI 9260-8i 512MB LiteOn IHAS124 Noctua NH-D15 
OSMonitorMonitorMonitor
8.1 Enterprise Acer GD245HQ (120hz) LG W2420P LG IPS231P 
MonitorMonitorKeyboardPower
HP ZR24w LG 32LH3000 (w/IPS) Razer Blackwidow Antec TruePower New 750W 
CaseMouseAudioAudio
Corsair 750D Modified original G5 Asus Xonar PCIe Sennheiser HD595 
AudioAudioAudioAudio
Tannoy Mercury 5 NAD C165BEE Bowers & Wilkins 683 Cambridge Audio DACMagic+ 
CPUCPUMotherboardRAM
Intel® Xeon® Processor E5-2630 v3 (20M Cache, 2... Intel® Xeon® Processor E5-2630 v3 (20M Cache, 2... Lenovo RD650 128GB DDR4 ECC REG 
Hard DriveHard DriveHard DriveHard Drive
720ix 12Gbps SAS RAID Controller with 1GB FBWC RAID 0 - 2 x Intel S3500 120GB SSD (deduped VHD... Intel 530 120GB SSD RAID 10 - 8 x Seagate 146GB 10k SAS  
OSPowerCase
Windows Hyper-V Server 2012 R2 2 x LiteION 750W 80PLUS Platinum RD650 24x2.5" chassis 
CPURAMHard DriveOS
Intel® Xeon® Processor X5650  8GB ECC 2 x 146GB SCSI RAID1 PfSense 2.2b 
Other
Intel 4 x 1GbE 
  hide details  
Reply
post #3 of 4
Some companies do colocation where they house their servers and other equipment into a datacenter owned by another company. Several colocation services offer "unmetered" connections which isnt "unlimited" but simply means they do not track how much data usage you use on your connection. You can get gig-E colocation unmetered but it's far more expensive but having several gig-e connected server in several different datacenters would satisfy even the most bandwidth hungry sites.

Some choose to build their own datacenter and get their own connection providers but I would say that if you're looking at something as big as archive.org or nytimes.com you'd probably need multiple multihoned OC12's at bare minimum.
post #4 of 4
Thread Starter 
Ok that makes sense, I suppose then a site that could host say anywhere from 250-10,000 users online simultaneously pulling down data, loading articles, streaming video, what have you, would mean it definitely could not be done in a residential area and would need serious infrastructure contracts to obtain bandwidth that could support something like that. I am working with someone and we may have the possibility to do something like this for a very powerful client, but I am being consulted on the infrastructure end in making this happen, so my curiosity lies more on the bandwidth level, because server and switch wise, thats not the issue, the only thing I'm worried about is bandwidth.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › Enterprise level Bandwidth question