Overclock.net › Forums › Software, Programming and Coding › Coding and Programming › Anyone use wget before?
New Posts  All Forums:Forum Nav:

Anyone use wget before?

post #1 of 4
Thread Starter 
I figure this is probably a long shot. But I figured I would throw it out there since I'm researching right now.

Just finished putting a new linux box together this morning and planning on making use of it to download some of my favorite online shows.

Revision3 and others have download links I'd like to use a shell script and wget to automate things for me a bit.

lol...Anyone familiar with it?

Rev3s Forum kind of sucks, haha. Although they had a couple decent links.

So far I have found the following links to be helpful.

http://www.krazyworks.com/wget-examples-and-scripts/

http://revision3.com/forum/showthrea...highlight=wget

Right now I am still researching, I'd like to do this myself, so please no one write any scripts for me, but please feel free to throw out pointers and any input you might have on the problem.

I have no issues with it downloading too much content, I'd rather have too much content than be missing something. lol. I've already gone through manually a while back to download some of the shows, but it's kind of a pain in the butt, so if I can automate it I might as well.

I've scripted before (actually do it a LOT, albeit C# scripting) but I've never used wget or done anything for web stuff.

Thanks guys
 
Play Server
(10 items)
 
NAS
(14 items)
 
CPUCPUMotherboardRAM
Intel Xeon L5640 Intel Xeon L5640 Dell R710 Mobo Hynix 144GB DDR3 ECC PC3L-10600R 
Hard DrivePowerCaseOther
Intel X25-M G2 80GB Redundant 840W PSU Dell 710 2.5" - Google Search Appliance Dell Perc H700 Raid Controller 
OtherOther
Dell iDRAC6 Enterprise Mellanox Connectx-2 10Gb SFP+ NIC 
CPUCPUMotherboardRAM
Intel Xeon E5-2670 v1 Intel Xeon E5-2670 v1 SuperMicro X9DRL-iF 64GB Kingston ECC (kvr16r11d4/16HA) 
Hard DriveHard DriveHard DriveCooling
12x 4TB HGST 5K4000 SanDisk SSD 960GB (cache) 6x 8TB WD Red Scythe AP-29 
CoolingOSPowerCase
2x Noctua U9DXi4 FreeNAS Corsair AX750 Norco RPC-4224 
OtherOther
3x LSI 9211-8i (HBA) Mellanox Connectx-2 10Gb NIC 
  hide details  
Reply
 
Play Server
(10 items)
 
NAS
(14 items)
 
CPUCPUMotherboardRAM
Intel Xeon L5640 Intel Xeon L5640 Dell R710 Mobo Hynix 144GB DDR3 ECC PC3L-10600R 
Hard DrivePowerCaseOther
Intel X25-M G2 80GB Redundant 840W PSU Dell 710 2.5" - Google Search Appliance Dell Perc H700 Raid Controller 
OtherOther
Dell iDRAC6 Enterprise Mellanox Connectx-2 10Gb SFP+ NIC 
CPUCPUMotherboardRAM
Intel Xeon E5-2670 v1 Intel Xeon E5-2670 v1 SuperMicro X9DRL-iF 64GB Kingston ECC (kvr16r11d4/16HA) 
Hard DriveHard DriveHard DriveCooling
12x 4TB HGST 5K4000 SanDisk SSD 960GB (cache) 6x 8TB WD Red Scythe AP-29 
CoolingOSPowerCase
2x Noctua U9DXi4 FreeNAS Corsair AX750 Norco RPC-4224 
OtherOther
3x LSI 9211-8i (HBA) Mellanox Connectx-2 10Gb NIC 
  hide details  
Reply
post #2 of 4
All I've ever needed, I've used gwget. Graphical frontend to wget. Should be in whatever distro you are using's repo. If using Ubuntu, just "sudo apt-get install gwget"
Assimilator
(16 items)
 
Backup
(12 items)
 
s939
(11 items)
 
CPUMotherboardGraphicsRAM
Intel i7 4770k Gigabyte z97x-soc force XFX R7 260X Crucial Ballistix Sport LP  
Hard DriveHard DriveCoolingCooling
Crucial M500 Seagate  EK-KIT L120 Swiftech MCR-H220 
OSMonitorKeyboardPower
Arch Linux x86-64 HP E201 Cooler Master Rapid-i mx red/green led EVGA SuperNOVA 850B2 
CaseMouseMouse PadAudio
Corsair C70 Perixx MX-1800R Something from Radio Shack Altec Lansing 2.1 
CPUMotherboardGraphicsRAM
i5 4690k Gigabyte Z97x-ud3h-bk MSI r7770 Crucial 
Hard DriveHard DriveCoolingOS
Crucial m4 240GB Seagate Corsair H60 Arch Linux 
MonitorKeyboardPowerCase
HP 2009m Noppoo Lolita 87 Corsair HX650 Cooler Master Haf 912 
CPUMotherboardGraphicsRAM
AMD Opteron 185 DFI LANPARTY UT nF4 SLI-DR Expert EVGA 8800 GTS Corsair XMS-4000PT DDR500 
Hard DriveOptical DriveCoolingOS
Seagate Asus Thermalright XP-90  XP Pro 
PowerCaseAudio
Ultra XFinity Chrome ULT-XF500  Ultra Wizard ALC850 
  hide details  
Reply
Assimilator
(16 items)
 
Backup
(12 items)
 
s939
(11 items)
 
CPUMotherboardGraphicsRAM
Intel i7 4770k Gigabyte z97x-soc force XFX R7 260X Crucial Ballistix Sport LP  
Hard DriveHard DriveCoolingCooling
Crucial M500 Seagate  EK-KIT L120 Swiftech MCR-H220 
OSMonitorKeyboardPower
Arch Linux x86-64 HP E201 Cooler Master Rapid-i mx red/green led EVGA SuperNOVA 850B2 
CaseMouseMouse PadAudio
Corsair C70 Perixx MX-1800R Something from Radio Shack Altec Lansing 2.1 
CPUMotherboardGraphicsRAM
i5 4690k Gigabyte Z97x-ud3h-bk MSI r7770 Crucial 
Hard DriveHard DriveCoolingOS
Crucial m4 240GB Seagate Corsair H60 Arch Linux 
MonitorKeyboardPowerCase
HP 2009m Noppoo Lolita 87 Corsair HX650 Cooler Master Haf 912 
CPUMotherboardGraphicsRAM
AMD Opteron 185 DFI LANPARTY UT nF4 SLI-DR Expert EVGA 8800 GTS Corsair XMS-4000PT DDR500 
Hard DriveOptical DriveCoolingOS
Seagate Asus Thermalright XP-90  XP Pro 
PowerCaseAudio
Ultra XFinity Chrome ULT-XF500  Ultra Wizard ALC850 
  hide details  
Reply
post #3 of 4
Thread Starter 
Oh interesting... I'll have to check that out. Thanks
 
Play Server
(10 items)
 
NAS
(14 items)
 
CPUCPUMotherboardRAM
Intel Xeon L5640 Intel Xeon L5640 Dell R710 Mobo Hynix 144GB DDR3 ECC PC3L-10600R 
Hard DrivePowerCaseOther
Intel X25-M G2 80GB Redundant 840W PSU Dell 710 2.5" - Google Search Appliance Dell Perc H700 Raid Controller 
OtherOther
Dell iDRAC6 Enterprise Mellanox Connectx-2 10Gb SFP+ NIC 
CPUCPUMotherboardRAM
Intel Xeon E5-2670 v1 Intel Xeon E5-2670 v1 SuperMicro X9DRL-iF 64GB Kingston ECC (kvr16r11d4/16HA) 
Hard DriveHard DriveHard DriveCooling
12x 4TB HGST 5K4000 SanDisk SSD 960GB (cache) 6x 8TB WD Red Scythe AP-29 
CoolingOSPowerCase
2x Noctua U9DXi4 FreeNAS Corsair AX750 Norco RPC-4224 
OtherOther
3x LSI 9211-8i (HBA) Mellanox Connectx-2 10Gb NIC 
  hide details  
Reply
 
Play Server
(10 items)
 
NAS
(14 items)
 
CPUCPUMotherboardRAM
Intel Xeon L5640 Intel Xeon L5640 Dell R710 Mobo Hynix 144GB DDR3 ECC PC3L-10600R 
Hard DrivePowerCaseOther
Intel X25-M G2 80GB Redundant 840W PSU Dell 710 2.5" - Google Search Appliance Dell Perc H700 Raid Controller 
OtherOther
Dell iDRAC6 Enterprise Mellanox Connectx-2 10Gb SFP+ NIC 
CPUCPUMotherboardRAM
Intel Xeon E5-2670 v1 Intel Xeon E5-2670 v1 SuperMicro X9DRL-iF 64GB Kingston ECC (kvr16r11d4/16HA) 
Hard DriveHard DriveHard DriveCooling
12x 4TB HGST 5K4000 SanDisk SSD 960GB (cache) 6x 8TB WD Red Scythe AP-29 
CoolingOSPowerCase
2x Noctua U9DXi4 FreeNAS Corsair AX750 Norco RPC-4224 
OtherOther
3x LSI 9211-8i (HBA) Mellanox Connectx-2 10Gb NIC 
  hide details  
Reply
post #4 of 4
I love wget. I've done some pretty intensive bash scripting before and anytime I get stumped I use this forum where I've linked the search results for wget to you.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Coding and Programming
Overclock.net › Forums › Software, Programming and Coding › Coding and Programming › Anyone use wget before?