Overclock.net › Forums › Video Games › PC Gaming › [OPEN SOURCE] Automatic Steam Backup/Restore Tool
New Posts  All Forums:Forum Nav:

[OPEN SOURCE] Automatic Steam Backup/Restore Tool - Page 8

post #71 of 257
Quote:
Originally Posted by Du-z;13974489 
yeah thats the only bug at the moment, if you have a look at the task manager there should be 3 7za_cmd.exe processes working with a CPU usage > 0%

for some reason the batch file is very slow redirecting its output... i need to find a better solution tongue.gif

Yep 3 in Task Manager - Processes, showing about 30% CPU each. On Performance tab it's 100% CPU usage and about 3.5GB of my total RAM being used on 3 instances.

Started at 11:50:57 and on job 24 of 38.
i5 Sandy Balls
(15 items)
 
  
CPUMotherboardGraphicsRAM
i5 2500K @ 4.5Ghz Asus P8P67 Pro Gigabyte 7970 OC G.Skill RipJawsX 2x4GB 
Hard DriveOptical DriveCoolingOS
C300 64GB SSD + WD Black 1TB + WD Black 2TB LiteOn BD-ROM Drive H100 Windows 7 X64 
MonitorKeyboardPowerCase
HannsG HS233H3B 23" Microsoft X6 HX650 Carbide 500R Black 
MouseMouse PadAudio
G9x Steel series QcK+ DG Xonar 
  hide details  
Reply
i5 Sandy Balls
(15 items)
 
  
CPUMotherboardGraphicsRAM
i5 2500K @ 4.5Ghz Asus P8P67 Pro Gigabyte 7970 OC G.Skill RipJawsX 2x4GB 
Hard DriveOptical DriveCoolingOS
C300 64GB SSD + WD Black 1TB + WD Black 2TB LiteOn BD-ROM Drive H100 Windows 7 X64 
MonitorKeyboardPowerCase
HannsG HS233H3B 23" Microsoft X6 HX650 Carbide 500R Black 
MouseMouse PadAudio
G9x Steel series QcK+ DG Xonar 
  hide details  
Reply
post #72 of 257
Thread Starter 
OK! time for an update, DeaDLocK, This one will fix the problem that you were having earlier.

Download Here:
Steam Backup Tool v1.1.7
Source


Change List:
Code:
v1.1.7
* Streamlined the start up of each Backup/Restore
- removed log files
+ Added in program redirecting of logs (Much faster)

Edited by Du-z - 12/22/11 at 2:09am
post #73 of 257
Thread Starter 
Ive updated the program further smile.gif

Download Here:
Steam Backup Tool v1.1.8
Source


Change List:
Code:
v1.1.8
+ Added Cancel job button
+ Added Find Steam button
* General performance updates
* Streamlined the start and finish of each Backup/Restore even further

Edited by Du-z - 12/22/11 at 2:09am
post #74 of 257
Thread Starter 
Hi Guys,

Been a while since the last update, but i though of a few features that i wanted to add, this will hopefully be the first of a few updates smile.gif

Download Here:
Steam Backup Tool v1.1.9
Source


Change List:
Code:
v1.1.9
+ Changeable compression levels
* Fix Error Message typo

Edited by Du-z - 12/22/11 at 2:10am
post #75 of 257
Thanks for developing the Steam Backup Tool. As usual Steam is not up to the challenge and it sent me looking for better solutions. Joined up just to let you know of my experiences with "SBT".
Have had your program working, after downloading and installing .Net v4, and yes, it'll take quite a while to compress the 158Gb's I have in my Steam folders but since the ordinary Steam backup will only do 87Mb's in about 2 seconds before it reports "I'm successfully finished" (wrong !), the extended time to ensure a proper and successful backup will be worth it. Your next trick I take it is to do incremental backups on an already backed up set of Steam folders ? biggrin.gif

The only downside I've had so far is that .Net v4 throws an exception and it happens every time at the same place. Just need to click the Find button (to automatically look for the correct Steam folders to back up) and .Net throws a wobbly.
If I go through manually and locate the "C:\Program Files\Steam" folder the backup can be started up no probs, but try and "Find" the Steam folder and the problem shows up every time.

Keep up the good efforts. Will be regularly watching for updates. (Had any thoughts of doing a decent Steam Chat Logger while you're at it ??)

Zipster_009.jpg 99k .jpg file
post #76 of 257
Thread Starter 
Hi davcomNZ Thanks for your post and welcome to OCN!

The way this tool automatically finds steam is buy looking in the registry for were steam reports its location, my guess is windows 98/95/"Whatever your running" puts this information into another location.

could you have a look at your registry to see if this location exists "HKEY_LOCAL_MACHINE\Software\Wow6432Node\Valve\Steam" with the Subkey named "InstallPath". If not could you have a look for where its located, a quick google suggests that it is at this location "HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam".

As far as new features are concerned only backing up were needed (if the folder has been updated since last backup) would be a very usefull indeed, good idea!
post #77 of 257
Hey Du-z,

Thanks for the welcome. Always keen to help where Open Source software is concerned.

I've searched the complete registry for "wow6432" and come up with the following :

HKEY_CLASSES_ROOT\Wow6432Node\Media Type\{E436EB83-524F-11CE-9F53-0020AF0BA770}\{3E264436-F54B-4E06-91E2-5B40A583BFB5}
HKEY_CLASSES_ROOT\Wow6432Node\Media Type\Extensions\.avi

HKEY_LOCAL_MACHINE\SOFTWARE\Classes\Wow6432Node\Media Type\{E436EB83-524F-11CE-9F53-0020AF0BA770}\{3E264436-F54B-4E06-91E2-5B40A583BFB5}
HKEY_LOCAL_MACHINE\SOFTWARE\Classes\Wow6432Node\Media Type\Extensions\.avi

All above with "Default" sub-key and a blank reg_sz
No HKEY_CURRENT_USER entries.
No HKEY_Users entries.
No HKEY_Current_Config entries.

Nothing to do with Wow6432 in the Valve or Steam entries.

I didn't consider that my machine is anything out of the ordinary as far as a standard Steam install is concerned; maybe it is !? Might go some way to explaining why the Steam Backup & Restore doesn't work too but don't consider that anything out of the ordinary (installs or faults) has been done to get it where it is now. Have done the standard Steam Client install and Steam Add-on Support, and that's about it.

Following are the only keys regarding Valve/Steam in HKEY_LOCAL_MACHINE :
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\0
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\10150
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\10180
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\19900
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\20500
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\22380
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\28000
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\34830
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\42700
HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\Apps\97100

with various sub-keys in each that seem to deal with vcredist, OpenAL, DirectX & GFWLive.

Noted, that there are many InstallPath registry entries for games installed via Steam, sometimes with more than one entry for each game.

Also noted, that in the HKEY_CURRENT_USER\Software\Valve\Steam key that there is a sub-key marked "SteamPath" that shows a REG_SZ value of what I manually had to browse for before I could start the backup, of "c:/program files/steam". The same sub-key and value was also found in HKEY_USERS\S-1-5-21-606747145-2025429265-839522115-1003\Software\Valve\Steam but nowhere else.

Cheers...
Edited by davcomNZ - 12/21/11 at 1:07am
post #78 of 257
Thread Starter 
well i did allot of playing around with the program last night, and because of the info you have given me I am confident that the version I am testing at the moment will fix that exception.

it seems that "HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\" links to "HKEY_LOCAL_MACHINE\Software\Wow6432Node\Valve\Steam" on my system even though i cannot browse to "HKEY_LOCAL_MACHINE\SOFTWARE\Valve\Steam\" using regedit. Interesting and relatively useful.

Currently I am testing the current build of the program. I have also made it backup the registry keys for all of the currently installed games, i haven't confirmed this yet but i am hoping that it will make the game show up in steam as installed even though you have just restored the games... That's the theory anyway tongue.gif

Hopefully I will release it late tonight or tomorrow night!

Stay Tuned and thanks for the help smile.gif
post #79 of 257
Thats awesome ! Look forward to downloading and testing the new version.

Just as a sidenote on Steam registry entries.....

Had to investigate a friends PC just a couple of weeks ago, where the 2nd hard drive had completely failed, and it had ALL his Steam games on it.

Because most of the registry entries were pointing to his "E:" drive, (only the Steam Client was installed to his "C:" drive) the Steam Client Installer would not work (was trying to get him up and running with _some_ games on his C: drive) and the tool provided by Steam to clean out the registry also did not work, for the same reason that it couldn't "see" the now non-usable drive. (The program should never have attempted to look for any drive but simply gone into the registry and cleaned out everything related to Steam. Those programmers at Steam need some lessons on functionality and intuitiveness. But I digress.)

My point is that in wading through the registry I found a LOT of entries related to Steam and its installed games. 100's of them. If you're not careful it could almost become another app just to list and make sense of them all ! smile.gif

(Come to think of it, maybe that wouldn't be such a bad thing. If there had been a utility available to change every reference of E: to C: for Steam related entries only, I wouldn't have had to spend an hour going through picking out every such reference manually so I could (eventually) get the Steam Client Installer to run successfully.)

Thats actually the reason for my doing this complete backup now as we have many similar games and I'll load pretty much all of my SteamApps folders onto his new hard drive (just arrived today and sitting beside me) then "verify the local Steam cache" so his Steam doesn't throw a hissy-fit and try to download literally 100's of Gb's of "lost" games and cost him megabucks for the bandwidth overage.

Hmmm. I haven't done a Restore using your program yet but does it allow the option to restore to a different drive letter than it was backed up from ? (I'm also thinking of the related registry entries here as much as the location of the actual files when they are restored).

Might a word of advice built into your program for after a restore, pointing out that the user should, as a precaution, go in and Verify Local Cache after restoring, be of assistance ?

Am I jumping the gun here at all ? (My experiences on several occassions has been that Steam will blithely start downloading the complete game(s) even when newly replaced folders with the entire game(s) are present UNLESS the "Verify Local Cache" is done, after which Steam is almost always happy that it can then see (each) game(s) folders and won't download anything (unless it truly is an update).

Cheers.
post #80 of 257
Thread Starter 
Hi mate, thanks for all of the great information again smile.gif

a few notes/answers on what you have written:

Registry Entries:

I tested most of this tonight but I believe there will be a few things that will need to be changed. the registry backup at the moment is very simple
basically it just runs the equivalent of a batch file that does the following
Code:
REG EXPORT HKEY_CURRENT_USER\Software\Valve\Steam\Apps D:\test.reg
and when restoring it just does
Code:
REG IMPORT D:\test.reg
This creates a text document that say something like the following
Code:
Windows Registry Editor Version 5.00

[HKEY_CURRENT_USER\Software\Valve\Steam\Apps]

[HKEY_CURRENT_USER\Software\Valve\Steam\Apps\10180]
"userconfigcrc"=dword:9c256373
"EnableCacheLoading"=dword:00000001
"Installed"=dword:00000001

[HKEY_CURRENT_USER\Software\Valve\Steam\Apps\10190]
"userconfigcrc"=dword:f76f84a7
"EnableCacheLoading"=dword:00000001
"Installed"=dword:00000001

Hopefully the ""Installed"=dword:00000001" is all the convincing that steam needs for it to know that the game is already on the HDD

For the moment the restore and everything works as it should, in the older versions after a restore I would have to click "Download" for all of the games but in reality steam first checks the HDD to see if the file exists already then downloads it if its needed. As i said i hope this registry thing will help smile.gif

Personally i am hesitant to uninstall my own 600GB steam folder to test the registry theory, but if it works, great, if not, no harm done the user will have to click the download button for steam to realize that the game is installed.

Anyway here is the latest version:

Download Here:
Steam Backup Tool v1.1.10
Source


Change List:
Code:
v1.1.10
* Fixed exception when unable to find Steam directory.
+ Backs up steam game registry entries.

Edited by Du-z - 12/26/11 at 6:52am
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: PC Gaming
Overclock.net › Forums › Video Games › PC Gaming › [OPEN SOURCE] Automatic Steam Backup/Restore Tool