Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Windows › Splitting a folder with millions of files (windows)
New Posts  All Forums:Forum Nav:

Splitting a folder with millions of files (windows)

post #1 of 4
Thread Starter 
I currently have a folder with 2.8 million files, which is having trouble enumerating the files without windows explorer crashing. I would like to move these files into folders of 100,000 each (or maybe less). Anyone had any experience with a similar issue? Robocopy works, but I'm not sure how i can use it to split the files into a number of different (automatically created) folders.

Thanks for any ideas.
The Ryzenator
(17 items)
 
Surface Book
(1 item)
 
 
CPUMotherboardGraphicsRAM
ryzen 1800x MSI Arctic Mortar b350 Gigabyte 1080 TI AORUS G.Skill Trident Z RGB 3466 8GB x 2 
Hard DriveHard DriveCoolingCooling
Samsung Evo 850 500GB Western Digital Black 3TB EK-XRES 140 Revo D5 PWM EK-Supremacy MX CPU Waterblock - Acetal 
CoolingCoolingCoolingOS
EK-CoolStream PE 360 EK-FC1080 GTX Ti Aorus - Acetal+Nickel Corsair SP120 Windows 10 Pro 
MonitorKeyboardPowerCase
AOC AGON AG352UCG Logitech G810 Corsair RM850x Corsair 460x RGB 
Mouse
Corsair Harpoon RGB 
  hide details  
Reply
The Ryzenator
(17 items)
 
Surface Book
(1 item)
 
 
CPUMotherboardGraphicsRAM
ryzen 1800x MSI Arctic Mortar b350 Gigabyte 1080 TI AORUS G.Skill Trident Z RGB 3466 8GB x 2 
Hard DriveHard DriveCoolingCooling
Samsung Evo 850 500GB Western Digital Black 3TB EK-XRES 140 Revo D5 PWM EK-Supremacy MX CPU Waterblock - Acetal 
CoolingCoolingCoolingOS
EK-CoolStream PE 360 EK-FC1080 GTX Ti Aorus - Acetal+Nickel Corsair SP120 Windows 10 Pro 
MonitorKeyboardPowerCase
AOC AGON AG352UCG Logitech G810 Corsair RM850x Corsair 460x RGB 
Mouse
Corsair Harpoon RGB 
  hide details  
Reply
post #2 of 4
Here, I made you a program to help you sort out those files. See if it works for you. thumb.gif

FolderSplitter.zip 202k .zip file

HowTo:
1) Run FolderSplitter.exe
2) Browser to the folder that has all those files
3) select how may files per folder you want
4) click Start

The program will create numbered folders 1-n in the selected path, and move the selected amount of files from the original path to those folders.
My Rig
(14 items)
 
Ex-wife's Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
Core i5 4460 AsRock H81M-DG4 Sapphire Rx470 Platinum KVR 1600 16Gb 
Hard DriveHard DriveCoolingOS
2x Seagate 3Tb Samsung 850 EVO 120 Scythe Ninja 3 Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Fujitsu Siemens A17-2A Logitech K280e SuperFlower SF-550K12XP Thermaltake Versa H25 
MouseAudio
Logitech G402 Sony MDR XD150 
CPUMotherboardGraphicsRAM
Athlon 750K 4.0Ghz AsRock FM2A75 Pro4+ Sapphire R9 270X Dual-X Kingston 2x4Gb 1600 
Hard DriveHard DriveOptical DriveCooling
Samsung 850 EVO 120  Western Digital 320Gb LiteON DVD-RW CoolerMaster Hyper Z600 
OSMonitorKeyboardPower
Windows 7 Pro x64 Toshiba 32" FullHD TV Logitech FSP Hexa 550 
CaseMouse
DeLUX Logitech 
  hide details  
Reply
My Rig
(14 items)
 
Ex-wife's Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
Core i5 4460 AsRock H81M-DG4 Sapphire Rx470 Platinum KVR 1600 16Gb 
Hard DriveHard DriveCoolingOS
2x Seagate 3Tb Samsung 850 EVO 120 Scythe Ninja 3 Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Fujitsu Siemens A17-2A Logitech K280e SuperFlower SF-550K12XP Thermaltake Versa H25 
MouseAudio
Logitech G402 Sony MDR XD150 
CPUMotherboardGraphicsRAM
Athlon 750K 4.0Ghz AsRock FM2A75 Pro4+ Sapphire R9 270X Dual-X Kingston 2x4Gb 1600 
Hard DriveHard DriveOptical DriveCooling
Samsung 850 EVO 120  Western Digital 320Gb LiteON DVD-RW CoolerMaster Hyper Z600 
OSMonitorKeyboardPower
Windows 7 Pro x64 Toshiba 32" FullHD TV Logitech FSP Hexa 550 
CaseMouse
DeLUX Logitech 
  hide details  
Reply
post #3 of 4
Thread Starter 
Ronnin

Thanks a lot mate - you are an absolute legend. Seems to be working well, although i estimate completion to take a while... You are a life saver pal thumb.gif
The Ryzenator
(17 items)
 
Surface Book
(1 item)
 
 
CPUMotherboardGraphicsRAM
ryzen 1800x MSI Arctic Mortar b350 Gigabyte 1080 TI AORUS G.Skill Trident Z RGB 3466 8GB x 2 
Hard DriveHard DriveCoolingCooling
Samsung Evo 850 500GB Western Digital Black 3TB EK-XRES 140 Revo D5 PWM EK-Supremacy MX CPU Waterblock - Acetal 
CoolingCoolingCoolingOS
EK-CoolStream PE 360 EK-FC1080 GTX Ti Aorus - Acetal+Nickel Corsair SP120 Windows 10 Pro 
MonitorKeyboardPowerCase
AOC AGON AG352UCG Logitech G810 Corsair RM850x Corsair 460x RGB 
Mouse
Corsair Harpoon RGB 
  hide details  
Reply
The Ryzenator
(17 items)
 
Surface Book
(1 item)
 
 
CPUMotherboardGraphicsRAM
ryzen 1800x MSI Arctic Mortar b350 Gigabyte 1080 TI AORUS G.Skill Trident Z RGB 3466 8GB x 2 
Hard DriveHard DriveCoolingCooling
Samsung Evo 850 500GB Western Digital Black 3TB EK-XRES 140 Revo D5 PWM EK-Supremacy MX CPU Waterblock - Acetal 
CoolingCoolingCoolingOS
EK-CoolStream PE 360 EK-FC1080 GTX Ti Aorus - Acetal+Nickel Corsair SP120 Windows 10 Pro 
MonitorKeyboardPowerCase
AOC AGON AG352UCG Logitech G810 Corsair RM850x Corsair 460x RGB 
Mouse
Corsair Harpoon RGB 
  hide details  
Reply
post #4 of 4
Quote:
Originally Posted by haha216 View Post

Ronnin

Thanks a lot mate - you are an absolute legend. Seems to be working well, although i estimate completion to take a while... You are a life saver pal thumb.gif

I'm glad it works! smile.gif All the best to you, mate
My Rig
(14 items)
 
Ex-wife's Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
Core i5 4460 AsRock H81M-DG4 Sapphire Rx470 Platinum KVR 1600 16Gb 
Hard DriveHard DriveCoolingOS
2x Seagate 3Tb Samsung 850 EVO 120 Scythe Ninja 3 Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Fujitsu Siemens A17-2A Logitech K280e SuperFlower SF-550K12XP Thermaltake Versa H25 
MouseAudio
Logitech G402 Sony MDR XD150 
CPUMotherboardGraphicsRAM
Athlon 750K 4.0Ghz AsRock FM2A75 Pro4+ Sapphire R9 270X Dual-X Kingston 2x4Gb 1600 
Hard DriveHard DriveOptical DriveCooling
Samsung 850 EVO 120  Western Digital 320Gb LiteON DVD-RW CoolerMaster Hyper Z600 
OSMonitorKeyboardPower
Windows 7 Pro x64 Toshiba 32" FullHD TV Logitech FSP Hexa 550 
CaseMouse
DeLUX Logitech 
  hide details  
Reply
My Rig
(14 items)
 
Ex-wife's Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
Core i5 4460 AsRock H81M-DG4 Sapphire Rx470 Platinum KVR 1600 16Gb 
Hard DriveHard DriveCoolingOS
2x Seagate 3Tb Samsung 850 EVO 120 Scythe Ninja 3 Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Fujitsu Siemens A17-2A Logitech K280e SuperFlower SF-550K12XP Thermaltake Versa H25 
MouseAudio
Logitech G402 Sony MDR XD150 
CPUMotherboardGraphicsRAM
Athlon 750K 4.0Ghz AsRock FM2A75 Pro4+ Sapphire R9 270X Dual-X Kingston 2x4Gb 1600 
Hard DriveHard DriveOptical DriveCooling
Samsung 850 EVO 120  Western Digital 320Gb LiteON DVD-RW CoolerMaster Hyper Z600 
OSMonitorKeyboardPower
Windows 7 Pro x64 Toshiba 32" FullHD TV Logitech FSP Hexa 550 
CaseMouse
DeLUX Logitech 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Windows
Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Windows › Splitting a folder with millions of files (windows)