Best Duplicate File Finder Deduper? Option to ignore part of filename? - Overclock.net - An Overclocking Community
Forum Jump: 

Best Duplicate File Finder Deduper? Option to ignore part of filename?

 
Thread Tools
post #1 of 7 (permalink) Old 02-14-2020, 10:41 PM - Thread Starter
¯\_(ツ)_/¯
 
Dreamliner's Avatar
 
Join Date: May 2015
Posts: 430
Rep: 3 (Unique: 3)
Best Duplicate File Finder Deduper? Option to ignore part of filename?

I have been using a program called DoubleKiller to find and delete duplicate files and it as worked very well. Now I am looking for a program that pretty much works the same way and will search for duplicate file names only but will ignore the last 4 or 5 characters of the filename (whatever I set) and try to match the rest of the characters.

Right now, DoubleKiller can search for duplicate files based on any combination of filename, size, dates or CRC32-checksum. What I need is a tool that will search by filename but ignore the last handful of characters. I'm assuming this will be something I can set with wildcards or something. Think of it sort of a reverse wildcard search. I also use a program called UltraSearch and maybe that has this function but I'm not certain.

For example, if i had a filename called "IMG_1001final" and another called "IMG_1001print" and they were different sizes, no deduper program would find that because the filenames AND sizes are different. I need a wildcard type search or deduper to ignore the last several characters so it would present to me both of these files for action.

Any suggestions?

|| 7820X @ 4.5Ghz | GTX1080Ti | TUF MARK 1 X299 | 32GB | 970 Pro 1TB | Define R4 | Air | Silent ||
Dreamliner is offline  
Sponsored Links
Advertisement
 
post #2 of 7 (permalink) Old 02-14-2020, 10:57 PM
New to Overclock.net
 
matthew87's Avatar
 
Join Date: May 2010
Posts: 244
Rep: 5 (Unique: 5)
Just use PowerShell and script it.

Would not be hard at all to do that.

$Var = Get-childitem -recurse
$Var.replicate(3)

That's your list of files with the final 3 chars omitted

Then a combination of
Get-filehash
Get-unique
Compare-diff
matthew87 is offline  
post #3 of 7 (permalink) Old 02-14-2020, 10:58 PM - Thread Starter
¯\_(ツ)_/¯
 
Dreamliner's Avatar
 
Join Date: May 2015
Posts: 430
Rep: 3 (Unique: 3)
Quote: Originally Posted by matthew87 View Post
Just use PowerShell and script it.

Would not be hard at all to do that.
I have zero idea how to use PowerShell (am willing to learn). I should also add these files are spread across multiple drives.

|| 7820X @ 4.5Ghz | GTX1080Ti | TUF MARK 1 X299 | 32GB | 970 Pro 1TB | Define R4 | Air | Silent ||
Dreamliner is offline  
Sponsored Links
Advertisement
 
post #4 of 7 (permalink) Old 02-15-2020, 11:37 AM - Thread Starter
¯\_(ツ)_/¯
 
Dreamliner's Avatar
 
Join Date: May 2015
Posts: 430
Rep: 3 (Unique: 3)
Any other ideas?

|| 7820X @ 4.5Ghz | GTX1080Ti | TUF MARK 1 X299 | 32GB | 970 Pro 1TB | Define R4 | Air | Silent ||
Dreamliner is offline  
post #5 of 7 (permalink) Old 02-15-2020, 12:59 PM
9 Cans of Ravioli
 
The Pook's Avatar
 
Join Date: May 2006
Posts: 17,752
Rep: 1268 (Unique: 689)
https://www.google.com/search?&q=Bes...UTF-8&oe=UTF-8

Intel i9 9900K Coffee Lake @ X8 5309mhz (+47.5%)
AMD FX-8320 Vishera @ X4 5022mhz (+43.5%)
Intel i5 4690K Haswell @ X4 5013mhz (+43.2%)
AMD X4 960T Zosma @ X6 4870mhz (+62.3%)
Intel i7 6700 Skylake @ X4 4709mhz (+38.5%)
Intel i5 6400 Skylake @ X4 4588mhz (+69.9%)
2 OP pls nerf
(24 items)
NUC U
(10 items)
CPU
i9 9900K
Motherboard
AsRock Z390 Taichi
GPU
MSI GTX 1080 Ti
RAM
G.Skill DDR4 4133 32GB
Hard Drive
Mushkin Pilot NVMe 1TB
Hard Drive
HP EX950 NVMe 2TB
Hard Drive
Samsung 860 Evo 1TB
Hard Drive
Toshiba X300 5TB
Hard Drive
Western Digital EZRZ 3TB
Power Supply
Seasonic Focus Plus Gold 750w
Cooling
Corsair H115i Pro
Cooling
Raijintek Morpheus II
Case
Fractal Design Meshify S2
Operating System
Windows 10 Education x64
Monitor
Acer XF270HU 27" 1440p
Monitor
LG 24UD58 24" 4K
Keyboard
CoolerMaster MasterKeys Pro S
Mouse
Logitech G502
Mouse
Glorious Model D
Audio
Klipsch PowerGate + FiiO E10K
Audio
Micca RB42
Audio
Philips Fidelio X2
Audio
Philips SHP9500S
Audio
Audio Technica ATH-M50X
CPU
i3 8109U
Motherboard
Intel NUC8i3BEH
GPU
Iris Plus 655
RAM
Kingston 8GB DDR4 2400
Hard Drive
Dierka K1 120GB
Hard Drive
ADATA SU800 128GB M.2
Operating System
Windows 10 Professional
Operating System
MX Linux
Keyboard
Dierya DK63-BT 60% (Outemu Blue)
Mouse
Logitech G603 Wireless
CPU
i7 860
Motherboard
Advantech AIMB 280 ITX
GPU
EVGA GTX 950 2GB
RAM
Kingston 2GB DDR3 1333
Hard Drive
Seagate Momentus 2.5" 500GB
Hard Drive
Western Digital Blue 2.5" 320GB
Power Supply
Silverstone SFX-L Gold 500w
Cooling
Arctic Alpine 11 GT 2
Case
Silverstone Milo Z ML07B
Operating System
Windows XP x86 SP3
Keyboard
Velocifire TKL01 Outemu Browns
Mouse
Logitech M512
▲ hide details ▲


The Pook is offline  
post #6 of 7 (permalink) Old 02-16-2020, 03:12 PM - Thread Starter
¯\_(ツ)_/¯
 
Dreamliner's Avatar
 
Join Date: May 2015
Posts: 430
Rep: 3 (Unique: 3)
Quote: Originally Posted by The Pook View Post
Any google search suggestions to find one with the nuance I asked for?

|| 7820X @ 4.5Ghz | GTX1080Ti | TUF MARK 1 X299 | 32GB | 970 Pro 1TB | Define R4 | Air | Silent ||
Dreamliner is offline  
post #7 of 7 (permalink) Old 02-16-2020, 03:55 PM
New to Overclock.net
 
speed_demon's Avatar
 
Join Date: Nov 2006
Location: Wisconsin
Posts: 1,887
Rep: 100 (Unique: 78)
Anything in this list that appeals to you? https://www.geckoandfly.com/26586/ef...-files-finder/

Quis custodiet ipsos custodes?


speed_demon is offline  
Reply

Quick Reply
Message:
Options

Register Now

In order to be able to post messages on the Overclock.net - An Overclocking Community forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Password
Please enter a password for your user account. Note that passwords are case-sensitive.
Password:
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:

Log-in



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page


Forum Jump: 

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off