Results 1 to 16 of 16

Thread: Duplicate File Scanner

  1. #1
    Senior Member Stringent's Avatar
    Join Date
    Jul 2003
    Location
    Neverland
    Posts
    5,226
    Thanks
    45
    Thanked
    155 times in 117 posts
    • Stringent's system
      • Motherboard:
      • Intel DQ57TM
      • CPU:
      • Intel i5 760
      • Memory:
      • 8GB
      • Storage:
      • 1TB
      • Graphics card(s):
      • NVIDIA Geforce 260GTX
      • PSU:
      • Corsair HX620
      • Case:
      • Coolermaster Centurion
      • Operating System:
      • Microsoft Windows 7 Ultimate x64
      • Monitor(s):
      • Dual Iiyama 24"
      • Internet:
      • Patchy

    Duplicate File Scanner

    Anyone recommend any duplicate file scanner and cleanup proggie which is free?

  2. #2
    Senior Member watercooled's Avatar
    Join Date
    Jan 2009
    Posts
    10,867
    Thanks
    1,502
    Thanked
    935 times in 805 posts

    Re: Duplicate File Scanner

    I've used NoClone in the past. Not used it for years so can't comment on what it's like now but it did the job when I used it. Think I got it on a magazine CD.

  3. #3
    Funking Prink! Raz316's Avatar
    Join Date
    Jul 2003
    Location
    Deal, Kent, UK
    Posts
    2,978
    Thanks
    130
    Thanked
    62 times in 52 posts

    Re: Duplicate File Scanner

    I used DUFF - http://dff.sourceforge.net/ - earlier this week and it seemed fine

  4. Received thanks from:

    watercooled (08-03-2010)

  5. #4
    Senior Member
    Join Date
    Mar 2005
    Posts
    4,593
    Thanks
    145
    Thanked
    311 times in 249 posts
    • badass's system
      • Motherboard:
      • ASUS P8Z77-m pro
      • CPU:
      • Core i5 3570K
      • Memory:
      • 32GB
      • Storage:
      • 1TB Samsung 850 EVO, 2TB WD Green
      • Graphics card(s):
      • Radeon RX 580
      • PSU:
      • Corsair HX520W
      • Case:
      • Silverstone SG02-F
      • Operating System:
      • Windows 10 X64
      • Monitor(s):
      • Del U2311, LG226WTQ
      • Internet:
      • 80/20 FTTC

    Re: Duplicate File Scanner

    I've used doublekiller in the past without problems.
    "In a perfect world... spammers would get caught, go to jail, and share a cell with many men who have enlarged their penises, taken Viagra and are looking for a new relationship."

  6. Received thanks from:

    watercooled (08-03-2010)

  7. #5
    ALT0153™ Rob_B's Avatar
    Join Date
    Jul 2006
    Posts
    5,876
    Thanks
    301
    Thanked
    645 times in 439 posts

    Re: Duplicate File Scanner

    +1 for doublekiller.

    Powerful enough for clearing my photo collection up!

  8. #6
    Senior Member Stringent's Avatar
    Join Date
    Jul 2003
    Location
    Neverland
    Posts
    5,226
    Thanks
    45
    Thanked
    155 times in 117 posts
    • Stringent's system
      • Motherboard:
      • Intel DQ57TM
      • CPU:
      • Intel i5 760
      • Memory:
      • 8GB
      • Storage:
      • 1TB
      • Graphics card(s):
      • NVIDIA Geforce 260GTX
      • PSU:
      • Corsair HX620
      • Case:
      • Coolermaster Centurion
      • Operating System:
      • Microsoft Windows 7 Ultimate x64
      • Monitor(s):
      • Dual Iiyama 24"
      • Internet:
      • Patchy

    Re: Duplicate File Scanner

    Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!

  9. #7
    Registered+
    Join Date
    Nov 2004
    Posts
    25
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: Duplicate File Scanner

    Stringent - which did you use?

  10. #8
    Senior Member
    Join Date
    May 2006
    Posts
    251
    Thanks
    0
    Thanked
    6 times in 6 posts

    Re: Duplicate File Scanner

    Quote Originally Posted by Stringent View Post
    Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!
    Windows 2003 and now 2008 have a file monitoring solution which will do this for you and email the list right to your desk weekly. There is now also Single Instance Storage which in the right environment is pretty sweet.

  11. #9
    Funking Prink! Raz316's Avatar
    Join Date
    Jul 2003
    Location
    Deal, Kent, UK
    Posts
    2,978
    Thanks
    130
    Thanked
    62 times in 52 posts

    Re: Duplicate File Scanner

    Quote Originally Posted by Stringent View Post
    Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!
    This is exactly what I used it for. The amount of duplication which looked like accidental copying to me was scary.

  12. #10
    Registered+
    Join Date
    Nov 2004
    Posts
    25
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: Duplicate File Scanner

    You One - you mean Server 2003? Does that mean Windows Home Server would have it as well (built on the same core)? How do you use/access this?

    Edit: I'm only seeing this in WSS (Windows Storage Server) 2003?

  13. #11
    Senior Member
    Join Date
    May 2006
    Posts
    251
    Thanks
    0
    Thanked
    6 times in 6 posts

    Re: Duplicate File Scanner

    Single Instance is only available in 2008 Storage Server, sorry should have mentioned that.

    The monitoring of duplicates and large files has been in since 2003 R2 as I remember, I have never used WHS beyond playing so couldnt confirm if its in there.

  14. #12
    CWH
    CWH is offline
    Registered+
    Join Date
    Jan 2010
    Location
    Cambridge
    Posts
    80
    Thanks
    0
    Thanked
    8 times in 8 posts

    Re: Duplicate File Scanner

    Hi,

    You One - you mean Server 2003? Does that mean Windows Home Server would have it as well (built on the same core)? How do you use/access this?
    WHS uses SIS for all it's backup functions - that is, it will only store one copy of any file, irrespective of the number of times it might appear across all your Clients, and will just include pointers for the other possible copies.
    It isn't SIS that you want really, it's de-duplication which is a different thing, which can co-exist with SIS. (WHS doesn't do de-duplication, as it thinks that each copy of any file is there because you want it there!)

    Colin

  15. #13
    Registered User
    Join Date
    Jan 2010
    Posts
    1
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: Duplicate File Scanner

    Mal ware scanner frequently left threats uncleaned even after multiple passes. Anti spam slows mail download significantly. Parental control low cost dedicated server[/url] blocks many valid sites. Duplicate file finder can damage system

  16. #14
    Ex-MSFT Paul Adams's Avatar
    Join Date
    Jul 2003
    Location
    %systemroot%
    Posts
    1,926
    Thanks
    29
    Thanked
    77 times in 59 posts
    • Paul Adams's system
      • Motherboard:
      • Asus Maximus VIII
      • CPU:
      • Intel Core i7-6700K
      • Memory:
      • 16GB
      • Storage:
      • 2x250GB SSD / 500GB SSD / 2TB HDD
      • Graphics card(s):
      • nVidia GeForce GTX1080
      • Operating System:
      • Windows 10 x64 Pro
      • Monitor(s):
      • Philips 40" 4K
      • Internet:
      • 500Mbps fiber

    Re: Duplicate File Scanner

    @OP: You don't mention which OS this is, but beware of running duplicate file checkers/removers on Windows Vista and later, as we use hard links heavily - these are not duplicate files and it is only bad news to delete any of the references (typically under system32 and in sub-folders under WinSxs)
    ~ I have CDO. It's like OCD except the letters are in alphabetical order, as they should be. ~
    PC: Win10 x64 | Asus Maximus VIII | Core i7-6700K | 16GB DDR3 | 2x250GB SSD | 500GB SSD | 2TB SATA-300 | GeForce GTX1080
    Camera: Canon 60D | Sigma 10-20/4.0-5.6 | Canon 100/2.8 | Tamron 18-270/3.5-6.3

  17. #15
    Senior Member watercooled's Avatar
    Join Date
    Jan 2009
    Posts
    10,867
    Thanks
    1,502
    Thanked
    935 times in 805 posts

    Re: Duplicate File Scanner

    @Sukie Mette: Sorry it's a little hard to understand what you're trying to say but I think you're basically saying Internet security and duplicate file scanners don't always work perfectly - no they don't but it's better than having nothing at all. And yeah duplicate scanners can damage the OS so it's important to exclude system files from the scan.

  18. #16
    Registered+
    Join Date
    Feb 2010
    Posts
    31
    Thanks
    1
    Thanked
    0 times in 0 posts

    Re: Duplicate File Scanner

    Its not really a duplicate finder but WinStatDir is great for working out where all that disk space has gone:

    http://windirstat.info/

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. LaTeX2html problem...
    By bsodmike in forum General Discussion
    Replies: 4
    Last Post: 15-12-2010, 03:51 PM
  2. nero recode compiling volume failed
    By hvb in forum Welcome to HEXUS!
    Replies: 1
    Last Post: 02-09-2007, 10:14 AM
  3. Need help on my maxtor harddrives
    By arthurleung in forum PC Hardware and Components
    Replies: 10
    Last Post: 12-06-2007, 09:40 PM
  4. Multiple problems - help!
    By Ruggerbugger in forum Help! Quick Relief From Tech Headaches
    Replies: 7
    Last Post: 18-08-2006, 11:41 PM
  5. Nero vision express saying:'Burn process failed'
    By johnnr892 in forum Help! Quick Relief From Tech Headaches
    Replies: 15
    Last Post: 11-12-2005, 11:43 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •