Duplicate File Scanner

Anyone recommend any duplicate file scanner and cleanup proggie which is free?

I've used NoClone in the past. Not used it for years so can't comment on what it's like now but it did the job when I used it. Think I got it on a magazine CD.

I used DUFF - http://dff.sourceforge.net/ - earlier this week and it seemed fine :)

I've used doublekiller in the past without problems.

+1 for doublekiller.

Powerful enough for clearing my photo collection up!

Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!

Stringent - which did you use?

Quote:

---

Originally Posted by Stringent

Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!

---

Windows 2003 and now 2008 have a file monitoring solution which will do this for you and email the list right to your desk weekly. There is now also Single Instance Storage which in the right environment is pretty sweet.

Quote:

---

Originally Posted by Stringent

Thanks for suggestions! All un doubled. Although if I run this on the server I DREAD to think how many copies of stuff will turn up in different places!

---

This is exactly what I used it for. The amount of duplication which looked like accidental copying to me was scary.

You One - you mean Server 2003? Does that mean Windows Home Server would have it as well (built on the same core)? How do you use/access this?

Edit: I'm only seeing this in WSS (Windows Storage Server) 2003?

Single Instance is only available in 2008 Storage Server, sorry should have mentioned that.

The monitoring of duplicates and large files has been in since 2003 R2 as I remember, I have never used WHS beyond playing so couldnt confirm if its in there.

Hi,

Quote:

---

You One - you mean Server 2003? Does that mean Windows Home Server would have it as well (built on the same core)? How do you use/access this?

---

WHS uses SIS for all it's backup functions - that is, it will only store one copy of any file, irrespective of the number of times it might appear across all your Clients, and will just include pointers for the other possible copies.
It isn't SIS that you want really, it's de-duplication which is a different thing, which can co-exist with SIS. (WHS doesn't do de-duplication, as it thinks that each copy of any file is there because you want it there!)

Colin

Mal ware scanner frequently left threats uncleaned even after multiple passes. Anti spam slows mail download significantly. Parental control low cost dedicated server[/url] blocks many valid sites. Duplicate file finder can damage system

@OP: You don't mention which OS this is, but beware of running duplicate file checkers/removers on Windows Vista and later, as we use hard links heavily - these are not duplicate files and it is only bad news to delete any of the references (typically under system32 and in sub-folders under WinSxs)

@Sukie Mette: Sorry it's a little hard to understand what you're trying to say but I think you're basically saying Internet security and duplicate file scanners don't always work perfectly - no they don't but it's better than having nothing at all. And yeah duplicate scanners can damage the OS so it's important to exclude system files from the scan.

Its not really a duplicate finder but WinStatDir is great for working out where all that disk space has gone:

http://windirstat.info/