Results 1 to 11 of 11

Thread: Software to duplicate / backup files onto secondary location?

  1. #1
    Senior Member
    Join Date
    Jul 2003
    Location
    Reading, Berkshire
    Posts
    1,250
    Thanks
    64
    Thanked
    53 times in 34 posts
    • tfboy's system
      • Motherboard:
      • MSI X470 Gaming Plus
      • CPU:
      • AMD Ryzen 7 2700
      • Memory:
      • 2x8GB Corsair Vengeance LPX)
      • Storage:
      • Force MP600 1TB PCIe SSD
      • Graphics card(s):
      • 560 Ti
      • PSU:
      • Corsair RM 650W
      • Case:
      • CM Silencio 550
      • Operating System:
      • W10 Pro
      • Monitor(s):
      • HP LP2475w + Dell 2001FP
      • Internet:
      • VM 350Mb

    Software to duplicate / backup files onto secondary location?

    Is there any software out there that allows this? It's for a disaster recovery scenario, but has to be done via software; RAID or other low level implementations can't be done as I can't change the storage.

    Effectively, what would be ideal, is some kind of monitoring service which sees a new file appear and then automatically backs it up onto another drive / partition / server.

    Any ideas?

    TIA

  2. #2
    The late but legendary peterb - Onward and Upward peterb's Avatar
    Join Date
    Aug 2005
    Location
    Looking down & checking on swearing
    Posts
    19,378
    Thanks
    2,892
    Thanked
    3,403 times in 2,693 posts

    Re: Software to duplicate / backup files onto secondary location?

    Standard backup software (depends on OS)

    If it is business critical - tape, iSCSI, rsync, rdump (last two are *nux)

    Raid isn't a backup or disaster recovery solution, and disaster recovery is a lot more than just backups - depending on the size of the enterprise.

    More details of the scenario would be helpful though!
    (\__/)
    (='.'=)
    (")_(")

    Been helped or just 'Like' a post? Use the Thanks button!
    My broadband speed - 750 Meganibbles/minute

  3. #3
    Senior Member MaddAussie's Avatar
    Join Date
    Dec 2006
    Location
    Deepest Darkest Dorset
    Posts
    1,708
    Thanks
    628
    Thanked
    297 times in 179 posts
    • MaddAussie's system
      • Motherboard:
      • Asus ROG Strix Z370G
      • CPU:
      • i7 8700k (5.1Ghz)
      • Memory:
      • 16Gb
      • Storage:
      • 500G 960 EVO NMVE
      • Graphics card(s):
      • GTX 1070
      • PSU:
      • Corsair RM650i
      • Case:
      • Corsair Carbide A1r 240
      • Operating System:
      • Win 10
      • Monitor(s):
      • 24" Dell HD + Samsung HD

    Re: Software to duplicate / backup files onto secondary location?


  4. #4
    Jay
    Jay is offline
    Gentlemen.. we're history Jay's Avatar
    Join Date
    Aug 2006
    Location
    Jita
    Posts
    8,365
    Thanks
    304
    Thanked
    568 times in 409 posts

    Re: Software to duplicate / backup files onto secondary location?

    are we talking home or business?
    □ΞVΞ□

  5. #5
    Overclocking Since 1988 nightkhaos's Avatar
    Join Date
    Apr 2009
    Location
    Sydney, AU
    Posts
    1,415
    Thanks
    93
    Thanked
    127 times in 106 posts

    Re: Software to duplicate / backup files onto secondary location?

    RAID is a prevention method. It is neither a backup nor a recovery solution. It is exists to reduce downtime in the effect of a hard drive failure and allow the systems to continue operating at reduced capacity until the array is rebuilt.

    A disaster recovery solution is as the name says, to recover from disaster. This is where backups are a very important part. Backups are periodioc duplicates of the data storage.

    I proper backup solution will have 3 tiers of data backup.

    Tier 1, onsite hourly/daily backups to recover from minor issues like accidental file deletion and if the equipment exists, quick recovery from multiple harddrive failure (failure in such a way that a RAID rebuild is not possible). This is usally achieved with a tool like rsync or rdump.

    Tier 2, onsite daily/weekly backup in a safe or other secure medium to recover from medium scale disasters that result in equipment damage but the equipment can be replaced in an ordely fashion. This is usally achieved by backing up to tape drive.

    Tier 3, offsite daily/weekly/monthly backup to recover from large scale disaster such that the office in question is completely destroied or not able to be accessed, or the safe or other secure medium is not recoverable. A Tier 3 backup recovery operation usually includes a temporary offsite office, and is achieved by mailing the tape drives to a secure location, or transmitting the data over the internet.

    So the question is, how paranoid are you, and how important is the data? Once we know that, we can go from there. Most home situations consist of a up to Tier 1 or Tier 2 solution, with a possible Tier 3 taking the form of online storage. Most corperate situations consist of a up to Tier 2 or Tier 3 solution.
    Desktop (Cy): Intel Core i7 920 D0 @ 3.6GHz, Prolimatech Megahalems, Gigabyte X58-UD5, Patriot Viper DDR3 6GiB @ 1440MHz 7-7-7-20 2T, EVGA NVIDIA GTX 295 Co-Op, Asus Xonar D2X, Hauppauge WinTV Nova TD-500, 2x WD Caviar Black 1TB in RAID 0, 4x Samsung EcoDrive 1.5TB F2s in RAID 5, Corsair HX 750W PSU, Coolermaster RC-1100 Cosmos Sport (Custom), 4x Noctua P12s, 6x Noctua S12Bs, Sony Optiarc DVD+/-RW, Windows 7 Professional Edition, Dell 2408WFP, Mirai 22" HDTV

    MacBook Pro (Voyager): Intel Core 2 Duo @ 2.6GHz, 4GiB DDR2 RAM, 200GB 7200RPM HDD, NVIDIA 8600GTM 512MB, SuperDrive, Mac OS X Snow Leopard, 15.4" Matte Display

    HTPC (Delta-Flyer): Intel Core 2 Q8200 @ 2.33GHz, Zotec GeForce 9300-ITX, 2GiB of DDR2 Corsair XMS2 RAM, KWorld PE355-2T, Samsung EcoDrive F2 1.5TB, In-Win BP655, Noctua NF-R8, LiteOn BluRay ROM Drive, Windows 7 Home Premium, 42" Sony 1080p Television

    i7 (Bloomfield) Overclocking Guide

    Quote Originally Posted by Spock
    I am not our father.

  6. #6
    Senior Member
    Join Date
    Jul 2003
    Location
    Reading, Berkshire
    Posts
    1,250
    Thanks
    64
    Thanked
    53 times in 34 posts
    • tfboy's system
      • Motherboard:
      • MSI X470 Gaming Plus
      • CPU:
      • AMD Ryzen 7 2700
      • Memory:
      • 2x8GB Corsair Vengeance LPX)
      • Storage:
      • Force MP600 1TB PCIe SSD
      • Graphics card(s):
      • 560 Ti
      • PSU:
      • Corsair RM 650W
      • Case:
      • CM Silencio 550
      • Operating System:
      • W10 Pro
      • Monitor(s):
      • HP LP2475w + Dell 2001FP
      • Internet:
      • VM 350Mb

    Re: Software to duplicate / backup files onto secondary location?

    OK, a bit more info.

    This is for business use. It's to back up very high bandwidth media (50 to 100 Mbps streams). I already know of some potential solutions, but thought I'd ask here as there can be some great left of the middle ideas

    Original / source of content is on a SAN and to be copied onto another SAN or NAS system. It's likely I'll stick in an additional SAN client which will be dedicated to the copy process and dump the media files onto the other storage.

    I suppose rsync could be possible. The server running this service could be linux or Windows based, and although the SAN is running a CVFS/SNFS file system, FS clients exist for linux and windows so both are possibilities.

    The backup destination has to be a disk volume and cannot be tape - the files need to be importable directly by clients. Maybe the use of "backup" is misleading, it's not to put on a shelf, it's so an independant system can use the files. The files cannot be compressed or packaged in a way that alters their "presentation". So no zipping or breaking up into smaller sized chunks. Think of a duplication if you prefer

    This "second copy" is more of a temporary solution whilst other upgrades / data migrations are taking place.

  7. #7
    Senior Member
    Join Date
    Mar 2005
    Posts
    4,825
    Thanks
    161
    Thanked
    358 times in 288 posts
    • badass's system
      • Motherboard:
      • ASUS P8Z77-m pro
      • CPU:
      • Core i5 3570K
      • Memory:
      • 32GB
      • Storage:
      • 1TB Samsung 850 EVO, 2TB WD Green
      • Graphics card(s):
      • Radeon RX 580
      • PSU:
      • Corsair HX520W
      • Case:
      • Silverstone SG02-F
      • Operating System:
      • Windows 10 X64
      • Monitor(s):
      • Del U2311, LG226WTQ
      • Internet:
      • 80/20 FTTC

    Re: Software to duplicate / backup files onto secondary location?

    Windows server 2003 Sp1/2 and Server 2008 all support DFS-R. It is designed with file system replication in mind.
    "In a perfect world... spammers would get caught, go to jail, and share a cell with many men who have enlarged their penises, taken Viagra and are looking for a new relationship."

  8. #8
    Senior Member
    Join Date
    Jul 2003
    Location
    Reading, Berkshire
    Posts
    1,250
    Thanks
    64
    Thanked
    53 times in 34 posts
    • tfboy's system
      • Motherboard:
      • MSI X470 Gaming Plus
      • CPU:
      • AMD Ryzen 7 2700
      • Memory:
      • 2x8GB Corsair Vengeance LPX)
      • Storage:
      • Force MP600 1TB PCIe SSD
      • Graphics card(s):
      • 560 Ti
      • PSU:
      • Corsair RM 650W
      • Case:
      • CM Silencio 550
      • Operating System:
      • W10 Pro
      • Monitor(s):
      • HP LP2475w + Dell 2001FP
      • Internet:
      • VM 350Mb

    Re: Software to duplicate / backup files onto secondary location?

    Cheers, Badass, but unfortunately, DFS requires NTFS as it relies on the journaling features to work.

  9. #9
    Overclocking Since 1988 nightkhaos's Avatar
    Join Date
    Apr 2009
    Location
    Sydney, AU
    Posts
    1,415
    Thanks
    93
    Thanked
    127 times in 106 posts

    Re: Software to duplicate / backup files onto secondary location?

    Quote Originally Posted by tfboy View Post
    OK, a bit more info.

    This is for business use. It's to back up very high bandwidth media (50 to 100 Mbps streams). I already know of some potential solutions, but thought I'd ask here as there can be some great left of the middle ideas

    Original / source of content is on a SAN and to be copied onto another SAN or NAS system. It's likely I'll stick in an additional SAN client which will be dedicated to the copy process and dump the media files onto the other storage.

    I suppose rsync could be possible. The server running this service could be linux or Windows based, and although the SAN is running a CVFS/SNFS file system, FS clients exist for linux and windows so both are possibilities.

    The backup destination has to be a disk volume and cannot be tape - the files need to be importable directly by clients. Maybe the use of "backup" is misleading, it's not to put on a shelf, it's so an independant system can use the files. The files cannot be compressed or packaged in a way that alters their "presentation". So no zipping or breaking up into smaller sized chunks. Think of a duplication if you prefer

    This "second copy" is more of a temporary solution whilst other upgrades / data migrations are taking place.
    It seems to me that you want periodic incremental backups. Have you considered rsnapshot (it's a script based upon rsync that does periodic incremental backups of a specifed volume).
    Desktop (Cy): Intel Core i7 920 D0 @ 3.6GHz, Prolimatech Megahalems, Gigabyte X58-UD5, Patriot Viper DDR3 6GiB @ 1440MHz 7-7-7-20 2T, EVGA NVIDIA GTX 295 Co-Op, Asus Xonar D2X, Hauppauge WinTV Nova TD-500, 2x WD Caviar Black 1TB in RAID 0, 4x Samsung EcoDrive 1.5TB F2s in RAID 5, Corsair HX 750W PSU, Coolermaster RC-1100 Cosmos Sport (Custom), 4x Noctua P12s, 6x Noctua S12Bs, Sony Optiarc DVD+/-RW, Windows 7 Professional Edition, Dell 2408WFP, Mirai 22" HDTV

    MacBook Pro (Voyager): Intel Core 2 Duo @ 2.6GHz, 4GiB DDR2 RAM, 200GB 7200RPM HDD, NVIDIA 8600GTM 512MB, SuperDrive, Mac OS X Snow Leopard, 15.4" Matte Display

    HTPC (Delta-Flyer): Intel Core 2 Q8200 @ 2.33GHz, Zotec GeForce 9300-ITX, 2GiB of DDR2 Corsair XMS2 RAM, KWorld PE355-2T, Samsung EcoDrive F2 1.5TB, In-Win BP655, Noctua NF-R8, LiteOn BluRay ROM Drive, Windows 7 Home Premium, 42" Sony 1080p Television

    i7 (Bloomfield) Overclocking Guide

    Quote Originally Posted by Spock
    I am not our father.

  10. #10
    Registered+
    Join Date
    Jun 2009
    Location
    Essex
    Posts
    59
    Thanks
    3
    Thanked
    5 times in 5 posts

    Re: Software to duplicate / backup files onto secondary location?

    i use syncback by 2 bright sparks for pretty much exactly what you describe

    in SB a profile is created with numerious options .. my profile does the following

    scans a source folder/drive, then scans a target folder/drive looking for changes

    the prog then prompts with the changes found

    clicking continue updates the target(*) to be exactly like the source

    (*) updates includes, add, delete or "update", i.e. if an existing file on the target is changed

    the target can be either a local hard drive, a networked drive ( WHS in my case ) or FTP ( a dream host account in my case ). The FTP is for off-site storage

    it is idiot proof in that deleting a file from the source will not delete a file from the target.
    similarly, if the source file becomes corrupt the target file would not be affected
    it is possible to create profiles that run as a back ground service looking for changes in a watched folder/drive

    please ask if you have any specific Qs

  11. #11
    Overclocking Since 1988 nightkhaos's Avatar
    Join Date
    Apr 2009
    Location
    Sydney, AU
    Posts
    1,415
    Thanks
    93
    Thanked
    127 times in 106 posts

    Re: Software to duplicate / backup files onto secondary location?

    Quote Originally Posted by asposium View Post
    i use syncback by 2 bright sparks for pretty much exactly what you describe

    in SB a profile is created with numerious options .. my profile does the following

    scans a source folder/drive, then scans a target folder/drive looking for changes

    the prog then prompts with the changes found

    clicking continue updates the target(*) to be exactly like the source

    (*) updates includes, add, delete or "update", i.e. if an existing file on the target is changed

    the target can be either a local hard drive, a networked drive ( WHS in my case ) or FTP ( a dream host account in my case ). The FTP is for off-site storage

    it is idiot proof in that deleting a file from the source will not delete a file from the target.
    similarly, if the source file becomes corrupt the target file would not be affected
    it is possible to create profiles that run as a back ground service looking for changes in a watched folder/drive

    please ask if you have any specific Qs
    That seems like just a fancy front end for rsync.
    Desktop (Cy): Intel Core i7 920 D0 @ 3.6GHz, Prolimatech Megahalems, Gigabyte X58-UD5, Patriot Viper DDR3 6GiB @ 1440MHz 7-7-7-20 2T, EVGA NVIDIA GTX 295 Co-Op, Asus Xonar D2X, Hauppauge WinTV Nova TD-500, 2x WD Caviar Black 1TB in RAID 0, 4x Samsung EcoDrive 1.5TB F2s in RAID 5, Corsair HX 750W PSU, Coolermaster RC-1100 Cosmos Sport (Custom), 4x Noctua P12s, 6x Noctua S12Bs, Sony Optiarc DVD+/-RW, Windows 7 Professional Edition, Dell 2408WFP, Mirai 22" HDTV

    MacBook Pro (Voyager): Intel Core 2 Duo @ 2.6GHz, 4GiB DDR2 RAM, 200GB 7200RPM HDD, NVIDIA 8600GTM 512MB, SuperDrive, Mac OS X Snow Leopard, 15.4" Matte Display

    HTPC (Delta-Flyer): Intel Core 2 Q8200 @ 2.33GHz, Zotec GeForce 9300-ITX, 2GiB of DDR2 Corsair XMS2 RAM, KWorld PE355-2T, Samsung EcoDrive F2 1.5TB, In-Win BP655, Noctua NF-R8, LiteOn BluRay ROM Drive, Windows 7 Home Premium, 42" Sony 1080p Television

    i7 (Bloomfield) Overclocking Guide

    Quote Originally Posted by Spock
    I am not our father.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Best Software that will backup my dvd films?
    By Jimmy Little in forum Software
    Replies: 17
    Last Post: 03-09-2004, 07:53 PM
  2. All new Software Sticky ( with Wings !! )
    By Moby-Dick in forum Software
    Replies: 0
    Last Post: 21-06-2004, 10:42 AM
  3. Backup software?
    By skly77 in forum Software
    Replies: 3
    Last Post: 10-10-2003, 03:48 PM
  4. Backup Software
    By elneckio in forum Software
    Replies: 9
    Last Post: 20-09-2003, 04:47 PM
  5. Backup software
    By Shad in forum Software
    Replies: 11
    Last Post: 30-07-2003, 02:56 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •