Results 1 to 9 of 9

Thread: Backing up 4TB of data?

  1. #1
    Senior Member
    Join Date
    Jan 2005
    Posts
    712
    Thanks
    0
    Thanked
    1 time in 1 post

    Backing up 4TB of data?

    We're considering adding a 3.5TB Apple XserveRAID to our network - my question is, how the hell would you guys tackle the issue of having to take a backup of the data 'off-site'?

    We're looking at a 12-tape LTO3 autoloader, but the idea of a backup set being spread over 12 tapes scares the mumblies out of me.

    I'm thinking about a few Lacie BigDisks that I can carry to/from work every weekend, but what automated backup software would support chucking as much data as possible on one disk, and then moving onto the next etc etc?

    Is there a better way??


    Cheers for your thoughts,
    S.

  2. #2
    Pedandic mo-fo IAmATeaf's Avatar
    Join Date
    Jul 2006
    Location
    South of the Watford Gap!
    Posts
    896
    Thanks
    0
    Thanked
    11 times in 11 posts
    • IAmATeaf's system
      • Motherboard:
      • Asus P5Q Deluxe
      • CPU:
      • Q6600@3.25
      • Memory:
      • 4 x 2GB Corsair 6400C5DHX XMS2
      • Storage:
      • 2 x 0.5TB 7200.12, 2 x 1.5TB 7200.11
      • Graphics card(s):
      • Gigabyte GTX460 OC
      • PSU:
      • Corsair HX520
      • Case:
      • Lian Li PC6089B
      • Operating System:
      • Windows 7 Pro x64
      • Monitor(s):
      • Samsung T240 24"
      • Internet:
      • 6Mb ADSL Max
    Don't think you'd have enough hours in the day or night to be able to make a complete backup each and every night. You really need a backup strategy. Typically you could/would have anything from 3 to 6 volumes, each volume consisting of a weeks backups with a cycling of the off site backup included in there. Over the weekend a complete backup would be taken and then Monday night to Friday night an incremental (only the changed files) would be taken. The cycle would then repeat with the last to last weeks tapes taken off site. You'd also need to include the lifecycle of tapes and phase in new tapes as and when you think they are likely to become unreliable and 1 last point always make sure you can recover the data before deciding to commit and continue. The above is just general info, would need to know a lot more in order to advise fully.

  3. #3
    Senior Member charleski's Avatar
    Join Date
    Jul 2006
    Posts
    1,586
    Thanks
    7
    Thanked
    52 times in 45 posts
    The tapes should all fit into a magazine that can be handled as a single unit when shipped to off-site storage.

  4. #4
    Agent of the System ikonia's Avatar
    Join Date
    May 2004
    Location
    South West UK (Bath)
    Posts
    3,734
    Thanks
    39
    Thanked
    75 times in 56 posts
    multiple options, using tape as a backup.

    LTO drives with an auto loader - take incrimentals and ship full backups off site on a weekly/monthly basis.

    Volume based backup, I'd doubt you'll be using that whole storage as one lun, so break it up and shedule backups to tape so eg: volume 1 fits onto 1 tape, volume 2 fits onto 4 tapes etc manage it like that.

    Disk option. Buy some crappy SATA disks of high capacity and backup the array to them for a local copy then just backup to tape from the local copy at any point during the day

    tons of options, all with $$$$ assigned to them.

    think it through - plan it out and impliment it. Just just through kit at it, oh and forward plan - eg: make sure your backup plan will work if you needed/wanted to add a second X serve to your network
    It is Inevitable.....


  5. #5
    Administrator Moby-Dick's Avatar
    Join Date
    Jul 2003
    Location
    There's no place like ::1 (IPv6 version)
    Posts
    10,662
    Thanks
    53
    Thanked
    382 times in 313 posts
    ^^ what he said

    we don't back up our SAN as a single unit - in fact we treat san attached drives as any other drives and let backup exec back up the attached drives with its associated server.
    Currently we use an LOT2 auto loader , but I think we're moving to a DISK-DISK-TAPE strategy where we'll run backups to a staging area during the production backup window - then stream to tape offline.
    my Virtualisation Blog http://jfvi.co.uk Virtualisation Podcast http://vsoup.net

  6. #6
    Agent of the System ikonia's Avatar
    Join Date
    May 2004
    Location
    South West UK (Bath)
    Posts
    3,734
    Thanks
    39
    Thanked
    75 times in 56 posts
    Spot on Moby,

    this is becoming more popular with larger environments and with shared platorm (CDS Disk) san.

    BCV or snapshot technology which is a more formal version of this approach is well used in the industry.

    Everything is about needs though.

    If you need is full restores quicky - then your stratergy will differ from full array restore over a day.

    One think to consider is get your priorities/requirments agreed and signed off before deciding a stratergy - no point paying out for a load of disks to act as a proxy BCV if you don't have a strict recovery time or your not required to restore at a file based level (just as an example)
    It is Inevitable.....


  7. #7
    Administrator Moby-Dick's Avatar
    Join Date
    Jul 2003
    Location
    There's no place like ::1 (IPv6 version)
    Posts
    10,662
    Thanks
    53
    Thanked
    382 times in 313 posts
    Delving a little deeper , what kind of data are you wanting to store on this kit ?

    If you have a really big budget - buy a second xserve & some san routers , then get replicating over IP
    my Virtualisation Blog http://jfvi.co.uk Virtualisation Podcast http://vsoup.net

  8. #8
    Agent of the System ikonia's Avatar
    Join Date
    May 2004
    Location
    South West UK (Bath)
    Posts
    3,734
    Thanks
    39
    Thanked
    75 times in 56 posts
    The data is an important point

    eg: 2 TB of data could be 1,0000000 small files of a couple of K or 2 files of 1 TB each - that will effect your backup stratergy in a big way, and again coupled with your requirments. 4 TB isn't a mass of data buts its enough to warrent putting thought/planning and longevity into the mix as well as budget which is normally the driver behind any business decision.

    Does the X Serve have a replication or mirror technology at an array level such as SRDF (just for example) I've never really worked with the X serve.
    It is Inevitable.....


  9. #9
    Vive le pants! directhex's Avatar
    Join Date
    Jul 2003
    Location
    /dev/urandom
    Posts
    17,074
    Thanks
    228
    Thanked
    1,027 times in 678 posts
    • directhex's system
      • Motherboard:
      • MSI X99A Gaming 7
      • CPU:
      • Intel Core i7 5280k
      • Memory:
      • 32GiB ADATA DDR4
      • Storage:
      • Corsair Neutron XT 960GB
      • Graphics card(s):
      • MSI GTX 980 Gaming 4G Twin Frozr 5
      • PSU:
      • Corsair AX860i
      • Case:
      • NZXT H440
      • Operating System:
      • Ubuntu 17.10, Windows 10
      • Monitor(s):
      • Dell U2713HM
      • Internet:
      • FIOS
    we had a play with our new hundred-grand disk system today. it's got green lights on the front!

    tape is the old favorite for any type of backup (because it's easy to move off-site, and nothing beats the bandwidth of an 18-wheeler full of tapes) but if you have the budget, i'd pay serious consideration to a pure duplication option - which is more or less what Moby is suggesting

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. ISP PlusNet Accidentally Deletes 700GB of Email
    By Tobeman in forum Networking and Broadband
    Replies: 21
    Last Post: 19-08-2006, 08:53 PM
  2. Privacy concern - Scan orders being reported to 3rd parties.
    By Paranoid2000 in forum SCAN.care@HEXUS
    Replies: 35
    Last Post: 09-06-2006, 07:35 PM
  3. Data Problem
    By xavxen in forum Help! Quick Relief From Tech Headaches
    Replies: 13
    Last Post: 08-09-2005, 03:12 PM
  4. Data Recovery
    By LayZeh in forum PC Hardware and Components
    Replies: 8
    Last Post: 04-08-2005, 11:00 PM
  5. Replies: 4
    Last Post: 11-06-2004, 07:39 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •