Results 1 to 13 of 13

Thread: Downloading a Large Site

  1. #1
    Banned Jimmy Little's Avatar
    Join Date
    Jul 2003
    Location
    Southampton
    Posts
    2,517
    Thanks
    0
    Thanked
    0 times in 0 posts

    Downloading a Large Site

    Hi i wanted to be able to save this entire web page with all links, is this possible in one swoop, as if you look this bios guide link below have about 100 pages connected to the ‘index’ page, this would be very handy on my hard drive

    http://www.rojakpot.com/default.aspx?location=1


    Any ideas?

  2. #2
    Senior Member Kezzer's Avatar
    Join Date
    Sep 2003
    Posts
    4,863
    Thanks
    12
    Thanked
    5 times in 5 posts
    There is a program which can do it but i can't remember what it is called :X

    You could always search through download.com

  3. #3
    Will work for beer... nichomach's Avatar
    Join Date
    Jul 2003
    Location
    Preston, Lancs
    Posts
    6,137
    Thanks
    563
    Thanked
    138 times in 99 posts
    • nichomach's system
      • Motherboard:
      • Gigabyte GA-870A-UD3
      • CPU:
      • AMD Phenom II X6 1055T 95W
      • Memory:
      • 16GB DR3
      • Storage:
      • 1x250GB Maxtor SATAII, 1x 400GB Hitachi SATAII
      • Graphics card(s):
      • Zotac GTX 1060 3GB
      • PSU:
      • Coolermaster 500W
      • Case:
      • Coolermaster Elite 430
      • Operating System:
      • Windows 10
      • Monitor(s):
      • Dell 20" TFT
      • Internet:
      • Virgin Media Cable
    http://www.httrack.com/

    "HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.

    It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.

    WinHTTrack is the Windows 9x/NT/2000/XP release of HTTrack, and WebHTTrack the Linux/Unix/BSD release."

  4. #4
    Banned Jimmy Little's Avatar
    Join Date
    Jul 2003
    Location
    Southampton
    Posts
    2,517
    Thanks
    0
    Thanked
    0 times in 0 posts
    wow thanks! i shall give it a pop!

  5. #5
    Senior Member
    Join Date
    Aug 2003
    Location
    Chesterfield
    Posts
    1,436
    Thanks
    4
    Thanked
    5 times in 5 posts
    Cool looks like a handy program might have to have a play with that later

  6. #6
    Banned Jimmy Little's Avatar
    Join Date
    Jul 2003
    Location
    Southampton
    Posts
    2,517
    Thanks
    0
    Thanked
    0 times in 0 posts
    yeah i'm just downloading!

  7. #7
    HEXUS.net Webmaster
    Join Date
    Jul 2003
    Location
    UK
    Posts
    3,108
    Thanks
    1
    Thanked
    0 times in 0 posts
    if you're building your own app to do it then the wget application is easy to call via a command line

  8. #8
    Comfortably Numb directhex's Avatar
    Join Date
    Jul 2003
    Location
    /dev/urandom
    Posts
    17,074
    Thanks
    228
    Thanked
    1,027 times in 678 posts
    • directhex's system
      • Motherboard:
      • Asus ROG Strix B550-I Gaming
      • CPU:
      • Ryzen 5900x
      • Memory:
      • 64GB G.Skill Trident Z RGB
      • Storage:
      • 2TB Seagate Firecuda 520
      • Graphics card(s):
      • EVGA GeForce RTX 3080 XC3 Ultra
      • PSU:
      • EVGA SuperNOVA 850W G3
      • Case:
      • NZXT H210i
      • Operating System:
      • Ubuntu 20.04, Windows 10
      • Monitor(s):
      • LG 34GN850
      • Internet:
      • FIOS
    what az said: wget -m url = makes a mirror.

  9. #9
    Senior Member
    Join Date
    Mar 2004
    Location
    Cork
    Posts
    1,467
    Thanks
    0
    Thanked
    0 times in 0 posts
    Or if you have a Palm PDA you could use Plucker which I find very useful for this kind of thing. You can read it anywhere then.

  10. #10
    Chaos Monkey Apex's Avatar
    Join Date
    Jul 2003
    Location
    Huddersfield
    Posts
    4,528
    Thanks
    957
    Thanked
    233 times in 163 posts
    • Apex's system
      • Motherboard:
      • Asus Z87M-PLUS
      • CPU:
      • Intel i5-4670K
      • Memory:
      • 32 GiB
      • Storage:
      • 14 TiB
      • Graphics card(s):
      • R9 480X 8Gib
      • PSU:
      • 750
      • Case:
      • Core View 21
      • Operating System:
      • Windows 10 pro
      • Monitor(s):
      • Dell S2721DGFA
      • Internet:
      • 200Mb nTL Cable
    or teleport pro



  11. #11
    Senior Member
    Join Date
    Oct 2003
    Posts
    2,069
    Thanks
    4
    Thanked
    7 times in 3 posts
    Doesnt MSIE come with something. Save webpage ofline or something and you can set it to do a whole site?
    Twigman

  12. #12
    HEXUS webmaster Steve's Avatar
    Join Date
    Nov 2003
    Posts
    14,276
    Thanks
    292
    Thanked
    837 times in 473 posts
    Quote Originally Posted by Twigman
    Doesnt MSIE come with something. Save webpage ofline or something and you can set it to do a whole site?
    Yeah, but it's a bit on the pants side.
    PHP Code:
    $s = new signature();
    $s->sarcasm()->intellect()->font('Courier New')->display(); 

  13. #13
    Loves duck, Peking Duck! bsodmike's Avatar
    Join Date
    Jul 2003
    Location
    Colombo
    Posts
    2,909
    Thanks
    496
    Thanked
    92 times in 80 posts
    • bsodmike's system
      • Motherboard:
      • Misc.
      • CPU:
      • Mac Pro 2.8 GHz (8-cores) / iMac 2.8GHz C2D Extreme Edition / MacBook Pro 15" 2.33 & 13.3" 2.26 GHz
      • Memory:
      • 2GB DDR2 kits on all systems / FB ECC RAM in Mac Pro
      • Storage:
      • 320GB + 3x 1TB, Mac Pro / 500 GB, iMac / 2x 1TB & 2x 2TB WD My Book Studio II, via FW800 to Mac Pro
      • Graphics card(s):
      • ATI Radeon HD 2600 XT 256MB (two dual-link DVI ports / Mac Pro)
      • PSU:
      • Misc.
      • Case:
      • Misc.
      • Operating System:
      • Mac OS X 10.5 (Mac Pro) / Mac OS X 10.4.11 (others)
      • Monitor(s):
      • Apple 23" Cinema HD / Dell FPW2408 / iMac 24" display
      • Internet:
      • 2mbps ADSL (Mac Pro) / 512kbps WiMax (Wifi/MacBook Pro)
    man wget

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. What do you think of my new site
    By Gordy in forum Software
    Replies: 9
    Last Post: 02-04-2004, 01:12 PM
  2. Strange inabilty to connect with one box and one site
    By RocketmanX in forum Networking and Broadband
    Replies: 9
    Last Post: 29-09-2003, 09:48 PM
  3. Anyone know good gadget site etc?
    By BoB_DoG in forum General Discussion
    Replies: 0
    Last Post: 22-08-2003, 12:38 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •