• Registered: 2004-10-15

Topic: How do I make a copy of a website??

With all the loonacy talk about possible changes to the Internet...I thought I would spend some time making copies of some websites.  And it is turning out to be sooooo frustrating.

I have used a number of programs and everyone of them has problems.  In the end I settled on Httrack.

Now the problem I have is that it doesn't completely mirror a site.  I tried making a copy of the Montalk site and it mirrors most of it, but then goes on and spends forever scanning links that are off-site.  Even though I set the perferances to stay on the same domain.  In addition to that it seems to miss some pages whilst it gets the others.

Yesterday I set it to mirror the Steiner archive site...the program has been running for over 24 hours now, scanning away...and it has got only a portion of the site and about 300mb of material.

Surely it should be easier than this?  Anyone got any help / suggestions they can give please??

Thought Manifestation

Marcus's Website

  • From: Brazil
  • Registered: 2006-02-11

Re: How do I make a copy of a website??

Maybe Teleport Pro is the software you need
http://www.tenmax.com/teleport/pro/home.htm

Bye, Pictus

--------------------
http://pictus.co.nr

Pictus's Website

  • Registered: 2004-10-15

Re: How do I make a copy of a website??

Thanks.  Just tried this program, and it copies the site just fine.  Except just like the other programs it misses half the stuff out...I think I am doing something wrong - but I have no idea what...  sad  sad

Thought Manifestation

Marcus's Website

  • montalk
  • montalk
  • forum-keeper-upper
  • Offline
  • Registered: 2004-03-24

Re: How do I make a copy of a website??

Marcus, the Steiner site (e-lib) has disabled mass-downloaders for certain articles. I've been stubbornly copying and pasting the material anyway. As for my site, I'm not sure how HTTrack handles dynamic sites... maybe a simple configuration change would do it, but last time I used that program most files on the net were static, so I can't offer any solutions right now sad It does give me the idea of posting a PDF archive of my site.

Acquiring fringe knowledge is like digging for diamonds in a mine field.

montalk's Website

5 Reply by visavis (edited by visavis 2006-02-17 17:08:54)

  • Registered: 2005-10-16

Re: How do I make a copy of a website??

Yes, I was thinking about this as well.  In case we wake up someday and "Web 2.0" has been launched behind our backs, joyously canonizing its content.  tongue

Thanks for the links & idea.

"The unknown does not incite fear, but dependence on the known does." - J. Krishnamurti

visavis's Website

  • Registered: 2004-10-15

Re: How do I make a copy of a website??

Ok thanks Montalk.  The stiener site is awful to download, but HTTrack does seem does with download an entire book or content at a time I think.  I will keep at it anyway.

HTTrack seems to have a little trouble with your site as for some reason I have to set it to retrive data from other domains - it seems the only way it will follow 90% of the links.  But even then it seems to struggle.

So I guess websites have become more complicated and these programs have difficulty with them now?

Thought Manifestation

Marcus's Website