Noble Realms — How do I make a copy of a website??

Re: How do I make a copy of a website??

2006-02-18T10:13:21Z

Ok thanks Montalk. The stiener site is awful to download, but HTTrack does seem does with download an entire book or content at a time I think. I will keep at it anyway.

HTTrack seems to have a little trouble with your site as for some reason I have to set it to retrive data from other domains - it seems the only way it will follow 90% of the links. But even then it seems to struggle.

So I guess websites have become more complicated and these programs have difficulty with them now?

Re: How do I make a copy of a website??

2006-02-18T01:08:29Z

Yes, I was thinking about this as well. In case we wake up someday and "Web 2.0" has been launched behind our backs, joyously canonizing its content.

Thanks for the links & idea.

Re: How do I make a copy of a website??

2006-02-17T21:40:44Z

Marcus, the Steiner site (e-lib) has disabled mass-downloaders for certain articles. I've been stubbornly copying and pasting the material anyway. As for my site, I'm not sure how HTTrack handles dynamic sites... maybe a simple configuration change would do it, but last time I used that program most files on the net were static, so I can't offer any solutions right now It does give me the idea of posting a PDF archive of my site.

Re: How do I make a copy of a website??

2006-02-17T20:20:04Z

Thanks. Just tried this program, and it copies the site just fine. Except just like the other programs it misses half the stuff out...I think I am doing something wrong - but I have no idea what...

Re: How do I make a copy of a website??

2006-02-17T12:39:41Z

Maybe Teleport Pro is the software you need
http://www.tenmax.com/teleport/pro/home.htm

How do I make a copy of a website??

2006-02-17T12:20:06Z

With all the loonacy talk about possible changes to the Internet...I thought I would spend some time making copies of some websites. And it is turning out to be sooooo frustrating.

I have used a number of programs and everyone of them has problems. In the end I settled on Httrack.

Now the problem I have is that it doesn't completely mirror a site. I tried making a copy of the Montalk site and it mirrors most of it, but then goes on and spends forever scanning links that are off-site. Even though I set the perferances to stay on the same domain. In addition to that it seems to miss some pages whilst it gets the others.

Yesterday I set it to mirror the Steiner archive site...the program has been running for over 24 hours now, scanning away...and it has got only a portion of the site and about 300mb of material.

Surely it should be easier than this? Anyone got any help / suggestions they can give please??