Stolenhistory.net Archives for Download

[KeeperOfTheKnowledge]

For anyone interested, I am making available internet-facing archives of stolenhistory.net in .tar.gz files preceeded by date, available for download.

19.85 GB folder on MEGA

12 files

mega.nz

 

[dakotamoon]

Much appreciated, I'm trying to install the linux app, but may have to go back to my one windows pc to complete the install. Thanks again.

 

[dreamtime]

Thank you, @KeeperOfTheKnowledge

We are also working on an automated solution, providing the backup from our servers.

When you come across a great thread you can also archive it to archive.org with one click with this chrome extension: Wayback Machine

 

[Sasyexa]

Based beyond belief, just when I started to download pages individually. Thank you

 

[KeeperOfTheKnowledge]

Based beyond belief, just when I started to download pages individually. Thank you

You're welcome

 

[luddite]

@KeeperOfTheKnowledge amazing work my friend! What are you using to scrape it? We have httrack working pretty well for other sites.

 

[KeeperOfTheKnowledge]

@KeeperOfTheKnowledge amazing work my friend! What are you using to scrape it? We have httrack working pretty well for other sites.

I use only basic Linux shell scripting with wget and aria2c. I write scripts to scrape forums for user posted links, then archive all the links as well as the forums. I intend to write an indepth post of what and how I archive for those who are interested in archiving their own data.

 

[windmilljoe]

Thank you, really appreciate this.

 

[WorldWar1812]

Thanks. "The Korben Codex" right.

 

[Seven823One]

We have httrack working pretty well for other sites.

I also tried to use HTTrack to create an offline copy of Stolenhistory.net
Unfortunately, in the middle of the download, "Register" page is getting invoked and that puts a kabash on all subsequent pages. How did you overcame that?

Thank you.

 

[luddite]

I scrape the cookie or embed credentials. Both methods work.

 

[Seven823One]

I am using Windows version WinHTtrack 3.49-2
The only mention of cookies in its config is on "Spider" tab, where there is a checkbox to accept cookies... The login password could be entered in "Insert URL" popup window. I was afraid there is a cookie timeout in play, since it took 2-3 days for my connection to download 3.83Gb (78K files) of data from the forum.

 

[luddite]

I am using Windows version WinHTtrack 3.49-2
The only mention of cookies in its config is on "Spider" tab, where there is a checkbox to accept cookies... The login password could be entered in "Insert URL" popup window. I was afraid there is a cookie timeout in play, since it took 2-3 days for my connection to download 3.83Gb (78K files) of data from the forum.

I will PM you about this.

 

[EeppinenHistoria]

Thank you!

 

[luchin001]

Thank you!