scraping php sites?

stanbusk

Administrator
Staff member
That can be because the site is accessing a database, is this possible? What do you mean with mixed results?
 

janderuiter

New Member
it is accessing a db but in the end, the pages are just html pages. basically a news-like structure where i have a jump page with links to detail pages. the pages themselves require no variables or anything dynamic.

i was hoping the dumper tool would scrape these pages as html, including following the links, and scraping them as well.
 

stanbusk

Administrator
Staff member
Yes, it is exactly what it is intended to as long as there is no code URLs embedded inside Javascript. Most site are download properly. The problem here is perhaps the fact everything is database centered, I mean the relinking can cause problems. I will try the site.
 

stanbusk

Administrator
Staff member
I have tried right after opening the preferences and pressing the 'Factory Default' button. With those default settings I am able to download the site and view it offline with my browser.
 

janderuiter

New Member
weird. i started with that (so i thought) before posting here.
Anyway, thanks so much. i will buy your tool next and try for myself.
thanks again!
 
Top