This project is just some weekend project in my office, not too important and not too hard. I have a request to scrap some indonesian forum, it is kaskus. Kaskus has move to new kaskus with a new fancy looking, and old kaskus still can be accessed in old.kaskus.co.id. The goal of my project is to scrap a thread, scrapy will save some data like, posts, user information and page information into mysql database, and it use no gui, just a command line.
Library I used :
And this is some screenshoot of them (open in new tab for higher resolution) :