Recent Works [Python] – Old Kaskus & New Kaskus Data Crawling

This project is just some weekend project in my office, not too important and not too hard. I have a request to scrap some indonesian forum, it is kaskus. Kaskus has move to new kaskus with a new fancy looking, and old kaskus still can be accessed in The goal of my project is to scrap a thread, scrapy will save some data like, posts, user information and page information into mysql database, and it use no gui, just a command line.


Library I used :

  1. Scrapy (Crawling using XPath)
  2. MySQLdb (Library to connecting Mysql and Python)

And this is some screenshoot of them (open in new tab for higher resolution) :


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s