[How to] Install Scrapy on Centos 7

scrapy-big-logo

Long time no see. So this time, I want to refresh my knowledge about python. This time, starting with scrapy (latest version when this article created is 1.0.3). Beside, I have a side project called ayorakit, that using scrapy so heavy.

Here is the step:

Continue Reading

Advertisements

[ID] Deploy Django pada VPS / Server dengan port custom

Artikel bahasa inggris

Saya sudah mencari di google tentang deploy Aplikasi Django menggunakan port custom, tapi kebanyakan yang saya temukan itu hanya sebuah saran, bukan tutorial. Saya menjadi sangat bingung sekali, apa yang ada di dalam pikiran saya “Bagaimana deploy django pada vps dengan port custom“, ya Saya punya sebuah akses ke PVS dengan sebuah ip publik, tapi tidak mempunyai DNS server, juga domain. Apa yang Saya inginkan adalah mengakses VPS tersebut, seperti publicip:port contoh: 10.234.78.253:8090
Continue Reading

Fun Works [Python] Scrapy rakitan dot com

Suddenly, I remember about my project, this is a starting point to achieve my project it still secret (hehehe).
But you can see it later (i’m trying to code as fast as I can).
So this project is crawling an online computer shop called rakitan.com
Just see this screenshoot, and fork my repo ūüėÄ

Continue Reading

Fun Works [Python] – Scrapy Dragonball Multiverse

Dragonball is one of the best manga (and anime) I have ever seen from my childhood ūüėÄ

So, suddenly I read a web that serve a doujinshi of dragonball, not draw by akira toriyama, by fans, but it really cool.
I’m a lazy person, and don’t like to wait to get the image, so I create the crawler to download those image, and read it offline.

Continue Reading

Installing kivy on Ubuntu 10.04

Kivy РOpen source Python library for rapid development of applications that make use of innovative user interfaces, such as multi-touch apps. kivy-logo-black-64

You already know¬†kivy. I think it’s awesome. I will show you how to install it in ubuntu 10.04 (lucid) from terminal and/or from Ubuntu User Interface.

  1. sudo add-apt-repository ppa:kivy-team/kivy OR from software sources (System -> Administration -> Software Sources -> tabs other software -> add) and insert this line deb http://ppa.launchpad.net/kivy-team/kivy/ubuntu lucid main if You do this part, just skip to step 3.  install_kivy1
  2. apt-get update
  3. apt-get install python-kivy
  4. Open your ipython command line and try to import kivy
  5. If need Cython just install it pip install cython

Scrapy [How to] Step by step crawling bhinneka.com – part 4

I know you read my¬†first post,¬†second post, and¬†third post. This time, We will complete Our crawler, We will use scrapy to crawl again the link that we found, and save the data into MySQL. Actually, I really don’t know if my method is right or wrong, but it really works, and I got what I need. Do not hesitate to ask me, just goto¬†about¬†and ask me, if I can help, I will answer your question.
bhinneka_1

Continue Reading

Scrapy [How to] Step by step crawling bhinneka.com – part 3

I know you read my¬†first post¬†and¬†second post, that’s still not complete, and now I will complete this tuts, this is not the last post in this session about scrapy. Actually, I really don’t know if my method is right or wrong, but it really works, and I got what I need. Do not hesitate to ask me, just goto¬†about¬†and ask me, if I can help, I will answer your question.
bhinneka_1

Continue Reading