No self-introduction
Loading
Profile
Follow
codes (1)
Web crawler code
no vote
Application background The code is a picture of the capture of informationPython to write a crawler to climb down the beautiful pictures on the 22mm.cc, we put the reptile project named: mm_crawler.Need to meet:1 don't climb up the non related pictures;2 you should think about how many threads? Or process;3. The command line - can view the program is running help, - N can specify the number of concurrent threads (default 10), - O can specify image storage in which directory (by default the run directory pics directory), - l can limit climb many pictures ends (default is not restricted);4 think about a problem, if I have to crawl other beautiful sites next time, you how this program will be conducive to reuse;5 the realization of your ideas clearly recorded in the directory of the reptile project: readme.txt;6 you can use Python built-in modules and third party modules to speed up your task;
w278372428 1 0
1
No more~
Follows0
Fans0