Scripts

Forum Access • Support • Help

Scripts

Postby KonnoMate » 04 Aug 2016, 18:30

I'm sure I'm not the only one that creates scripts to scrap sites. Feel free to share ones you've made here.

Viper.py
This script is for viperteen.com. I used it to download around 200GB within a few hours. It will crawl a specified page, create a folder for the model name and dump all the images in the set folder.

Requires: Python2, BeautifulSoup4 and Requests
Usage: python viper.py [AGENCY] [START_PAGE] [MAX_PAGE] [MODEL_INDEX]

Example: python viper.py ttl 1 6 0
(Note: Get the agency name from the url.
viperteen.com/non-nude/ttl/
viperteen.com/non-nude/Silver/
viperteen.com/non-nude/WebeWeb/
etc)


This means the script will crawl "[url]viperteen.com/non-nude/ttl/*new-1/[/url]" up to page 6, starting at the first model on the page.(model index 0) Occasionally the script may fuck up due to server issues, in which case you can just restart it where you left off.

Image
I'd also be happy to fulfill any other customized scrappers/site rippers requests, if for whatever reasons BID/IGH/DownthemALL don't suffice.
Password:models-forum.org


User avatar
KonnoMate

Advanced Member
 
Posts: 26
Joined: 27 Jul 2016, 11:13
Country: America

Advertisement

Re: Scripts

Postby buzzer2 » 04 Aug 2016, 18:48

Do not link to other sites/forums as backlinks can be traced.

If you absolutely must post a URL to an external resource, please ensure the link is disabled by removing the protocol. I have edited your post above. :)


User avatar
buzzer2

Moderator
 
Posts: 4968
Joined: 13 Nov 2015, 09:15
Country: Canada


Return to Help • Tutorials

Who Is Online

Users browsing this forum: No registered users and 1 guest