Web Scraping with python+scrapy+tor+mysql

I am an expert in scrapping and willing to discuss further details about the project specifications .

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. you can see my experience here: https://www.freelancer.com/u/uumairkhalid.html looking for your reply. Thanks

Hello, I have a lot of experience in python / scrapy. I am interested in your offer. Tell me more about the planned tasks and operating conditions. Thank you, Oleg

I have expertise on web scraping, check my portfoli. Let me tell you that your project could have another alternative of development with python. My works have quality and warranty, check my reviews.

Just be clear, the deliverable is DATA from the website, I will not provide you with the source code of my scraper. That said, I have already scrapped web sites using php+privoxy+tor+mysql cookies/session management is not an issue i know how to force TOR to change the IP. I have also scraped sites in parallel using multiple TOR nodes.

Hi I have big experience with scraping and PHP (see my portfolio), so you can hire me. I always do my job fast and neatly. My Skype - avkiev. Feel free to contact me. Best regards Alex

Hey! i have done similar project with scrapy and python for one of my courses..it is easy to cover :)

Hi, My name is Vladimir Kadalashvili, I'm Uzbekistan-based web developer with more than four years of experience. Currently I work remotely for SEO company based in the US. I have a good experience with Python and Scrapy, in fact I use Scrapy in the project I'm working on at my full-time job. Seven reasons why you should choose my bid: 1. I read project information carefully before posting any bids, so you can be sure that I estimated the time carefully 2. I always reply to emails and other messages promtly 3. I provide DAILY progress report to all my customers so you always know how the project is going on 4. I always deliver complete fully tested code by the time specified in my bid or earlier 5. I work with my customers until they are 100% satisfied 6. I always keep my promises 7. I always provide high quality code, no bugs, no dirty hacks etc I have several questions regarding to your project. 1. First (and the most important one) can you please send me site URL that you want to scrape and data you want to get? 2. Perhaps it's possible to avoid tor / proxies and just limit crawl rate? 3. Do you have database structure already, or I'll need to create it? 4. Is it ok for me to use sqlalchemy ORM as database access layer? If you have questions just let me know. Looking forward to work with you! Best regards, Vladimir

Предложение еще не подано

A proposal has not yet been provided

Hi, I am an experienced in native PHP,Zend(1,2),CI,Laravel,jQuery. -Python(Django) -core Java Repository: GIT,SVN : brij420 (skype) Coding Style:- -System design , database design and documentation -Development by following coding standard -Testing -Deployment with document Please communicate me on skype. Hope to hear from your side soon. Regards: Brijesh

I already have a custom script using curl+tor+privoxy+browser agent to scrape the web. I have a cron job which is automating a reset of tor every minutes. works fine for my usage. I can not sell or share the script but I can automate the process and deliver you the data in any format(mysql, csv, xml, email..) I could test my script on the site to see how much work/Adaptation it would require to be able to select the type.