In Progress

Price comparison website in Django


I am looking for someone to develop a price comparison website in Django using Scrapy (or something better) & Selenium - code must be documented in English. It should allow to crawl a "variable" number of separate sites (using a number of "spiders") that can pull out product details such as Product ID, Title, Price, Vendor, Description, Image, URL and Stock Position etc. This information should then be placed in a PostgrSQL database to be displayed using Web2py/Django. There should also be a way of the URL to the products be changed to affiliate links.

Expected Features:

a) The Products Table in the server database should be automatically populated by the scraper. The required fields are Product ID, Title, Price, Vendor, Stock Position, Payment Options, Delivery Time

b) Easy extensibility to add more functionality in future.

c) Posibility to scrape indefinite number of ecommerce sites and easy adding new stores

d) Should work with any type of ecommerce also ones using JavaScript

e) Primary URLs to be saved with the date of last successful scraping, to enable scheduling of periodic repeat scrapings so that the prices of the products are always up to date.

f) While executing scraping, only those fields that have changed since last scrape are to be extracted and the original table entry for the product to be "updated", as required. In case of new products, the details to be "inserted" as a new row in the Products Table.

g) The website should be very fast to provide the best user experience

h) URL to the comparison products within the website to be changed to affiliate links when available.

i) Posibility of adding reviews and rating for each product and each store, and user accounts for example for favourite product lists etc.

j) Website should have design similar to ecommerce website for example something like Aliexpress with carousel, fatured products and advertisement features, and also fully customizable.

k) It should count all the redirections to the external stores and provide full statistics of the usage of the site by user, store etc.

l) It should list all the compared prices from different stores from the lowest to the highest but the first few could be choosen manually from featured stores even if they are higher than other prices

m) Categories and subcategories view should have filters on the left side so the user can easily filter out the products he wants. When needed new categories could be added.

n) Every store should have its separate page with different information as for example recent rates and reviews, brands sold etc.

o) Website should be also mobile friendly

if you have examples of previous work please share them. Additionally if you have advice on the a better architecture/solution I am open to ideas.

Expected Skills: Web Scraping, Scrapy, Selenium, Python, Data Mining, Javascript, MySQL

Skills: Python, Django, JavaScript, Web Scraping, Data Processing

See more: price comparison website design, best database design price comparison website, cost developing price comparison website, build price comparison website, price comparison website specification, free opensource price comparison website, price comparison website clone freelance, price comparison website starting costs, start product price comparison website, price comparison website aspnet, price comparison website xml size, cost develop price comparison website, starting price comparison website, online price comparison website, money price comparison website, can build price comparison website, price comparison website template, software price comparison website, price comparison website feed

About the Employer:
( 0 reviews ) Mexico City, Mexico

Project ID: #28323067

Awarded to:


Dear Client, How are you? I am Full Stack Web Developer and Web Scraping Expert with more than 6 years experience in the field. Experienced in Python and PHP backend development, my work includes Django, Flask, Wo More

$400 USD in 30 days
(15 Reviews)

23 freelancers are bidding on average $557 for this job


Greetings , Price comparison websites market is going to flourish at a CAGR of 15.5% during the forecast period i.e. 2018- 2023. The aim of doing competitor analysis is to present a detailed strate More

$500 USD in 7 days
(12 Reviews)

Hi! I am a web developer and Python expert. I can start work right now and successfully deliver final result to you. I can deliver your project in shortest time and successfully. Thanks.

$500 USD in 7 days
(14 Reviews)

Hi, We have gone through your requirement and believe that we would be the perfect fit for you. We are an agency having 5+ years of experience in the field of customized website designs, app development. Designing is o More

$450 USD in 18 days
(25 Reviews)

Hi I am interested in working on this project with you but We need to discuss more details. Lets discuss and finalize all details and milestones for the project. thanks

$500 USD in 7 days
(15 Reviews)

Hi, I have already work on such such project, I will show you my work if you want and it is not possible with the selenium, we have to use other modules of python to to scrap the dynamic website or we have to use API. More

$1000 USD in 7 days
(3 Reviews)

Respected Hiring Manager, Django specialist. I can develop website for price comparison. please contact me now. I guide you. [login to view URL] please check my recent work. I am Certified Pytho More

$480 USD in 10 days
(3 Reviews)

Hey, I'm Arnav I'm an experienced Software Engineer/ Fullstack Developer with a skillset comprising of web development (frontend & backend), automation, machine learning, deep learning, data mining, data analysis, API More

$475 USD in 7 days
(25 Reviews)

✋ Hi I have much experience in building ✔️ PCW. I m very good at web scrapping and various kinds of API integrations. I am a web & mobile developer with ⭐ 5 years ⭐ of experience.  I can deliver quality products to tig More

$500 USD in 7 days
(6 Reviews)

Hi, With over 5 years of experience in Python. I’ve gone through your complete project description. My main skills are as follows: Python, Web Scraping, Selenium, BeautifulSoup Thank you for your attention. Hope to d More

$500 USD in 7 days
(5 Reviews)

Hi, First of all, thanks for very detailed explanations of what you exactly want. The only possible issue might be with the "indefinite number of ecommerce websites". Every website has a different architecture and sou More

$500 USD in 30 days
(5 Reviews)

Hello. How are you? I am Python/Django expert. As well as I have strong knowledge of frontend such as ReactJS, Angualr, VueJS. I can build you perfect job very quickly. I am sure you will get the best result very soon. More

$500 USD in 7 days
(1 Review)

“”” Dream is your's, Development work is our's”””” Please check the work below: eCommerce [login to view URL] [login to view URL] [login to view URL] [login to view URL] For concrete cost and time More

$500 USD in 7 days
(2 Reviews)

Sir , I have 7+ years Experience in Web-Design and Web-Development.I building different types of Web Site. I have read your project details carefully , understand requirement . Please reply me Some of my projec More

$500 USD in 7 days
(4 Reviews)

Hello, Hope you're doing good.! Before the bid, let me tell you in brief about myself. I am a Data scientist with over 3 years of working experience and have done many projects on AI for clients. Some of them are Se More

$1000 USD in 15 days
(3 Reviews)

Hi, Hope you are doing well. I have read your job description. We will surely help your users to compare prices, characteristics, tariffs, stores, etc. We consider ourselves to be specialists in this sector, having d More

$750 USD in 7 days
(1 Review)

Good Morning!! Hope you are doing well.. I have strong 5 years of experience in Python, Django, React.js along with Back-end technologies like: Python, Django, Django REST-Framework, and Front-End technologies like: More

$500 USD in 7 days
(1 Review)

Hello, I'm pretty happy to bid on this interesting project. I read your description carefully and I think that I am the developer you are looking for and are suitable for this task. I have rich experience in Python, D More

$650 USD in 7 days
(2 Reviews)

Handle the staff including manage related to staff which is, handle human resource task as a handle staff card, recorded sick leave of staff. I also manage staff allowance, create every official letter that required fr More

$500 USD in 7 days
(0 Reviews)

i am akshay the best date entry master of india i am trying to complete my work before end of the time I'm a very hard and fast worker. I'm reliable, detail-oriented, and self-motivated. I take every job seriously and More

$500 USD in 7 days
(0 Reviews)

Hi, We at Tecogno Solutions are a team of Passionate Data Science and Full Stack professionals having more than five years of combined experience in multiple areas including Backend, Frontend, Machine learning (ML) an More

$750 USD in 7 days
(0 Reviews)