I have attached an excel sheet that I prepared in detail. Plese look at the sheet first before reading on. The sheet is password protected, please send me a private message so I can give you the password.
The user only puts the information in Sheet "BOM" that is highlighted in blue font color. The other information is calculated at a later point that is self-explanatory.
Step 1) User clicks "Map Manufacturers". This means based on the user manufacturer (e.g. "AD") we look up if we have a matching manufacturer (sheet "manufacturer") or a mapping (sheet "mappings") we will try to normalize the user input to something we belive makes sense. In this case "AD" will not hit a manufacturer directly but will match to "Analog Devices" through the mapping table.
Unmapped cells are highlighted yellow. Cells without a manufacturer at all are highlighted grey. If a manufacturer is matched and we have a manufacturer article number the column scrape (H) is set to yes, otherwise no.
2) User hits "Scrape". There will have to be a different driver module for every website since the structure is slightly different. The scraper will log in the website with the given credentials. If there are no credentials there will be no login. You will have to handle the login process. When scraping the sheet "Results" is filled with the website results. I have actually put in all the data that are provided by the 3 webshops that I have set to active in the sheet "webshops login". In this case we searched for the term "OP484FS" and got the results:
Shop 1: 5 results
Shop 2: 3 results
Shop 3: 12 results
The results are color coded according to the commenting in the sheet.
Attention! I think that in order to scrape the information you can not use the overview sites of the websites but you will have to go to every individual detail website. Please consider that you may be sent to the detail website directly if there is only 1 result bypassing the overview website.
Based on the results the scraper automativally selects the "Match Best" and "Partial Best" as explained in sheet "Result" column L.
3) Finalize Result
After selecting what price he wants the user clicks "finalize result" which will then add the total price at the bottom of the sheet.
HOW LONG WILL THIS TAKE?
Please give me an estimate of how much time you think this will take. I belive the following could be a guideline:
Day 1: project clarification of questions and features
Day 2: general framework and handling
Day 3: scraper driver 1
Day 4: displaying scraped results in main sheet
Day 5: presentation of working prototype and feature discussion
Day 6: scraper driver 2
Day 7: scraper driver 3
Day 8: scraper driver 4
Day 9: final implementation
Day 10: presentation and bugfixes
Day 11: missing feature and missunderstanding implementation
Day 12: buffer
All in all I think this is half a month of work.
PLEASE BE AWARE: I will completely ignore spam offers like "I know PHP, ASP, Photoshop ...". Please take this seriously. I will definitely award the project and the freelancer providing the best concept at a reasonable price point will win this.
20 freelancers are bidding on average $1143 for this job
Hello I will do this job perfectly assuring professional results as I have created many web scraper and bots, I will work as per your mentioned schedule Ready to start work immediately Regards
Hi, I can scraper for these 4 website, as you have permissions. I have 12 year of experience in vb5/6/.net, and have many projects. I am ready to start now as per your shedule