Completed

Sophisticated Excel Scraper (Visual Basic) for Electronic Components

I need you to create an excel webscraper that scrapes 4 electronic component websites. I do have permission to scrape the sites, so this is not a terms of use violation.

I have attached an excel sheet that I prepared in detail. Plese look at the sheet first before reading on. The sheet is password protected, please send me a private message so I can give you the password.

The user only puts the information in Sheet "BOM" that is highlighted in blue font color. The other information is calculated at a later point that is self-explanatory.

Step 1) User clicks "Map Manufacturers". This means based on the user manufacturer (e.g. "AD") we look up if we have a matching manufacturer (sheet "manufacturer") or a mapping (sheet "mappings") we will try to normalize the user input to something we belive makes sense. In this case "AD" will not hit a manufacturer directly but will match to "Analog Devices" through the mapping table.

Unmapped cells are highlighted yellow. Cells without a manufacturer at all are highlighted grey. If a manufacturer is matched and we have a manufacturer article number the column scrape (H) is set to yes, otherwise no.

2) User hits "Scrape". There will have to be a different driver module for every website since the structure is slightly different. The scraper will log in the website with the given credentials. If there are no credentials there will be no login. You will have to handle the login process. When scraping the sheet "Results" is filled with the website results. I have actually put in all the data that are provided by the 3 webshops that I have set to active in the sheet "webshops login". In this case we searched for the term "OP484FS" and got the results:

Shop 1: 5 results

Shop 2: 3 results

Shop 3: 12 results

The results are color coded according to the commenting in the sheet.

Attention! I think that in order to scrape the information you can not use the overview sites of the websites but you will have to go to every individual detail website. Please consider that you may be sent to the detail website directly if there is only 1 result bypassing the overview website.

Based on the results the scraper automativally selects the "Match Best" and "Partial Best" as explained in sheet "Result" column L.

3) Finalize Result

After selecting what price he wants the user clicks "finalize result" which will then add the total price at the bottom of the sheet.

HOW LONG WILL THIS TAKE?

Please give me an estimate of how much time you think this will take. I belive the following could be a guideline:

Day 1: project clarification of questions and features

Day 2: general framework and handling

Day 3: scraper driver 1

Day 4: displaying scraped results in main sheet

Day 5: presentation of working prototype and feature discussion

Day 6: scraper driver 2

Day 7: scraper driver 3

Day 8: scraper driver 4

Day 9: final implementation

Day 10: presentation and bugfixes

Day 11: missing feature and missunderstanding implementation

Day 12: buffer

All in all I think this is half a month of work.

PLEASE BE AWARE: I will completely ignore spam offers like "I know PHP, ASP, Photoshop ...". Please take this seriously. I will definitely award the project and the freelancer providing the best concept at a reasonable price point will win this.

Skills: Data Mining, Data Processing, Excel, Visual Basic, Web Scraping

See more: what is active component, visual basic price, visual basic for website, visual basic 6 freelancer, use case components, the visual freelancer, the best php framework for 2015, the best freelancer websites, step for freelancer, scraping framework best, questions of data structure, prototype map, prototype component, project mapping freelancer, process data structure, php overview with freelancer, php asp freelancer, password protected excel, overview for freelancer, overview best freelancer

About the Employer:
( 28 reviews ) Hahnenbach, Germany

Project ID: #7041203

Awarded to:

jaylancer43

Hello Sir, I am an Expert Techno-Functional Analyst having vast experience in lots of arenas of IT industry including Excel Macros and Formulas. I am an Engineering Graduate with an MBA degree. If you see I am t More

$900 USD in 10 days
(607 Reviews)
8.3

20 freelancers are bidding on average $1143 for this job

Teloquence

A proposal has not yet been provided

$1473 USD in 12 days
(339 Reviews)
7.7
webscrapinggurus

I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete t More

$3157 USD in 45 days
(65 Reviews)
7.1
dpune

Hi, I have more than 14 years of exp and I am expert in this kind of Excel Scrapping work. I have completed more than 220 projects. Please look at the feedback left by my employers to know more about my work. Waiting f More

$900 USD in 30 days
(140 Reviews)
6.4
IXV

Hi, Can you please the password for the excel fie, so that I can have a look at it? Also I will have a close look at the manufacturers website so that I can ascertain how difficult each website is. I will update More

$999 USD in 25 days
(5 Reviews)
6.2
sknadeem123

please send me password of sheet thank you

$1056 USD in 12 days
(63 Reviews)
6.0
Alexod

Hello. If you need an EXE tool for Windows, then I'm the perfect candidate for completing your project successful. I have long and strong experience with automation task, like creating bots, tools, automation programs. More

$999 USD in 7 days
(13 Reviews)
5.6
sonarkaushik

Sir, I am well versed in this kind of jobs and can do your project as per requirement. I have done lots of these kind of projects and will deliver flawless work Looking for further discussions in this reg More

$1250 USD in 20 days
(72 Reviews)
6.0
abhinovpankaj

Hello, I will take 7 days in total. 1 Day to analyze the websites. Rest 2 Days for Coding Next 1 day discussing the changes if required and the last day in fixing those changes. I have been working with a MNC ba More

$772 USD in 20 days
(63 Reviews)
5.5
vikas0903

[Thanks for sharing password. I have revised time-estimate to 18 days (Added 3 days as buffer fro testing and feedback.] Hi, I have done similar project, for another client, for whom I accessed https://www.smarteda. More

$855 USD in 18 days
(39 Reviews)
5.6
nikhiltechnology

Hello I will do this job perfectly assuring professional results as I have created many web scraper and bots, I will work as per your mentioned schedule Ready to start work immediately Regards

$833 USD in 12 days
(28 Reviews)
4.9
mkhrsunil

Hi, I'm web scraper developer and understood your requirements scraper will log in to website as per credentials and search for right detail web page to scrap. Also, it will act as per condition and direction as More

$800 USD in 20 days
(13 Reviews)
4.8
danielrinf

Hello There, Waiting for the Password to take a deep look and give you prices and time. Thanks .

$1250 USD in 20 days
(37 Reviews)
5.0
sreejithakaz

I have developed web scrappers similar to this for an e-commerce website - which needs to pull data from various sites to analyse their cost. I believe this project would take 15 to 20 days to complete and this will be More

$750 USD in 20 days
(14 Reviews)
4.2
ayanbishnu

Hi I can assure you that i am having the best VB/excel experience and i can do almost everything possible with excel. Please check my review in freelancer.com IF you need see some samples of my work, then, pl More

$1315 USD in 30 days
(9 Reviews)
3.9
gperete

Software developer since 2000, specializing in Visual Basic, SQL Server, Crystal Reports, and VBA for MS Office. what is the password for the excel sheet?

$750 USD in 10 days
(10 Reviews)
3.7
vw2177740vw

I can help you to write this app. I know VB,VBA,C++,C#,PHP and I can do it perfectly and fast. I already wrote software like this and i have necessary skills to complete this project successfully. Contact with me via s More

$1666 USD in 14 days
(0 Reviews)
0.0
aign

Hi, can you send me a password for your xls file ? And i need to know what sites need to be processed, can you provide me site names ?

$888 USD in 20 days
(0 Reviews)
0.0
sflogics

Hi, We’ve had a good look at your project description and we’re very interested in providing a solution. We are a professional development company head-quartered in Pakistan. If you like what you see and if our qu More

$1000 USD in 20 days
(0 Reviews)
0.0
trafficmaster88

Hi, I can scraper for these 4 website, as you have permissions. I have 12 year of experience in vb5/6/.net, and have many projects. I am ready to start now as per your shedule

$1250 USD in 20 days
(2 Reviews)
0.0