Closed

Website Scraping using node.js

Web Scape ( using node.js )

*** These are currently the manual steps I use to generate our desired output ***

I want to automate this task !!!

I Login to a secure website with a single username/password

Once logged in, I click on a link which brings us to a web form.

now I need to enter an applicant ID into a field (this is the applicant form)

Then I need to click on a "magnifier icon" which open a popup and I type in a product item, I click on search and it provides a list of all sub-product items ( there can be up to 5 sub-product items ).

When I click the sub-product link, it goes back to the original applicant form and inserts our selection into a readonly field

Then I click on search and some status info is returned on the same page. (which is what I need collected, along with the sub-product item name )

* I will repeat the process of using the same applicant ID while searching for the other sub-product items.

When all sub-product items have been verified, then I go onto the next applicant ID... etc...

================================

I would like this program to get the username/password also from a simple csv file

I would like this program to get the data required from a simple csv file at runtime that contains the applicant IDs and product items.

I would also like the extracted data, output to a csv file.

================================

Because it's already 5PM in my time, I will only make a decision in terms of hiring tomorrow. Thanks.

Skills: node.js, Javascript, Web Scraping, Software Architecture

See more: website scraping using vba, freelancers node js web design bangalore, companies using node.js, node.js web service, node js web scraping login, create website using node js, node js web scraping library, node js web scraping, using node js in web application, an introduction to web scraping with node js, how to build a web application using node js, how to create a dynamic website using node js, node js web scraping framework, ecommerce website using node js, how to build a website using node js, web application development using node js, web crawler using node js, node js web scraping github, full stack web development using node js, web scraping using node js with projects from scratch

About the Employer:
( 11 reviews ) laval, Canada

Project ID: #21681913

84 freelancers are bidding on average $1091 for this job

meet2amitvw

Dear employer as a custom Node.js (for Rest API) developer i am having relevant skills and experience as you requested in your project description...i can share some demo as well in further chat. can we discuss more on More

$2500 CAD in 15 days
(87 Reviews)
8.4
Lxtech

Hello, Its been 4 years working with Node.js and surely able to help you for scraping. **Kindly open your PMB for further discussion. Best Regards, Lx.

$900 CAD in 7 days
(338 Reviews)
7.9
seaanddream

Hi, my name is Selim. I am from UK. I read your `Website Scraping using node.js` project descriptions carefully before bidding. I checked the your requirements as well... I got what you need and ready to go ahead as so More

$950 CAD in 7 days
(281 Reviews)
7.9
mantislin

Hi there, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script for you More

$1440 CAD in 6 days
(330 Reviews)
7.7
AwaisChaudhry

Hi, I have gone through the brief details mentioned on the job. I have done multiple jobs with Javascript, node.js, Software Architecture, Web Scraping which are the skills required to get this job done. Lets start the More

$1500 CAD in 10 days
(62 Reviews)
7.7
workspaceit

Hello there, This is Tahsinul Alam, CEO of Workspace InfoTech Limited. We have 52 engineers in 14 teams who are serving the world wide client in different ways. Our expertise are given below: Technology: ----------- More

$1125 CAD in 7 days
(22 Reviews)
7.6
zekovicm

Hi there,I am Web Scraping/automation ( node.js) expert from Bosnia & Herzegovina,Europe. We can definitely automate that process for you as you mentioned . You will put input csv in the folder where the node.js code w More

$850 CAD in 5 days
(107 Reviews)
7.4
bluediscover

Hi there, I see you want to automate your browsing work. I've done many projects similar to this work and have one project have just finished. You can check it here: https://www.freelancer.com/u/bluediscover please, c More

$1300 CAD in 7 days
(60 Reviews)
7.3
PigtailXL

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator (using dif More

$750 CAD in 7 days
(208 Reviews)
7.5
C3guru

If you wanted to use Python, I would use Python + selenium. As long as you want Node.js, I will use puppeteer. It is webbrowser-automation library. I recently made an Instagram b0t using it. Don't worry and don't dou More

$750 CAD in 3 days
(51 Reviews)
7.0
liveexperts123

Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the More

$1500 CAD in 5 days
(49 Reviews)
6.9
emizentech

Hello, We have 6+ years of experienced JavaScript MEAN/MERN stack developers Team for your project. You could hire full-stack Python, MongoDB, NodeJS and AngularJS technologies experts remotely with us for full tim More

$2000 CAD in 30 days
(43 Reviews)
7.5
yuriyes43

Dear Sir! I’d like to describe myself as someone who is versatile and determined and someone who loves learning. I am creative, open-minded and easy going and I enjoy working with others. And I tried to use all these q More

$1125 CAD in 7 days
(73 Reviews)
6.7
adeelpirzada

Hi, I'm reaching out about i have done scrapping almost on Half of Worldwide web including eCommerce giants (Amazon, eBay, craigslist) News Feed, Social media websites, API's. I develop my own scrapers and Bots More

$1050 CAD in 7 days
(44 Reviews)
6.6
Friends4it

We already have built large scale applications, CRMs, ERPs and huge systems can be found at our website. Like [login to view URL] [login to view URL] [login to view URL] [login to view URL] https: More

$1463 CAD in 5 days
(41 Reviews)
6.9
WebExpertAnton

Dear hiring manager. I have read your job description. I am sure I can do it. This project is chrome extension project. I am an expert in chrome extension and web scraping. I am very passionate and responsible. I will More

$1200 CAD in 10 days
(34 Reviews)
5.8
susanna2018

hi! Dear , my Client! i am very pleasure the opportunity to discuss this job with you. i am a full time freelancer with skills and experience on angular.js, vue.js, react.js node.js, react native,JavaScript etc. Especi More

$1125 CAD in 7 days
(41 Reviews)
5.9
kkc264043kkc

Can make automation tool in nodejs Can follow all the steps. want to Know more about the website. Can take username password as input from csv file This is our web scraping platform [login to view URL] have More

$1111 CAD in 4 days
(44 Reviews)
6.0
kroim

Greetings to you my dear!. How are you? I think that your project is good for me with my skills. I have experiences in Web Scraping using python, Java/JavaFX, c# using selenium, scrapy, beautifulsoup. Amazon, Ebay, Bet More

$1000 CAD in 7 days
(32 Reviews)
5.8
cybersolutionvw

Hi, I have gone through project requirements in detail and understand what needs to be done. I can build a scraper for you based on your requirements. I have 3 years of experience in making web scraping tools. I assu More

$1200 CAD in 10 days
(130 Reviews)
6.1