Find Jobs
Hire Freelancers

AWS Lambda function to crawl and parse data

$30-250 USD

In Progress
Posted over 5 years ago

$30-250 USD

Paid on delivery
Create aws lambda function using nodejs to crawl [login to view URL] product page and parse product data. Input for the lambda function will be product page url like: [login to view URL] [login to view URL][]=color&st=color [login to view URL] It need to crawl the page and parse for product details like: title, image urls (both thumbnail and large size), mrp, price, highlights, description, specification, rating count etc. The response need to be in json format. Let me know in proposal what tools/libraries you are going to use. You will need to use your own aws account for development. Additional Info: I have added screenshots with highlights of what need to be extracted. Please check if you can get all the fields. May be we will need headless browser for this task.
Project ID: 18388626

About the project

8 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
8 freelancers are bidding on average $185 USD for this job
User Avatar
He there, I can help you to crawl the given sites and respond in JSON. I am Node.js and Lambda expert. I have deployed more than 100 lambdas with other AWS services like SQS, api gateway, kinesis, s3, SNS etc. I mostly used cheerio module to crawl the sites. There are other modules are available, I’ll use which one will be suitable for your requirements. You may check my profile. Looking forward to work with you. I am Sr. Software Engineer having experienced in JavaScript,Node.js,Angular, JQuery, Bootstrap, ExpressJS, Koa framework, AWS(Lambda, DynamoDB, RDS, S3, API Gateway, EBS, EC2, SES, etc.), SQL(MySQL, PostgreSQL, MS SQL Server, Sqlite3), NoSQL(MongoDB, Ravendb, CouchDB), Linux, Git, Nginx. Thanks,
$30 USD in 3 days
5.0 (30 reviews)
4.7
4.7
User Avatar
Hi, I will use request in nodejs to fetch the page and find the elements using cheerio, if it's only possible with JS, I'll use puppeteer.
$244 USD in 2 days
5.0 (2 reviews)
4.7
4.7
User Avatar
Hi, I have experience making crawlers and I can make the lambda parse the data directly from the page html.
$100 USD in 3 days
5.0 (13 reviews)
4.3
4.3
User Avatar
i can scrappy Python lib to scrapping and dynamo db to store the details. ping me if you have sometime to discuss.
$277 USD in 15 days
4.8 (8 reviews)
3.8
3.8
User Avatar
Hello ! I would like to know more about your requirement, Chat me and lets talk about, Hope to talk to you. Regards, Diego !
$277 USD in 5 days
5.0 (6 reviews)
2.7
2.7
User Avatar
Developed many applications on AWS Lambda. Relevant Skills and Experience Worked on many AWS Lambda applications.
$133 USD in 3 days
5.0 (2 reviews)
2.0
2.0
User Avatar
Hello friend, I understand your requirement thoroughly. I have 8 years of experience in Python, NODEJS and software industry at multiple MNCs. Customer satisfaction is my motto. Since my profile is new I will provide my services at a heavily discounted price too. Will set up the code and service on aws. Best Regards, Ranbir
$88 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Guwahati, India
4.9
8
Payment method verified
Member since May 28, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.