Find Jobs
Hire Freelancers

Scrape data sources, load to a DB, provide data in a front end reporting engine

$15-25 USD / hour

Closed
Posted over 4 years ago

$15-25 USD / hour

You are bidding on Phase 1 only but understand phase 2 and 3 and confirm you can do it. Develop software that can scrape and/or query data from provided third-party websites, and create a database or storage system to host the data. Open to suggestions, however, NoSQL model and/or ELK stack is preferred for speed. Once the database system is created, create a front-end or leverage an open-source project to display data in a meaningful manner. You should assume the websites will be provided and they are open for data extraction. Scrape/Query data from third-party websites for an integration into a single storage . Ideally a scalable model such as NoSQL, or ELK stack but we are open to suggestions. Phase 2 Develop software that can ingest databases we feed it, normalize it, and quickly load and index it within a database. Make it scalable and fast. Phase 3 Portal with open API so anyone can connect tot the data
Project ID: 21737506

About the project

20 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
20 freelancers are bidding on average $21 USD/hour for this job
User Avatar
Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Before the collaboration starts - the initial briefing round takes place, which is free of charge. We are interested in all the details of your specific case. They will allow us to obtain a better vision of your concept and help us create unique solutions for you. Let's schedule a convenient time for the first kick-off conversation. Best Regards, Andrei Costenco Team Lead, Business Analyst, Senior Engineer Dev Experts Team
$25 USD in 30 days
5.0 (125 reviews)
8.8
8.8
User Avatar
Dear employer as Big Data Analytics engineer (specifically working with NoSQL, ELK and other AWS managed services)  i am having relevant skills and experience as you requested in your project description...i can share some demo as well in further chat. can we discuss more on this to get detail understanding about project ? As i am having some technical question on this so let me know when you get time to discuss on this and clear the doubts. Moreover You can also check my profile page as i have more than 32% Repeat Hire Ratio..so i work as long term basis.
$25 USD in 40 days
5.0 (60 reviews)
7.9
7.9
User Avatar
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$25 USD in 40 days
4.9 (70 reviews)
7.1
7.1
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$20 USD in 40 days
4.9 (93 reviews)
6.8
6.8
User Avatar
Hi,dear. I am very interested in your project - 'Scrape data sources, load to a DB, provide data in a front end reporting engine'. I've already done this kind of project before. I'm a professional programmer with 12 years of experience. If you award me, I'll implement all of your requirements in a short time. Skills: Data Mining, Data Science, Data Scraping, Software Architecture
$22 USD in 1 day
4.9 (11 reviews)
6.4
6.4
User Avatar
*** hello. I have checked your description and understood your points. I can use nosql. I have good experience with scraping and nosql. I want to discuss with you in detail. Thanks.
$20 USD in 40 days
5.0 (25 reviews)
5.3
5.3
User Avatar
I'm very much interested in this project, Please review my profile as i have relevant skills and experience required for this project. Kindly send me a message to discuss further. Thank you, Md Habibullah B.
$15 USD in 40 days
5.0 (17 reviews)
4.8
4.8
User Avatar
Dear Client. I respect you and will follow all your requirements. I am so happy to see your serious project. Because your project is the perfect match for my skills and experience. I have strong skill and rich experience about web scraping and automation processing, data mining , bypass security verification using python and c#, nodejs, java. So I can write high performance, robust and clean code for your project. I am sure I can deliver a perfect result for you. Please contact me and discuss more. Looking forward to hearing from you. Thanks for taking precious time to look for my cover letter. Best Regards.
$18 USD in 40 days
4.9 (13 reviews)
4.5
4.5
User Avatar
Hello. I have read your project descriptions. I am full stack developer with 10+ years of experience in web development. Also I developed many web scrapping projects. I understood what you want. Parse1: I will scrape data from your target website and save it to host database(I will use mongodb or postgreSql). Parse2: I will make Website to show scrapped data. And this will load fastly because I will make pagination features. Also I will make search engine for scrapped result with filter conditions for each fields. Parse3: I will make Restful APIs so any users can get data via api calling. Thank you.
$25 USD in 40 days
5.0 (5 reviews)
3.0
3.0
User Avatar
Dear Sir, I understand your project description. I think you want a person for your project who expert in Data Colletion I think there is no detailed discussion of the work here. So, we can discuss more work? First of all, I'll give you a sample of work. If you like the job samples, you can work with me. I am Expert in the Data entry,Data Mining, Data scrape and other than providing high-quality data collection and web research services. I’m ready to work according to your instructions. If you hire me, then I will do your work provide properly and satisfy you by my work. So, please discuss more over the chat. I am waiting for your reply. Thank you, Amarildo
$20 USD in 40 days
5.0 (4 reviews)
2.6
2.6
User Avatar
Hi there, I'm definite i can provide the exact service you are looking for. I'm planning to use Python along with some scraping library and Django for the data representation part. For DBMS i propose to use MongoDB. I am much fluent using these and which is enough to get the job done perfectly. I'm ready to start working immediately. Eagerly waiting for your responses. Regards
$20 USD in 40 days
5.0 (1 review)
0.6
0.6
User Avatar
I checked your project: Scrape data sources, load to a DB, provide data in a front end reporting engine and I am totally sure that I am able to accomplish it ! I am very good at Data Mining, Data Science, Data Scraping, Software Architecture. Hi Chris M.! Please Send me a message so that we can discuss more about this project
$15 USD in 77 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Hiring Manager I am web enthusiast with more than 5 years of experience In the IT Industry. Work Style: *Availability- 40 hrs/week, Flexible with All Time Zones. *Communications Skills- Excellent In English. *Reports- Daily Detailed Reports, Weekly and Monthly Reports with all necessary information. Please schedule a meeting so that we can discuss more about the work first and then proceed the further and I assure high quality work,quick responses on your messages and responsibility. Thanks and Regards Kabir Infocom
$20 USD in 7 days
5.0 (1 review)
0.0
0.0
User Avatar
Hi we are VNATOR, a company of freelancers software developers. We have 2 developers with experience in python, ELK and javascript. One of this 2 developers is a Senior Python developer and the other is a Javascript Senior developers. Both developers has expirience with many languages and patterns.
$25 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey there We are a small but efficient team. We have haad web scrapping from across the world and have worked on numerous projects. I have gone through your requirements and it is apparent to me that you need a web engineer capable of scrapping and mainintaining databases with ease. Front end ui will be easily developed once we have the data. We work with one client at a time. If you employ is, you will be the center of our attention for the duration of the project. We got samples of previously extracted data, images, Twitter feeds, texts etc. We can share it with you as a sample if you want a proof of work. Rest assured you are in safe hands and are being overlooked by professionals. Ckntact us please. Kind regards
$22 USD in 20 days
0.0 (0 reviews)
0.9
0.9
User Avatar
Nice to meet you I am a Machine Learning expert In all domains such as industry, economy and biomedicine, any hard problem can be resolved using Artificial Intelligence Techniques. In my PhD research, I have developed a Hybrid Intelligent Method which can be used for identification and modeling of complex and nonlinear not systems or for prediction of chaotic behavior. After ten years of manipulating some paradigms of machine learning techniques (such as Support Vector Machine and Neural Networks) with some computational approaches (such as fuzzy logic and wavelet analysis) and other theories (such as kernel methods and chaotic theory), I am sure that if the opportunity is offered to me, I will be able to tackle any problem using my rigor of mathematician, my varied knowledge of computer science as well as my great passion for the modern physical sciences. I am good at data-mining,data-science,data-scraping,software-architecture Thank you
$21 USD in 40 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Derby, United States
5.0
12
Payment method verified
Member since Nov 1, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.