In Progress

Create a website that scrapes an API and analyzes the data

FUNCTIONAL REQUIREMENTS

The website you create will be responsible for scraping data about prices from a remote API endpoint. The website will notify users when these prices meet certain user-defined criteria. Users should be notified in the web interface and via email and/or text message. The prices are for sports games seat licenses (season tickets). Prices and items are identified by a unique ID. The software’s purpose is to identify when priced items fall below a certain price. The 'certain price' is set by the user. There are 22 possible API endpoints or teams that can be monitored, which should be permitted for enabling or disabling as controlled by the user.

All scraped data and prices are shared among all the users. The users inputting pricing data work together in one office.

Frontend: A password-protected (individual login) web interface that shows all listings, both ones that have price thresholds defined, and those which need prices set by the user.

When a new listing exists (an ID that has not been previously seen by the data scraper, or has not been 'set' for price criteria by a user), the interface should indicate to the user that a listing is ready for pricing.

Backend: It will periodically (eg. once every 5 minutes) scrape data from a remote json API (eg. [login to view URL]). There are a total of 22 endpoints, each of which represents a different team. After scraping this data and storing relevant information in a local database, any data meeting pricing criteria will trigger a user notification. These criteria are set by users, as discussed above.

See attached wireframes.

DESIGN REQUIREMENTS

After a candidate is selected for this task, you will be given access to a VPS testing environment. You must create a functional implementation in this testing environment. You must upload your code to our private Bitbucket repository, and follow readable/maintainable code commit practices.

Security is not a significant concern for this project as the software will run in-house on a closed access machine.

Your code will be reviewed for quality and maintainability before it is accepted.

SYSTEM REQUIREMENTS

Language: PHP or Javascript with framework [CakePHP, Laravel, Node.js, angular, or any other web framework that enables clear separation of model, view and controller (MVC)]

Database: MySQL

Skills: HTML, MySQL, PHP, Software Architecture, Web Scraping

See more: web scraping api python, web scraping, web scraping python beautifulsoup, python web scraping library, python 3 web scraping, web scraping tutorial, web scraping multiple pages python, beautifulsoup tutorial python 3, php, html, website design, wordpress, python, javascript, codeigniter, email handling, laravel, jquery

About the Employer:
( 1 review ) ALLEN PARK, United States

Project ID: #19592462

Awarded to:

MohanKumar28

Hi I have gone through the requirements. Have created similar kind of custom apps using Laravel. Will do this application also using Laravel. I'm available to start now. Please share additional details. Regards, Mohan

$1500 USD in 15 days
(103 Reviews)
5.7

81 freelancers are bidding on average $2310 for this job

cr8tivewebexpert

Hi, We have reviewed your requirements and wireframes as well. Based on your requirement and our experience [we have got experience with scrapping as well as api integration] we will build you optimized scalable sol More

$4705 USD in 35 days
(276 Reviews)
8.8
TenStar718

Hello, and thanks for the opportunity to bid on your project. Please check my portfolio and reviews from other customers https://www.freelancer.com/u/TenStar718.html I am an expert in many different area’s of web More

$2000 USD in 30 days
(256 Reviews)
8.7
r4rony

** WE ARE SCRAPING SPECIALIZED ** Dear Client, I would like to inform you that We have already worked on similar kind of requirements as yours and We are confident that our skills and experience will definitely help More

$2000 USD in 40 days
(191 Reviews)
8.5
nuked24

Hi, please send me any reference site url . design theme you will provide or we will create ? We are expert in designing as well in development. We will provide you quality of work. We will provide you our [login to view URL] More

$3000 USD in 30 days
(186 Reviews)
8.8
dreamci

Good day Full Stack Expert development team is ready to serve you. We are working on hourly rate 35usd / hour. Can you send me a message? Then we can discuss the details Thank you.

$2500 USD in 5 days
(188 Reviews)
8.3
babysoftS

Hi, I understand your requirement to build the custom system to track the prices from the external API and notify the users. My name is Vibhor and I am based in India. I speak English and I am a Preferred Freela More

$2611 USD in 35 days
(182 Reviews)
8.1
mingxiao2008

Hello, Dear How are you? I have read your project description and am ready for discussing with you about your project as full Web and Scraping developer. I am going to implement your project using Django or Laravel More

$2000 USD in 30 days
(95 Reviews)
8.2
akash9958

As I am a Developer with 7+ years of experience in PHP or Javascript with framework [CakePHP, Laravel, Node.js, Angular Js, or any other web framework based Website Designing & Development with AJAX, Bootstrap, PH More

$3000 USD in 30 days
(275 Reviews)
8.4
aqualeafitsolpl

I have many experience about api project....Please invite me in chat so we can discuss in detail & show you our api project.......

$2941 USD in 30 days
(166 Reviews)
8.4
webbookstudio

Hi there. We are Ukrainian IT company and provide website design and development services. We have a huge experience in Blog Install, Graphic Design, PHP, HTML, CSS, SEO, Website Design and WordPress. We are interestin More

$3000 USD in 45 days
(236 Reviews)
8.4
FASTGuru

Hi Sir! I'm the certified PHP, JavaScript developer and have experience in web crawling and data mining, with 6 years of experience I assure you the highest quality of the work. Please check the profile here https://ww More

$2352 USD in 15 days
(230 Reviews)
8.0
mingah429

Create a website that scrapes an API and analyzes the data Hello, I read your description and got what to do. I am looking forward to discussing more for your project. I am ready now, please message me to start More

$2647 USD in 30 days
(23 Reviews)
7.9
fattahaabdul

Expert in scrapping. Let us discuss and move ahead. I am ready to start Please reply so that we can move ahead

$3333 USD in 20 days
(143 Reviews)
8.0
mekiho

Hi. I have vast experience to scrape api so I can work very fast and reliable. Please check my past jobs here and message me for detailed discussion. Thank you Danijel Mekiho

$2500 USD in 30 days
(81 Reviews)
7.4
Angel521

Hello. I am *XiaoLong* 99.99999% Completion Rate!!! I am an expert of web scrapping. I have done these works for several years and get good reviews as you can see on my skills. "Correct implementation for requireme More

$2500 USD in 30 days
(122 Reviews)
7.5
ITWhiz4U

Create a website that scrapes an API and analyzes the data Hello. How are you today? I have read your job post in carefully and understood everything what you want. I have developed 60+ apps & published them app sto More

$2250 USD in 30 days
(25 Reviews)
7.2
ITLove007

Hi, there. I read your job detail carefully and understand main idea. I think you will scrape data every 5 minutes. And because of the large number of requests, the endpoint will ignore the request. So my opinion is More

$2647 USD in 30 days
(66 Reviews)
7.5
hjr122413

Hi. Thank you for posting. I have read your post carefully. It's very exciting project and I am very interested on your project. As I am a senior full stack developer, I have strong expertise in Laravel and Angular. More

$2250 USD in 7 days
(83 Reviews)
7.1
KashirinA

⭐⭐⭐⭐ i am Full stack developer. ⭐⭐⭐⭐⭐⭐ I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. * 6+ years experience in web and mobile app development. * I More

$2500 USD in 30 days
(130 Reviews)
7.3
widadsaghir1993

Hello. As an scraping and web expert, I am very interested in this project with strong confident. I have read your description with care. This job is good fit to me. As you can see from my profile, I am fully experienc More

$2250 USD in 7 days
(118 Reviews)
7.4