Looking for scraper

This brief aims to achieve the following outcomes for the following Social Media platforms (SMP)

Instagram

Facebook

Twitter

YouTube

Tiktok

Business Outcome:

A scraper that will pull key data from the above social media platform based on an instruction from an input sheet (excel) of handles for the above platforms(this could be exported into an xml). The scraper will be designed to alert if any of the data cannot be pulled into a separate failure report and data will be landed into an AWS postgres db along with timestamps and reference data from the XML. The Scraper will need to be created in such a way that it can be scheduled to run at a time the user determines.

We want the development in Python using the Chalice framework to create AWS Lambda functions, and it should follow the documentation created. Our engineering team will integrate code into the existing system with a front end taking the connectivity information and passing to the SMP or GA code, then the SMP/ GA code pulling the data and then landing this into the DB.

There will be some basic calculation to calculate engagement rates, sum counts etc

Java Python Web Scraping Amazon Web Services Elasticsearch

Project ID: #28415787

About the project