Create business Twitter data source

General Objective

Create a Twitter datasource for a data mining product

Specific Objectives

Create a AWS lambda function for extracting data from a third party API (Data Extraction)

Create a Python function for transforming this data into rows (Data transformation)

delivery time: 3 days


A W Datasource is a software component that is basically responsible for retrieving information from a specific source in a specific format. After the information is retrieved, a transformation function is applied for converting the data into a row record, required for storing the information as a table.

Data Extraction Function

The objective of this element is to retrieve the data from the source, without applying any changes nor additional logic.

Consider this element as a bridge which consumes the API using the configuration parameters received (input parameters) and provide exactly the same result that the API returns.

The magic of this element consists on consuming any API endpoint available by the provider passing the data to the next point in the chain. Changing the input parameter must be the only thing required for reaching a different endpoint or to consume a specific endpoint with different options. The goal behind this is to have a generic datasource capable of retrieving any info available by the provider. Using this approach, a new requirement coming from a datasource user will not require any code modification or development.

Transformation Function

This is where the conversion and the handling of the information returned by the provider. At the end of the process must convert the data into a collection of rows. Each row is passed to the helper as an object. This step is for converting the raw data returned by the provider into something that can be used for the table creation.

we will provide the credentials once the project be accepted

Skills: Amazon Web Services, Aws Lambda, Git, Python, RESTful API

See more: twitter business account cost, why use twitter for business, create twitter business account, change personal twitter account to business account, twitter business account vs personal, twitter for business, twitter profile, how to create twitter page for organization, php create table csv data, create database normalize data, create graphs mysql data, jeweler create business cards, create business header letter, create business website using wordpress, using data source options netobjects fusion, create business letterhead using photoshop, create user twitter using java api, post twitter data using flex, create data source sql server performancepoint, create pivot table asp vbscript data source

About the Employer:
( 1 review ) bogota, Colombia

Project ID: #18537420

3 freelancers are bidding on average $85 for this job


Hi I al certified aws solutions architect with 4+ years of industry experience. I have been working on design and implementation of scalable, available and fault tolerant solutions using aws. Relevant Skills and Exper More

$100 USD in 3 days
(16 Reviews)

Hi...I have worked on AWS Lambda as well as other functionality of AWS Provided Services. I have also worked upon API consumption. What I fail to follow is how are you expecting the two to be brought together to achiev More

$100 USD in 5 days
(0 Reviews)

Hello, Visit [login to view URL] to see our work portfolio and technology. We can do this project. Would like to know more about the details to present a final quote. Looking forward to hearing fro More

$55 USD in 10 days
(0 Reviews)