Data project: global mobile services and plans

Deliverables / milestones (payment per milestone, breakdown at end)

Part 1:

This is a prequisite to Part 1 and , and give context for scope of project

Extract all the fields/rows from

[login to view URL]

and joining with dataset of country ISO code (2 letters) on country name

[login to view URL]

Creating CSV with

a) country ISO code

b) country name (3rd column) in imei)

c) service code (1s column in imei)

d) service name (2nd column)

Part 2 (this is likely manual step)

Dataset covering every mobile service provider in each country (global scope) from Part 1

(columns) with following infromation for each each

a) URL of service homepage

b) URL at which pre-paid data plan prices are listed (refinement of (a))

> if options/plans span multiple distinct URLs, all will be needed

c) URL at which post-paid data plan prices (may be same as (b))

> if options/plans span multiple distinct URLs, all will be needed

Format: CSV file

Each row unique for country/service/plan_type {pre/post-paid} / page# (if multiple pages)

Columns:

1. country ISO code (2 letter)

2. country name

2. service name

3. plan type

4. page #

5. URL

Part 3

Snapshot archive of pages from (b) and (c) of Part 2 -- this needs to be automated, not manual (see Part 4)

(a) as html

(b) as pdf

Design: organized tree hierachy of directories

country / service / plan_type / {html, pdf } / {page1,page2, ...}.{pdf,html}

Part 4:

Annotated code that can replicate

- Stage 1

- Stage 3 given (full or subset of) CSV from Stage 1

I am open on choice of tooling, but as always, there is a virtue keeping to a minimum number of dependencies for Part 4 / code.

Milestone/payment structure:

Let's make sure we progress correctly and ensure we are aligned on quality and value along the way.

So at end of each Part, let's plan on agreement on outcome before next step -- and payment for work done at end of each milestone.

1. End of Part 1+2

-- data exchagned

-- will be checked for accuracy/completeness

-- Outcomes

a) accurate / success and we continue: $100

b) breakup option -- if systematic errors are found at this stage, we are going to break off

>> we can also break up this task by region with partial milestone payments too to make sure we are aligned

2. End of Part 3

-- gzip exchagne

-- quality checked

Outcomes:

a) all looks good, move on to Part 4: $50

>> we can also break up this task by region with partial milestone payments too to make sure we are aligned

3. End of Part 4

Let's look at how you did all this , and can I replicate it

Oucomes

a) clear annotation

b) successfull replication / rerun on my machine

Final payment of $100 and we are done.

Data Extraction

Project ID: #24720919

About the project