Need 26 Million URLs Checked For Duplicates Today
$30-100 USD
Completed
Posted over 13 years ago
$30-100 USD
Paid on delivery
I have 26 million urls listed one per line in a text file. I need all duplicates removed. Text file is zipped in 670meg file so please allow time to download and upload.
## Deliverables
26 Million urls listed one per line, divided across 26 text files containing 1 million each. I need the duplicates removed so that I have all unique urls. Then simply split the urls across 15 text files and return to me. I should have about 15-20 million uniques in the end. I need this done TODAY! File size is 670meg so allow for time to download and upload.
## Platform
Text File
Project ID: 2977660
About the project
5 proposals
Remote project
Active 13 yrs ago
Looking to make some money?
Benefits of bidding on Freelancer
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
5.6
5.6
5 freelancers are bidding on average $49 USD for this job
5.7
5.7
3.5
3.5
2.6
2.6
2.8
2.8
About the client
Riverside, United States
247
Member since Jan 13, 2010
Client Verification
Other jobs from this client
$30-5000 USD
$30-5000 USD
$30-5000 USD
$30-5000 USD
$30-5000 USD
Similar jobs
$10-30 USD
₹75000-150000 INR
£5-10 GBP / hour
$250-750 USD
$30-60 USD
$250-750 USD
$30-250 USD
$30-250 AUD
$2-8 USD / hour
€12-18 EUR / hour
₹180-1800 INR / hour
€30-250 EUR
₹1500-2000 INR
₹12500-37500 INR
$4-5 USD / hour
$2-8 AUD / hour
$30-250 USD
€750-1500 EUR
$10-12 USD / hour
$2-8 USD / hour
Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Copy to clipboard failed, please try again after adjusting your permissions.
Copied to clipboard.
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.