Large Datafeeds Manipulation

Data Manipulation project I have 16 Product Datafeeds that i need to be maipulated. The following tasks will be needed to be done on the feeds. Please note couple of the feeds are huge 140000 products. I dont think this project can be done mannually 1. Unzip file 2. Add the following "header" at the top of each CSV ProductID|Name|MerchantID|Merchant|Link|Thumbnail|BigImage|Price|RetailPrice|Category|SubCategory|Description|Custom1|Custom2|Custom3|Custom4|Custom5|LastUpdated|status|manufacturer|partnumber|merchantCategory|merchantSubcategory|shortDescription|ISBN|UPC 3. Remove all products that are less than $10 4. Replace USERID with my Affiliate Number (922028) from column Link 5. Remove all products that are not Gadget related ie only selects "Electronic, Hardward, Computers, Smart phones , Tablets etc " All clothing home, outdoor camping need to be removed 6. Once all data is cleaned , all datafeeds would need to be merged and sort in Alphabetical order. 7. Critical Step : All products should be considered as "Duplicate" if they have the same first 2 words eg Cubot X9 5.5 Screen Cubot x9 mtk6592 android 8. Those duplicate products will need to have their ProductID to be changed to be all the same So basically we are identifying same products from different merchants. 9. If the end results is datafeeds of 20,000 products , then i would need this master feeds to be split into maximum 4000 k feeds, so the above would be split into 5. I am open to suggestion on how is the most effective way of doing this project. The options are [login to view URL] + using formulas etc [login to view URL] php script [login to view URL] .net framework application 4. Using [login to view URL] 5. Any other suggestions ...are welcome Requirements 1. Before you bid , please make sure you download one of the datafeeds that i am providing as example 2. Make sure you are able to do ALL STEPS 3. Bid only within my budget, anything outside will not be considered 4. Please let me know whats methods you intend to use - See attachement and download sample datafeeds here [login to view URL] [login to view URL] ------- All automated bids will be ignore unless you actually study the project properly and discuss your method