Find Jobs
Hire Freelancers

CSV > MySQL Import Script tweaks and overal DB/speed tune-up.

£18-36 GBP / hour

Closed
Posted almost 9 years ago

£18-36 GBP / hour

We currently have a PHP script which downloads and imports about 50 separate CSV files (They all using the exact same column format) into one large database (Roughly 250,000 records): This script however is running slow 20 records per second. (mysql_query(INSERT INTO)) Initially we'd like someone to look through the script and make any obvious improvements in the code to speed things up (inc suggestions to database structure, use of primary, indexes etc) and also perhaps [login to view URL] tweaks. Longer term we'd like to look into swapping over to LOAD DATA LOCAL INFILE, and also adding a number of rules so we can add product categories based on product name, store name etc. We see this very much as a 2 stage project and would like to build a long term relationship for further work on the websites which use the product database. Thanks, Jason.
Project ID: 7994387

About the project

52 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
52 freelancers are bidding on average £26 GBP/hour for this job
User Avatar
Hello! I am interest your project and I hope to work with you. My Ranking is Top 7th on freelancer. I have enough experience with WEB developing for 5+ years. Client satisfaction is my top priority. I will complete your project perfectly in your deadline. I am ready to start the work, and it will be a great pleasure for me to work for you. Please get in touch. Looking forward to hear from you. Best Regards!
£30 GBP in 10 days
5.0 (382 reviews)
9.4
9.4
User Avatar
Let's discuss over freelancer Personal Message Box for the proper estimation of cost and time. I am myself developer so you will directly work with me. No mediators. No managers. No subcontractors. see my recent work for the technical expertise along with reviews & feedback on my profile page.
£18 GBP in 30 days
5.0 (154 reviews)
9.3
9.3
User Avatar
Greetings Jason, I have read Project Description & understood the initial details but wondering, if you have more detailed requirements, some high level features? I also understand that it is 2 phase project, so I will assign you a dedicated team lead, who can work with you as long as you want. Our current bid is just a placeholder, as we cannot submit the proposal without entering any amount but once you respond us, we can then finalize it. Look forward to hearing from you. Regards, YK LEADconcept
£30 GBP in 40 days
5.0 (88 reviews)
8.9
8.9
User Avatar
Hello, and thanks for the opportunity to bid on your project. https://www.freelancer.com/u/TenStar718.html I am an expert in many different area’s of web and mobile applications based on the following languages: PHP, MySql, HTML5, Java (Web and Android), and JavaScript. I am also an expert in many different frameworks such as CodeIgniter, Spring and jQuery. I have over 5 years industry experience in development and graduated with a Masters Degree in IT from the Hong Kong University. My PHP L1 exam score in Freelancer places me in the top 3% of developers. Please have confidence in my skill and quality of work. I assure, I will do my best to work with you on your project to present the best possible outcome for you and your customers. I will also do my best to correct any area of work where quality comes into question, I want to have pride in my service to your company and the final product provided. While I am happy to make adjustments and alterations as your project progresses please understand that I am a dedicated freelancer and any work that is substantially different from the project description may need the awarded fee to be re-negotiated. Feel free to contact me if you have any questions, and please review my 5 star profile. I look forward to working together in partnership on your project and into the future. Regards
£26 GBP in 10 days
5.0 (189 reviews)
8.3
8.3
User Avatar
I have read your project details, and I am interested in offering my services. I provide 100% satisfaction guaranteed on all my work. Milestone is required to begin; to be released when the job has been satisfactorily completed. ftp details to your server will be required. Contact me at your soonest convenience so we may get your solution delivered quickly. Thanks, coderXO
£20 GBP in 20 days
4.9 (770 reviews)
8.3
8.3
User Avatar
Hello, I'm Maciej and I'm Web Performance Optimization consultant (I work only on projects related to performance optimization). I optimize both front end and backend (PHP, MySQL, low level Linux configuration). I have vast experience in MySQL optimization and I will be glad to take care of the issue for you. 20 records per second seem very low and most probably it's matter of untuned configuration. If you think I might be good candidate for the job please contact me. Regards, Maciej Klepaczewski
£53 GBP in 10 days
5.0 (53 reviews)
6.9
6.9
User Avatar
HELLO THERE, Over 200+ Positive Reviews. Over 90% Completion Rate. 5 Star Rating. 8+ Years of experience in PHP/MYSQL I AM INTERESTED IN WORKING ON THIS PROJECT. PLEASE CHECK MY REVIEWS AND THEN DECIDE ON ME. LOOKING FOR A LONG TERM RELATIONSHIP. -------------- THANKS, AJIT
£20 GBP in 3 days
4.9 (262 reviews)
6.7
6.7
User Avatar
I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably you will get a quick response from my end.
£25 GBP in 3 days
4.8 (53 reviews)
7.0
7.0
User Avatar
let expert do this.............................................................................................................
£30 GBP in 10 days
4.9 (209 reviews)
6.7
6.7
User Avatar
Propunerea nu a fost încă furnizată
£18 GBP in 3 days
4.6 (148 reviews)
6.5
6.5
User Avatar
Hi, i'm interested, i can do the job in a few hours if you send me the database structure, php script and CSV sample files i can install it in my server and run tests regards
£20 GBP in 1 day
5.0 (64 reviews)
6.2
6.2
User Avatar
Hi, best not sure whoch db engine you use but if you use MyISAM it will help the change to to Innodb...next important think is to run all insertion (or group of insertions) IN one transaction. Also PHP mysql_query function is depreciated for a while and is better to use PDO or mysqli . Best regards Peter
£30 GBP in 30 days
5.0 (29 reviews)
6.1
6.1
User Avatar
Aucune proposition n'a encore été fournie.
£18 GBP in 40 days
4.6 (39 reviews)
6.2
6.2
User Avatar
Hi, I am very interested to work on your project: 'CSV > MySQL Import Script tweaks and overal DB/speed tune-up' As implementation offer, I propose optimizing your import/insert csv script as requested . I have 10 years experience in PHP/MySQL and few of my projects related with yours can be seen on my freelancer.com portfolio. Notice: **My BID IS RELATIVE and negotiable on your request** My 10+ years background in: - server side programming(php, C#, C++, Java, VBA, Python etc) ; - client side programming and design(HTML/HTML5, CSS, JavaScript, JQuery, Ajax etc); - database development(MySQL, PostgreSQL, MSSQL, Informix, Access, NoSQL etc); - multiple web frameworks(Wordpress, Symfony, Drupal, CodeIgniter, Yii, PrestaShop, WooCommerce etc), - CRM (SuiteCRM, VTiger, Zoho, Infusion) , ERP ( OpenERP) - HRM Software (OrangeHRM platform) - Google App, Web Services, Mobile App, Amazon App, RESTful ; - data processing, - web scrapping any kind of data - software testing - email management on large scale applications(with complete services on architecture, design, implementation, customization, SAAS) make me very confident that we can have a successful collaboration. I suggest we start as soon as possible by sending me all the necessary technical information and agree on the final details Thank you!
£18 GBP in 4 days
5.0 (55 reviews)
5.8
5.8
User Avatar
A proposal has not yet been provided
£28 GBP in 30 days
4.3 (12 reviews)
7.0
7.0
User Avatar
Dear Sir/Madam, We are a professional organization providing software development services for various skills and technology and have been in operation for last two years. We operate from state of Gujarat (India) and have been dealing with clients from across the globe. We checked your project details and would like to discuss the requirement for further action. Kindly let us know if you would want us to work on your project. ---------------------------------------------------------------------------------------------------------------------------- Below are some technologies that we work on: • Joomla • WordPress • PHP • CSS • Virtuemart ---------------------------------------------------------------------------------------------------------------------------- Note: Actual time and cost may vary as per scope of work and will be agreed upon first with the employer. Thank You Mitesh Patel
£24 GBP in 10 days
4.9 (22 reviews)
5.2
5.2
User Avatar
Hello, if there is not some hidden cache on the server that is slowing this I am sure I can improve your import script and make it work much faster. Parsing the CSV files shouldn't be the source of the slowness except if the server has some limits set, but this really shouldn't be the case on a modern server even in a shared hosting environment. The most common mistake in such cases is that each row of data has a separate insert statement instead of grouping them. As you mentioned the table indexes should be checked. If it suites you I can do all the work/tests/improvements on my dedicated development server in France if you can supply the database structure, the script and a few CSV files. Best regards, Tomi Crnicki Croatia/EU
£20 GBP in 5 days
5.0 (14 reviews)
4.9
4.9
User Avatar
Hi There, Can be done now. Please share this project and will give you the perfect work. Thanks for this.
£30 GBP in 20 days
4.9 (49 reviews)
4.6
4.6
User Avatar
hi, i am interested. thanks
£19 GBP in 40 days
4.9 (7 reviews)
4.2
4.2
User Avatar
Hi, I am DB developer with php/data load speed tuning experience. I propose to work with you. With changes in PHP script, the speed can be increased by 10 times You have any queries, Please let me know. Regards Sankar
£18 GBP in 6 days
5.0 (7 reviews)
4.2
4.2

About the client

Flag of UNITED KINGDOM
Ipswich, United Kingdom
5.0
11
Payment method verified
Member since Feb 3, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.