Closed

Speed up / parallel processing of python code and make exe

We have some python code that works pretty well but when we run it on a big server we notice its not using all of the cores and is generally slow. Here is what we need from you.

we have a csv of about 10K urls in it that we are running with this python code

here is the script - [login to view URL]

we need you to review and make changes to it and/or the exe of it so that it will use more resources from the machine running it.

the script basics are that it runs against a list of domains to figure out where the [login to view URL] file is and then outputs to a outputcsv file the results.

When you are done speeding this thing up we need you to package to an exe so we can run it on a windows server. Ideally when running it you can assume the domain list is in the same dir as the exe you make and the output can be in the same dir as well. this will avoid needing to make ui controls for it.

lastly it would be nice if you can print to screen the progress so we can see what names its checking or done with. can be a console log sort of thing to screen.

Generic proposals will be deleted

Skills: Python, Software Architecture

See more: credit card processing decline code, digital image processing matlab code, code source exe, linux image processing within code, code build exe source code, audio signal processing python, processing python postgresql, implementation video processing fpga code, access parallel processing, natural language processing python code text summarization, image processing using python code, python parallel processing example, speed up python code, python parallel processing, plant leaf disease detection using image processing python code, fake currency detection using image processing python code, vehicle speed detection python code

About the Employer:
( 460 reviews ) Austin, United States

Project ID: #22475310

21 freelancers are bidding on average $136 for this job

lkhelladi

Hello, I'd be glad to speed up your python tool and pack it into an exe file. Looking forward to chat with you soon for more details. Best regards.

$125 USD in 2 days
(158 Reviews)
7.2
umg536

Hi there, Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for More

$150 USD in 6 days
(18 Reviews)
6.1
topexpert713

Hello, Hi, Nice to meet you! I have read your requirements carefully and I am very interesting for your project. I am confident of this project as I'm a professional Python expert with over 5 years of experience. gith More

$125 USD in 7 days
(35 Reviews)
5.8
kaloyan13

My special skill is parallel programming. I can use threads to speedup your script. We have 2 options: 1) load all of the urls to memory and split between threads 2) read and push each domain to a queue, from which wor More

$100 USD in 1 day
(95 Reviews)
6.0
anuyadav1

I am ready to take it up today and deliver it in one day . I have good experience with python threading and multiprocessing , so it will make use of maximum cpu .

$125 USD in 2 days
(78 Reviews)
6.2
RushService

Feel fee to contact me for Speed up / parallel processing of python code and make exe .Shoot me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order to help More

$150 USD in 3 days
(59 Reviews)
6.0
ayeilyurt

Hello, making this program an exe would not increase the efficiency. I will use multithreading to access each site in parallel and make it run much more efficient. However, multithreading alone would not be enough. S More

$166 USD in 7 days
(11 Reviews)
5.6
IshaqKN

Hi there, Yeah I will make it much faster. Own thread for each link. I have already experience with such method. I believe its the optimal solution for such tasks. It makes use I will also make changes to the code if More

$120 USD in 2 days
(11 Reviews)
4.0
duythu0211

Hello sir, nice to meet you! I'm a DevOps engineer with strong experience with Python. I'm confident to handle this task because it's one of my daily tasks in office. Feel free to contact me if need. Thank you so much More

$100 USD in 3 days
(20 Reviews)
4.0
writingapp

Hi. I have written similar exe app. It can open many urls (you can choose) at once. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, Pow More

$245 USD in 3 days
(11 Reviews)
3.8
wangxiangyu1231

Hi. Nice to meet you . I checked your requirement and script. your script is for scraping? I have a lot experience with web scraping. I can do it, with muti-threading. To improve speed. if you want to discuss with me a More

$150 USD in 1 day
(9 Reviews)
3.8
ElectPro1985

How are you? I am a senior web expert with 9 years of experience. I have checked your requirement in detail. I can start right now. Once you award me, I will do my best. I will serve you whenever you want. No Worry a More

$125 USD in 7 days
(7 Reviews)
4.0
healer818

Hello I have just read you requirement carefully and I am sure i can finish it a few hour.r It is easy for me because I am a professional python expert for 5 years experience. Please contact me if you want to finish it More

$150 USD in 1 day
(1 Review)
2.8
pozhitok22

Hello, Client! I have read your job description carefully and it's very interesting job with the Website Development. I'm a Web developer and I have much experiences with Frontend Development & Amazon web service. My S More

$100 USD in 7 days
(2 Reviews)
1.9
DreamYOU

Dear. Nice to meet you. I am a Python Expert who is specialized in Webapp / Data Analytics / Machine Learning. I have been programming for over 8+ years & always had a 100% satisfaction rate. I am good at Python, Dj More

$100 USD in 3 days
(1 Review)
1.4
akiramatsui0305

hi Client. i have read and understood your request.i am interested in your project and can do it very well. I have wide experience in Python development and i am looking forward to contact me, please. i want to consult More

$125 USD in 3 days
(1 Review)
0.8
mahmoudeltobgy

Hi there. I am a computer engineer and have a 3 years of experience in programming so you can trust me. I am forward to hearing from you. Thanks

$100 USD in 2 days
(0 Reviews)
0.0
vaibhavAP

5 years experience in Reactjs / Redux / Angular / Nodejs / PHP / Django / Backned - Frontend development! All of our programming skills: *Front-end: - HTML, HTML5, JSON. - JAVASCRIPT (Ajax, AngularJS / 2 / 4 / 5 / More

$125 USD in 3 days
(1 Review)
0.0
apovalyaev

I had solid experience in C\C++, Python backgrounding by past positions in EMC, Nokia and others. Developed software on Linux, AIX and Windows platforms. Available for both software engineering and research (10+ papers More

$250 USD in 7 days
(0 Reviews)
0.0
rudobrody

I'm python enthusiasts. It is/was pleasure to find best way to do it in python. I've also experience with parallel tasks in compiled languages. please contact in chat, i will share implementation details and prepared . More

$100 USD in 1 day
(0 Reviews)
0.0