We have some python code that works pretty well but when we run it on a big server we notice its not using all of the cores and is generally slow. Here is what we need from you.
we have a csv of about 10K urls in it that we are running with this python code
here is the script - [login to view URL]
we need you to review and make changes to it and/or the exe of it so that it will use more resources from the machine running it.
the script basics are that it runs against a list of domains to figure out where the [login to view URL] file is and then outputs to a outputcsv file the results.
When you are done speeding this thing up we need you to package to an exe so we can run it on a windows server. Ideally when running it you can assume the domain list is in the same dir as the exe you make and the output can be in the same dir as well. this will avoid needing to make ui controls for it.
lastly it would be nice if you can print to screen the progress so we can see what names its checking or done with. can be a console log sort of thing to screen.
Generic proposals will be deleted
21 freelancers are bidding on average $136 for this job
I am ready to take it up today and deliver it in one day . I have good experience with python threading and multiprocessing , so it will make use of maximum cpu .