Închis

Speed up / parallel processing of python code and make exe

We have some python code that works pretty well but when we run it on a big server we notice its not using all of the cores and is generally slow. Here is what we need from you.

we have a csv of about 10K urls in it that we are running with this python code

here is the script - [login to view URL]

we need you to review and make changes to it and/or the exe of it so that it will use more resources from the machine running it.

the script basics are that it runs against a list of domains to figure out where the [login to view URL] file is and then outputs to a outputcsv file the results.

When you are done speeding this thing up we need you to package to an exe so we can run it on a windows server. Ideally when running it you can assume the domain list is in the same dir as the exe you make and the output can be in the same dir as well. this will avoid needing to make ui controls for it.

lastly it would be nice if you can print to screen the progress so we can see what names its checking or done with. can be a console log sort of thing to screen.

Generic proposals will be deleted

Aptitudini: Python, Arhitectură software

Vezi mai multe: credit card processing decline code, digital image processing matlab code, code source exe, linux image processing within code, code build exe source code, audio signal processing python, processing python postgresql, implementation video processing fpga code, access parallel processing, natural language processing python code text summarization, image processing using python code, python parallel processing example, speed up python code, python parallel processing, plant leaf disease detection using image processing python code, fake currency detection using image processing python code, vehicle speed detection python code

Despre angajator:
( 463 recenzii ) Austin, United States

ID Proiect: #22475310

15 freelanceri licitează în medie 141$ pentru acest proiect

lkhelladi

Hello, I'd be glad to speed up your python tool and pack it into an exe file. Looking forward to chat with you soon for more details. Best regards.

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(169 recenzii)
7.3
umg536

Hi there, Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 6 zile
(21 recenzii)
6.2
RushService

Feel fee to contact me for Speed up / parallel processing of python code and make exe .Shoot me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order to help Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(66 recenzii)
6.1
ayeilyurt

Hello, making this program an exe would not increase the efficiency. I will use multithreading to access each site in parallel and make it run much more efficient. However, multithreading alone would not be enough. S Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(14 recenzii)
5.9
kaloyan13

My special skill is parallel programming. I can use threads to speedup your script. We have 2 options: 1) load all of the urls to memory and split between threads 2) read and push each domain to a queue, from which wor Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(104 recenzii)
6.1
anuyadav1

I am ready to take it up today and deliver it in one day . I have good experience with python threading and multiprocessing , so it will make use of maximum cpu .

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(79 recenzii)
6.2
writingapp

Hi. I have written similar exe app. It can open many urls (you can choose) at once. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, Pow Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(23 recenzii)
4.7
IshaqKN

Hi there, Yeah I will make it much faster. Own thread for each link. I have already experience with such method. I believe its the optimal solution for such tasks. It makes use I will also make changes to the code if Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(33 recenzii)
4.7
duythu0211

Hello sir, nice to meet you! I'm a DevOps engineer with strong experience with Python. I'm confident to handle this task because it's one of my daily tasks in office. Feel free to contact me if need. Thank you so much Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(21 recenzii)
4.2
rudobrody

I'm python enthusiasts. It is/was pleasure to find best way to do it in python. I've also experience with parallel tasks in compiled languages. please contact in chat, i will share implementation details and prepared . Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(2 recenzii)
4.4
vaibhavAP

5 years experience in Reactjs / Redux / Angular / Nodejs / PHP / Django / Backned - Frontend development! All of our programming skills: *Front-end: - HTML, HTML5, JSON. - JAVASCRIPT (Ajax, AngularJS / 2 / 4 / 5 / Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(1 părere)
1.3
akiramatsui0305

hi Client. i have read and understood your request.i am interested in your project and can do it very well. I have wide experience in Python development and i am looking forward to contact me, please. i want to consult Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(1 părere)
0.8
mahmoudeltobgy

Hi there. I am a computer engineer and have a 3 years of experience in programming so you can trust me. I am forward to hearing from you. Thanks

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(0 recenzii)
0.0
apovalyaev

I had solid experience in C\C++, Python backgrounding by past positions in EMC, Nokia and others. Developed software on Linux, AIX and Windows platforms. Available for both software engineering and research (10+ papers Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(0 recenzii)
0.0
ArtEvorSolutions

Hello, Requests' Session in python is thread-safe - implementing parallelism won't be a headache. As of binding script to exe won't be much of a hustle either. We can do it in less than a day. Regards.

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(0 recenzii)
0.0