Închis

Speed up / parallel processing of python code and make exe

We have some python code that works pretty well but when we run it on a big server we notice its not using all of the cores and is generally slow. Here is what we need from you.

we have a csv of about 10K urls in it that we are running with this python code

here is the script - [login to view URL]

we need you to review and make changes to it and/or the exe of it so that it will use more resources from the machine running it.

the script basics are that it runs against a list of domains to figure out where the [login to view URL] file is and then outputs to a outputcsv file the results.

When you are done speeding this thing up we need you to package to an exe so we can run it on a windows server. Ideally when running it you can assume the domain list is in the same dir as the exe you make and the output can be in the same dir as well. this will avoid needing to make ui controls for it.

lastly it would be nice if you can print to screen the progress so we can see what names its checking or done with. can be a console log sort of thing to screen.

Generic proposals will be deleted

Aptitudini: Python, Arhitectură software

Vezi mai multe: credit card processing decline code, digital image processing matlab code, code source exe, linux image processing within code, code build exe source code, audio signal processing python, processing python postgresql, implementation video processing fpga code, access parallel processing, natural language processing python code text summarization, image processing using python code, python parallel processing example, speed up python code, python parallel processing, plant leaf disease detection using image processing python code, fake currency detection using image processing python code, vehicle speed detection python code

Despre angajator:
( 460 recenzii ) Austin, United States

ID Proiect: #22475310

21 freelanceri licitează în medie 136$ pentru acest proiect

lkhelladi

Hello, I'd be glad to speed up your python tool and pack it into an exe file. Looking forward to chat with you soon for more details. Best regards.

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(158 recenzii)
7.2
umg536

Hi there, Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 6 zile
(18 recenzii)
6.1
topexpert713

Hello, Hi, Nice to meet you! I have read your requirements carefully and I am very interesting for your project. I am confident of this project as I'm a professional Python expert with over 5 years of experience. gith Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(35 recenzii)
5.8
kaloyan13

My special skill is parallel programming. I can use threads to speedup your script. We have 2 options: 1) load all of the urls to memory and split between threads 2) read and push each domain to a queue, from which wor Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(95 recenzii)
6.0
anuyadav1

I am ready to take it up today and deliver it in one day . I have good experience with python threading and multiprocessing , so it will make use of maximum cpu .

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(78 recenzii)
6.2
RushService

Feel fee to contact me for Speed up / parallel processing of python code and make exe .Shoot me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order to help Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(59 recenzii)
6.0
ayeilyurt

Hello, making this program an exe would not increase the efficiency. I will use multithreading to access each site in parallel and make it run much more efficient. However, multithreading alone would not be enough. S Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(11 recenzii)
5.6
IshaqKN

Hi there, Yeah I will make it much faster. Own thread for each link. I have already experience with such method. I believe its the optimal solution for such tasks. It makes use I will also make changes to the code if Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(11 recenzii)
4.0
duythu0211

Hello sir, nice to meet you! I'm a DevOps engineer with strong experience with Python. I'm confident to handle this task because it's one of my daily tasks in office. Feel free to contact me if need. Thank you so much Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(20 recenzii)
4.0
writingapp

Hi. I have written similar exe app. It can open many urls (you can choose) at once. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, Pow Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(11 recenzii)
3.8
wangxiangyu1231

Hi. Nice to meet you . I checked your requirement and script. your script is for scraping? I have a lot experience with web scraping. I can do it, with muti-threading. To improve speed. if you want to discuss with me a Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(9 recenzii)
3.8
ElectPro1985

How are you? I am a senior web expert with 9 years of experience. I have checked your requirement in detail. I can start right now. Once you award me, I will do my best. I will serve you whenever you want. No Worry a Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(7 recenzii)
4.0
healer818

Hello I have just read you requirement carefully and I am sure i can finish it a few hour.r It is easy for me because I am a professional python expert for 5 years experience. Please contact me if you want to finish it Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(1 părere)
2.8
pozhitok22

Hello, Client! I have read your job description carefully and it's very interesting job with the Website Development. I'm a Web developer and I have much experiences with Frontend Development & Amazon web service. My S Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(2 recenzii)
1.9
DreamYOU

Dear. Nice to meet you. I am a Python Expert who is specialized in Webapp / Data Analytics / Machine Learning. I have been programming for over 8+ years & always had a 100% satisfaction rate. I am good at Python, Dj Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(1 părere)
1.4
akiramatsui0305

hi Client. i have read and understood your request.i am interested in your project and can do it very well. I have wide experience in Python development and i am looking forward to contact me, please. i want to consult Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(1 părere)
0.8
mahmoudeltobgy

Hi there. I am a computer engineer and have a 3 years of experience in programming so you can trust me. I am forward to hearing from you. Thanks

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 2 zile
(0 recenzii)
0.0
vaibhavAP

5 years experience in Reactjs / Redux / Angular / Nodejs / PHP / Django / Backned - Frontend development! All of our programming skills: *Front-end: - HTML, HTML5, JSON. - JAVASCRIPT (Ajax, AngularJS / 2 / 4 / 5 / Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 3 zile
(1 părere)
0.0
apovalyaev

I had solid experience in C\C++, Python backgrounding by past positions in EMC, Nokia and others. Developed software on Linux, AIX and Windows platforms. Available for both software engineering and research (10+ papers Mai multe

%bids___i_sum_sub_35%%project_currencyDetails_sign_sub_36% USD în 7 zile
(0 recenzii)
0.0
rudobrody

I'm python enthusiasts. It is/was pleasure to find best way to do it in python. I've also experience with parallel tasks in compiled languages. please contact in chat, i will share implementation details and prepared . Mai multe

%bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD în 1 zi
(0 recenzii)
0.0