Optimize MySQL statements and PHP Web Crawler

$30-250 USD

Anulat

Data postării:

peste 9 ani în urmă

$30-250 USD

Plata la predare

Dear Freelancer, I need help with the optimization of some MySQL statements and PHP Web Crawlers. I have a running online tool with about 500 active users. This project is divided into three parts: 1) Landingpage and order process 2) Online tool itself and GUI 3) Several batch jobs The project is quite slow and I think it is because of poor-programmed SQL statements and a poor table scheme (no indices and so on). WHAT YOU SHOULD OPTIMIZE 2) A quick GUI would be nice for my users. Some simple MYSQL statements 3) Very essential and important part. A lot of MYSQL statements and crawlers. They could be run asynchronous instead of just using CURL DETAILS - report view: some sql statements - image view: some sql statements - [login to view URL]: a lot of sql statements - [login to view URL]: some sql and a lot of file_get_content() - [login to view URL]: A lot of file_get_content(); - [login to view URL]: a lot of sql statements - [login to view URL]: a lot of sql statements - [login to view URL]: a lot of curl - crawlGoogle: some sql and a lot of curl. I run this file every minute even if the previous run is not finished. this may be very dangerous... Asynchronous crawling would be nice. WHAT YOU SHOULD NOT OPTIMIZE 1) Website and order process is fast enough Project is done when server load is under 0.30 again. We can start with the optimization of the first file and we can measure the sql loading time before and after optimization. I have NewRelic on my Server. Server is a dedicated root server and should be fast enough. Please feel free to discuss things first and contact me if you need more infos like code examples.

ID-ul proiectului: 7102711

Despre proiect

7 propuneri

Proiect la distanță

Activ: 9 ani în urmă

Vrei să câștigi bani?

Adresa de e-mail

Avantajele de a licita pe platforma Freelancer

Stabilește bugetul și intervalul temporal

Îți primești plata pentru serviciile prestate

Evidențiază-ți propunerea

Te înregistrezi și licitezi gratuit pentru proiecte

7 freelanceri plasează o ofertă medie de $270 USD pentru proiect

@coolguyinus2004

to optimize Mysql and PHP code and also server mysql configuration too. 11+ years of experience in programming PHP/MYSQL. You can check my profile for my reputation and ranking .

$605 USD în 3 zile

4,9

(326 recenzii)

7,6

@jcsconsulting

Hello For item #3 I would recommend "curl_multi_exec". This would execute the crawlers using non-blocking I/O. It is safer than implementing a custom socket solution due to PHP's single threaded execution model. Indexes, as you already mentioned, would be an excellent low hanging fruit for us to pursue first as well as query optimization. Optimization is an area of specialty for me. I recently tuned a large, 1 TB database for a Oil & Gas client in the UK. Report queries on their alarm data were taking in excess of twenty minutes to complete. I was able to bring each query to within five seconds. Here is a sample of the feedback from my profile. "The stars aligned to find such a perfect match for this job! Awesome out of the box thinking by Jay improved our system's speed by over 100 times. I will be using JCS Consulting again!" For your online tool I would provide the following services. 1. Profile the system online or in my test lab (item #2). 2. Analyze the crawler execution speed (item #3) 2. Recommend changes and discuss them with you. 3. Implement the changes. 4. Provide after-project support to ensure you are satisfied with the results. This project sounds like a great opportunity, thank you for your consideration. Feel free to message me if you have any questions. Best regards, Jay

$222 USD în 5 zile

5,0

(12 recenzii)

5,0

@dddevelopersd

I have immense experience in custom PHP programming and well versed in open-sources / Framework like Joomla, Drupal, Cakephp, Wordpress and others. share with me more details i am waiting for your reply.

$224 USD în 7 zile

5,0

(7 recenzii)

3,9

@BitLabs

Dear sir, I will complete your project within 3 days, LIFETIME error free guarantee and provide ONE YEAR support... I have gone through your outsourced requirement "Optimize MySQL statements and PHP Web Crawler" and have analysed that I have right credentials (Graphic Design, HTML, MySQL, PHP, Website Design) to execute your esteemed project. You will never go wrong choosing me :)

$131 USD în 3 zile

5,0

(23 recenzii)

3,5

@usamae

Hi there. I hope you are doing well. I just got the notification of your project. Well, i read the description and I am glad that I can work again with you. Thanks!

$388 USD în 3 zile