Need Help Implementing [login to view URL] on Video Inputs for Machine Learning
$750-1500 USD
S-au achitat serviciile după ce au fost prestate
I'm training a video classification model using TensorFlow and Keras. Currently my data pipeline is a custom generator than reads the raw video file, do some preprocessing and feed the processed data into the model batch by batch. However, this is really slow and not scalable to large datasets.
I'm currently running the model on my university's high performance computing server, which allows me to request up to 28 cpu cores (with up to 128 gb of memory each) and 4 gpu cores per job. However, my custom generator, which processes videos sequentially are not utilizing these resources for speedup and is pretty much stuck at the I/O disk reading and video pre-processing part.
I'm unfamiliar with [login to view URL] pipeline but heard that it can prefetch data. I also heard about parallel processing but I'm unable to implement these by myself. So I'm asking for your help to write a code that can prefetch video data, do parallel processing of my videos and utilize the resources provided so that the speed of the training and prediction can be increased.
I'm going to give you more information in the chat room.
This will be ongoing work if it goes well.
ID Proiect: #27500724
Detalii despre proiect
16 freelanceri plasează o ofertă medie de 1183$ pentru proiect
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https:/ Mai multe
Hi, there. I am a machine learning engineer with 5+ years of hands-on experience in Tensorflow. Carefully checked your requirements. Hope to work for you with this project. Best regards, Sgadou
Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python, JAVA, etc. I Mai multe
Hello! I have read your project details completely and thoroughly. I am Python and have 10 years experience. Further details will be discuss in the inbox. I am waiting for your message to discuss it. Th Mai multe
