Hi,
I have read your job post and pleased to inform you that we have huge experience in crawling and scraping data.
We believe data extraction is all about accuracy and without accuracy it is useless and as per my understanding the key points of the scrapper will be as follows: -
- Scrapper will be implemented which will automatically scrape & filter the collected data.
- Data will be scrapped at defined regular intervals of time based on corn jobs.
- A Smart algorithm will be implemented, in order to maintain system accuracy and better result. It will automatically filter duplicate, incomplete, buggy records.
- The system will not delete any collected or filtered data and it will also keep a complete log of every information and process, so it can be further used to generate various business-orientated analytic and new information whenever required.
- There will be a separate admin panel that consists of all the data and scrapped data can also be exported to excel or CSV etc by admin.
Further to add we have huge experience in crawling and scraping. We have recently scrapped various data giants such as Facebook, LinkedIn, Google, MSN, Bing, Yahoo, G+, Groupon, Twitter, Yellow Pages, Yelp, White pages, YouTube, Amazon, Weather Websites, NOMAD website for Weather reports and various other E-Commerce, Affiliation websites, etc.
With our expertise, we can definitely help you with your project by developing a scrapper as per your requirement in a cost-effective manner.
Also I do have few queries:
- Will you require automated scrapping or you want to control when and which profiles to process?
- Do you want any control on the numbers of results scraped from the sites?
We have done similar work earlier for multiple clients and we understand and respect our client privacy and IP rights. We cannot share those details public domain. We'd love to showcase our work when we start project discussion.
I would like to discuss more about project your project so we can have clear understanding of project and its requirements.
Looking forward to hear from you.
Best Regards,
Tapan S.