
Closed
Posted
Paid on delivery
Full-Stack Python Developer / Team — Multi-Tenant Data Scraping & Lead Generation Web Application Project Overview We are seeking an experienced Senior Full-Stack Python Developer (or small specialized agency) to build a scalable, multi-tenant web application for automated web scraping, contact discovery, and lead management. The application will host two independent scraping engines under a unified user and admin dashboard, featuring background task queues, anti-bot mechanisms, automated data enrichment, and direct Google Sheets API integration. Key Technical Architecture & Modules 1. Module 1: Job Site Scraping Engine Automated data extraction from dynamic and static job portals. Support for site-specific selectors, pagination rules, rate limiting, and category/subcategory filtering. High-volume background processing (~200 records per source daily). 2. Module 2: General Data & Lead Generation Engine Niche and location-based business data extraction from web sources, public directories, and map platforms. Integration interface for third-party enrichment APIs (e.g., LinkedIn/executive data). 3. Automated Contact Discovery & Formatting Engine Deep-crawl fallback logic: Automatically inspects company websites (contact pages, footers) and public sources when primary contact info is missing. Phone number parsing and standardization (E.164 international format with click-to-call support). Email syntax cleaning and deliverability validation. 4. Multi-Tenant User Dashboard & Admin Panel Secure user authentication with OTP verification. Role-Based Access Control (RBAC) with logical database isolation (user_id separation). System-wide task scheduling (admin-controlled fixed intervals). Real-time task progress monitoring, logs, and failure email alerts. 5. Integrations & Data Sync Google Sheets API: Direct OAuth-based auto-sync per individual user account. Server-side Excel Export (.xlsx): Auto-generated downloadable files with date/time tracking. Automated Webhooks: Webhook support for external CRM pushes. Deduplication: Hash-based checks (user_id + unique record identifiers) to prevent duplicate record storage. Required Tech Stack Backend Framework: Python (Django or FastAPI) Scraping & Crawling: Scrapy, Playwright, Selenium, BeautifulSoup Anti-Bot Countermeasures: Rotating residential proxy pools, CAPTCHA bypass, stealth headless browsers Task Queue & Scheduler: Celery + Redis + Celery Beat Database: PostgreSQL (indexed for fast deduplication lookups) Frontend: React.js / [login to view URL] with Tailwind CSS or Bootstrap How to Apply Start your proposal with the exact phrase 'SCRAPER ENGINE' to confirm you have reviewed the complete architectural specification. Please submit your proposal with: Relevant Portfolio: 2–3 examples of complex web scrapers, data pipelines, or multi-tenant Django/React applications you have built. Technical Approach: Briefly outline your preferred setup for proxy rotation, headless browser management, and handling Celery worker queues. Fixed Price & Timeline: Provide an estimated cost and milestone timeline for delivering the core scraping engines and web application.
Project ID: 40693329
162 proposals
Remote project
Active 7 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
162 freelancers are bidding on average $135 USD for this job

Hello, I am Dr. Rajesh Rolen, PhD in Computer Science & Engineering, with experience of over 20+ years in PHP, React.js, NoSQL Couch & Mongo, Web Scraping, Python, Django As a preferred freelancer in the top 1%, I have done 400+ projects here on freelancer.com, I have 4.9 ratings out of 5 on average, which showcases my quality of work and timely delivery. Key Highlights: - Free Hosting Support on the Cloud or any desired platform. - Free 3 months of post-delivery support to ensure that our client doesn’t face any challenges after the launch of the project. - Free Dedicated tester on projects to ensure quality delivery, so clients don’t need to act as a tester. - 10+ Years experience UI/UX team to ensure intuitive UI. Portfolio: https://www.freelancer.com/u/Microlent Please open the chat and send me a message, so we can have a more detailed discussion about the project to give you the project timeline and cost. Thank you for considering my services. I look forward to engaging in a productive conversation and understanding how I can be of assistance in bringing your project to life. Regards Rajesh Rolen
$140 USD in 10 days
9.4
9.4

SCRAPER ENGINE This is a strong match because I have built several real scrapers. My Mercari scraper work covered delivery, cost and client invoicing. My Co-op scraper handled changes to their Algolia request structure. I also built catalog extraction using Playwright and Selenium flows. That work mimicked real users on SPA sites to capture product data. My UK Car Imports project included proxy logic and volume testing. These projects directly relate to your scraping and proxy requirements. For accuracy, I would apply AI during extraction and data validation. AI can help derive selectors from sampled page structures faster. It can classify extracted fields before they enter your data store. It can also flag unusual prices, phones or emails for review. I would keep deterministic validation before accepting each record. This gives faster development without trusting AI with final data. I would isolate Celery workers by engine and control them with Redis. PostgreSQL would handle tenant isolation and hash-based deduplication. Proxy sessions would be managed separately from browser workers. Google Sheets OAuth state would remain isolated for every tenant. I estimate $250 fixed over 14 days for the initial implementation. I would first prove both engines with representative sources. Then I would expand source coverage after the extraction works. This reduces the risk of building a large scraper around bad rules.
$140 USD in 7 days
9.1
9.1

Hello, With 15+ years of experience in the industry, I, Yasir Shah, founder of A4Logic, am certain that I have the skills and knowledge you need to create this robust web scraping and lead generation application. My expertise in Python, Django, & FastAPI; Scrapy, Playwright; Selenium and BeautifulSoup; Celery and Redis/Celery Beat for task queues; along with PostgreSQL for efficient deduplication lookups position me as an ideal candidate for this endeavor. Regarding your explicit requirements for Modules 1 and 2, I've successfully built similar data scraping engines extracting high volumes of data from various sources before allowing me to confidently state that there's no challenge too big for me to handle. Additionally, my experience in creating web applications with role-based access control (RBAC) ensures proper data isolation while granting users only authorized access to their own individual accounts , an essential feature in a multi-tenant app like yours. Last but not least, I'm impressed by your plan for anti-bot countermeasures! It shows you're aware of the challenges present with web scraping projects. My previous ventures include using rotating residential proxy pools and managing CAPTCHA bypasses and stealth headless browsers to combat these obstacles effectively. To further demonstrate my suitability for this project, I invite you to review my diversified portfolio containing several examples of complex web scrapers, Thanks!
$180 USD in 2 days
8.6
8.6

⭐⭐⭐⭐⭐ Build a Scalable Multi-Tenant Data Scraping Web Application ❇️ Hi My Friend, I hope you are doing well. I've reviewed your project requirements and see you're looking for a Full-Stack Python Developer. You don’t need to look any further; Zohaib is here to help you! My team has successfully completed 50+ similar projects for data scraping and web applications. I will use efficient methods to create a scalable application with features like automated scraping and lead generation. ➡️ Why Me? I can easily do your project as I have 5 years of experience in full-stack development, focusing on Python, web scraping, and API integrations. My expertise includes Django, React, and task management with Celery. Additionally, I have a strong grip on database management and anti-bot measures to ensure seamless operations. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. Looking forward to discussing this with you! ➡️ Skills & Experience: ✅ Python ✅ Django ✅ React.js ✅ Web Scraping ✅ Selenium ✅ Scrapy ✅ BeautifulSoup ✅ PostgreSQL ✅ Celery ✅ API Integration ✅ Data Processing ✅ Task Scheduling Waiting for your response! Best Regards, Zohaib
$150 USD in 2 days
8.1
8.1

SCRAPER ENGINE As the founder of MAK Online Solutions, I lead a team that focuses on building robust and scalable applications using modern technologies. With our proficiency in Python, Django, React.js, and the entire tech stack you require, we assure you that we have the expertise to complete your project successfully. Our portfolio includes complex web scrapers and data pipelines, validating our ability to create a multi-tenant application like yours. We integrate Redis powered Celery for efficient background task management and PostgreSQL for fast deduplication lookups as you've specified. Our handling of Celery worker queues is meticulously orchestrated to ensure minimal latency and optimize CPU power. Moreover, we are no strangers to anti-bot countermeasures and are well-versed in working with rotating residential proxy pools, CAPTCHA bypasses, and stealth headless browsers. We understand the challenges associated with automated scraping at a large scale and therefore ensure seamless proxy rotation and headless browser management. Given our competency in building similar projects, we can deliver remarkable tailor-made modules that automate data extraction from dynamically evolving sources such as job portals and public directories alike. Let's start building!
$240 USD in 2 days
7.5
7.5

SCRAPER ENGINE I see you need a multi-tenant web application with two scraping engines and solid background processing. The challenges of handling those anti-bot mechanisms and high-volume data extraction are clear. And I’ll implement a solution using Python with Django or FastAPI, using Scrapy and Playwright for scraping, as well as Celery with Redis for task management. I'll make sure role-based access control and effective data handling to meet your requirements. I can have the core functionality ready for you to test first, only award once you're satisfied with the results, so there's really no risk on your end. My bid is 62 USD, and I’m ready to start immediately. Rajavel Freelance Developer specializing in Python, web scraping, and multi-tenant applications.
$62 USD in 10 days
7.2
7.2

Hello, I am interested in building your multi-tenant scraping and lead generation platform. I understand you need a scalable solution combining automated scraping, contact discovery, data enrichment, and a user-friendly dashboard. I have experience with Python, Django/FastAPI, React, PostgreSQL, Celery, Redis, Scrapy, and Playwright. I can develop reliable scraping engines with background processing, proxy management, dynamic website handling, and clean data extraction workflows. I can build the complete system including user/admin dashboards, lead management, contact validation, Google Sheets integration, CRM webhooks, exports, and duplicate prevention. My focus will be on creating a secure, scalable, and maintainable application. I would be happy to discuss your technical requirements, milestones, and preferred architecture. I am ready to help deliver a powerful lead generation platform built for long-term growth.
$30 USD in 1 day
7.2
7.2

Hi, I'm Denis, a full-stack developer with experience building data extraction systems and multi-tenant applications using Scrapy, Playwright, Django, and Celery. I understand your needs: a robust system to extract data from multiple sources at scale, handle anti-bot challenges, deduplicate records, and sync to Google Sheets with strong multi-tenant isolation. The core complexity isn't scraping itself—it's managing proxy rotation reliably, handling failures gracefully, maintaining stable task queues under load, and ensuring data consistency across concurrent operations. My approach: I'll clarify exact scraping requirements and target sites, then build core engines with Scrapy and Playwright for static and dynamic content. Proxy rotation and stealth headers minimize blocks. Celery with Redis handles task queuing and admin-controlled scheduling via Celery Beat. PostgreSQL manages multi-tenant isolation through user_id filtering and indexed deduplication. Contact discovery fallback runs as secondary tasks when primary data is incomplete. React frontend displays real-time progress and logs. Google Sheets integration uses per-user OAuth tokens with automatic syncing after successful scrapes. The trickiest part is maintaining reliability as sites change. I'll build monitoring and alerting to catch selector failures quickly, plus an admin interface to update selectors without redeploying. I can start immediately. Let's discuss the details. Thanks, Denis.
$150 USD in 2 days
6.5
6.5

Hi, I went through your project details and understand what you're looking to achieve. I'd be interested in working with you on this. Based on the requirements you've shared, I can handle the project from start to completion while keeping the work aligned with your expectations, timeline, and desired outcome. My approach is straightforward: first, I'll make sure the requirements and expected deliverables are clear. Then I'll complete the work in structured stages, share progress along the way, incorporate your feedback, and deliver the final work after everything has been reviewed. Before we begin, I have a couple of questions about your requirements that will help me understand the scope more accurately. Feel free to message me so we can discuss the details and determine the best way to move forward. Best regards, Anum
$250 USD in 1 day
6.6
6.6

SCRAPER ENGINE I have experience building Python-based scraping systems, data pipelines, Django/FastAPI backends, React dashboards, PostgreSQL, Celery/Redis, and API integrations. I can develop the two scraping engines with scalable background workers, multi-tenant architecture, deduplication, contact enrichment, Google Sheets sync, exports, webhooks, and admin monitoring. 1. Which sources should be prioritized for the first scraping release, and what daily volume do you expect? 2. Should scraping limits and schedules be configurable per tenant or controlled globally by admins? 3. Do you already have preferred proxy/enrichment providers, or should I recommend the setup?
$140 USD in 7 days
6.5
6.5

Hello There! I’m Md Toriqul Islam, an experienced Full-Stack Python developer specializing in Django, FastAPI, Scrapy, Playwright, Celery, Redis, PostgreSQL, React, and scalable data pipelines. I have rich experience building automated scraping systems, lead-generation platforms, background task processing, multi-tenant dashboards, API integrations, deduplication, data enrichment, and Excel/Google Sheets exports. I am skilled in Python, Django/FastAPI, Scrapy, Playwright, Celery, Redis, PostgreSQL, React, REST APIs, OAuth, and scalable worker architecture. I understand you need a multi-tenant scraping and lead-generation platform with two scraping engines, contact discovery, data enrichment, proxy/browser management, Celery queues, RBAC, real-time monitoring, Google Sheets sync, webhooks, and automated deduplication. I have some questions: 1) Which CRM are you currently using, and do you already have the required API/integration credentials? 2) Do you have a preferred WordPress builder such as Elementor, Divi, or Gutenberg? 3) How many landing pages are you planning to build after the pilot page? I’m ready to start immediately and would be happy to discuss the architecture, scraping targets, milestones, timeline, and relevant examples. Looking forward to hearing from you. Best regards, Md Toriqul Islam
$100 USD in 3 days
6.6
6.6

SCRAPER ENGINE Hi, I can build this with Django, PostgreSQL, Celery/Redis, Playwright, and Next.js. The platform will include tenant isolation, RBAC, queued scraping jobs, deduplication, enrichment, exports, webhooks, and Google Sheets OAuth sync. I’ll use rate limiting, managed browser workers, retries, and API-first collection. CAPTCHA or access-control bypasses would be replaced with approved APIs or licensed data providers. Relevant examples can be shared privately. Which sources must the first scraping engine support? Regards, Houssame
$140 USD in 7 days
6.6
6.6

Hello! We can build a multi-tenant web app for scraping, lead generation, and data management. 1. Which part should we prioritize first: scraping, lead management, or dashboard? 2. Do you already have source sites and API access details? — About us We are dZENcode – a full-cycle IT company for digital product development: from design and programming to integrations and post-release support. We build projects from scratch and also work on existing solutions that need further development, improvements, or technical support. You can find detailed information about our services and rates on our official website: https://dzencode.com. Please review it – after that, we can discuss the details and agree on the next step. ⚠️ After clarifying all details, we will define the scope, the suitable cooperation format – task-based, outsourcing, or outstaffing – and the final cost. Projects are guaranteed to reach release with us: • 10+ years providing IT services; • 90+ in-house specialists; • 250+ public reviews since 2015; • We support products under SLA after launch; • We work under NDA and a company contract!
$140 USD in 7 days
6.6
6.6

SCRAPER ENGINE Building a scalable multi-tenant web application for automated web scraping and lead generation is both an exciting challenge and an area where I excel. My approach starts with leveraging Python's robust frameworks like Django or FastAPI for backend architecture, pairing them with Scrapy for building scalable scraping engines that can efficiently handle dynamic content. For proxy management, I would implement rotating residential proxy pools and use headless browsers to navigate site-specific challenges while incorporating anti-bot measures. Utilizing Celery with Redis would ensure seamless task scheduling and processing, allowing high-volume background operations to run smoothly. Here are a few similar projects I’ve worked on: - [Link to portfolio example 1] - [Link to portfolio example 2] - [Link to portfolio example 3] Could you provide more details on the specific third-party APIs you plan to integrate, and what your budget looks like for this project? I look forward to discussing how I can bring your vision to life! Thank you, Muhammad Furqan
$175 USD in 2 days
6.0
6.0

SCRAPER ENGINE I've built multi-tenant data pipelines with Scrapy, Playwright, and Celery + Redis for high-volume extraction across dynamic job portals and business directories, so this is right in my wheelhouse. I'll structure the backend on FastAPI with PostgreSQL for indexed deduplication lookups, wire Celery Beat for admin-controlled task scheduling, and handle proxy rotation through residential pools with Playwright stealth mode for CAPTCHA-prone sources. React frontend with Tailwind will surface real-time task monitoring, Google Sheets OAuth sync, and webhook triggers for CRM pushes—all isolated by user_id at the database layer for logical multi-tenancy. Contact discovery fallback logic runs on secondary crawl chains when primary extraction misses, with E.164 phone parsing and email deliverability validation baked into the enrichment pipeline. The critical operational piece is deduplication performance—hash-based checks on (user_id + record_id) need indexed queries to avoid bottlenecks at scale, so I'll pre-build that schema from day one. I can start immediately and outline milestones after we align on proxy provider and CAPTCHA handling strategy. Thanks, Andrii
$150 USD in 4 days
5.5
5.5

SCRAPER ENGINE Hello! I'm Karthik, a Full-Stack Python Developer with 15+ years of experience in building robust applications. I specialize in creating scalable, multi-tenant web scraping solutions and have extensive expertise with the required tech stack including Django, Scrapy, and React.js. Portfolio Highlights: 1. Developed a multi-tenant lead generation app with integrated scraping engines. 2. Built a complex data pipeline for a real estate platform using Scrapy and Celery. 3. Created a job scraping solution with advanced anti-bot mechanisms. Technical Approach: - Proxy Rotation: Utilize rotating residential proxies with a fallback mechanism for reliability. - Headless Browsers: Implement Playwright with stealth mode to bypass anti-bot measures. - Celery Management: Configure Celery with Redis for efficient task scheduling and monitoring. Fixed Price & Timeline: I propose a budget of $200 and a timeline of 4 weeks to deliver the core scraping engines and web application, including user dashboard and integrations. Looking forward to collaborating on this exciting project! Best, Karthik
$200 USD in 7 days
5.6
5.6

Hi, I noticed your need for a scalable, multi-tenant web application that integrates automated web scraping and lead management. My experience as a Full-Stack Python Developer aligns perfectly with this project. Utilizing Python's robust libraries for web scraping, I can develop efficient scraping engines to gather data accurately. Additionally, I will employ React.js to create an intuitive user and admin dashboard, ensuring seamless interaction with the scraping engines and lead management features. To ensure the application scales effectively, what specific data volumes do you anticipate handling, and are there any particular websites you need prioritized for scraping? Understanding these details will help tailor the solution to meet your exact requirements.
$30 USD in 7 days
5.8
5.8

SCRAPER ENGINE Hi Tommy, I will build a multi‑tenant app with two scraping engines (job portal and lead generation), Celery‑Redis task queues, anti‑bot proxy rotation, Google Sheets sync, and React dashboard. I’ll deliver the MVP in 4 weeks for $250. I can start immediately with a sample job‑site scraper. Do you prefer Django or FastAPI? Waiting for your response in chat! Best Regards.
$140 USD in 3 days
5.5
5.5

scraper engine hi, i have reviewed the details of your project. i can build the multi tenant scraping and lead generation platform with python, django or fastapi, postgresql, celery, redis, and react. i have solid experience with scraping, data pipelines, api integrations, background workers, dashboards, and multi tenant systems. i will build the two scraping engines, contact discovery and data cleaning, user isolation, task monitoring, google sheets sync, excel exports, webhooks, and deduplication. for crawling, i will use playwright or scrapy with controlled rate limits and reliable worker queues. can we schedule a quick meeting to discuss the project in detail. it will help me understand your needs better and give you a clear plan with timeline and budget. i will also share my portfolio during the chat. mughiraa
$140 USD in 7 days
5.4
5.4

SCRAPER ENGINE ==== Hi - Truong here ==== "MULTI-TENANT SCRAPING & LEAD GENERATION PLATFORM" — you need two reliable scraping engines feeding one isolated dashboard, with enrichment, deduplication, and background processing handled automatically. I’d structure this around Django + PostgreSQL + Celery/Redis, with Scrapy for scalable crawling and Playwright only where browser rendering is required. Tenant-scoped records, hash-based deduplication, retryable workers, proxy rotation, logging, and Google Sheets sync should be separated into clear services so new sources can be added without destabilizing the system. Can you share the first 2–3 target sources so I can map the scraper architecture and worker flow around their actual requirements? Looking forward to work with you.
$30 USD in 1 day
5.1
5.1

London, United Kingdom
Payment method verified
Member since Jul 16, 2026
$30-250 USD
£20-250 GBP
£20-250 GBP
$30-250 USD
$10-30 USD
$30-250 USD
$30-250 USD
$10-30 USD
£20-250 GBP
$30-250 USD
$250-750 USD
€30-250 EUR
$1500-3000 USD
$30-250 CAD
$750-1500 USD
₹12500-37500 INR
€8-10 EUR
$50-100 USD
£10-20 GBP
$10-30 CAD
$15-25 USD / hour
£10-15 GBP / hour
₹1500-12500 INR
₹600-1500 INR