Scala web scrapeproiecte
Am nevoie de un script care sa faca "scrape" in fb ads prin, API sau nu, dupa un cuvant cheie (predefinit) si sa salveze datele centralizat ori intro baza de date sa poata fi sortata dupa criteriile de mai jos ori intr-un fisier excel. Date necesare in tabel: - data publicarii reclamei - link din reclama - link catre reclama fb ads - nr de reclame rulate pe creativul respectiv (CEL MAI IMPORTANT ASPECT) - text reclama - link video.
Am nevoie de datele din casetele box score aferente meciului cat si de cele aferente fiecarui dori sa pot aduce datele pentru un anumit seson ales ex (2019-2020) sa il pot schimba si sa aduc date pentru oricare sezon doresc.
Trebuie să scot cote din 3 case de pariuri românești (Superbet, Betano, Fortuna), sporturi (fotbal, tenis, baschet, hochei, handbal), cu o rată de actualizare în software-ul meu de minim 5 minute. Trebuie să compar această cotă, cu cote medii de la pentru fiecare meci, am nevoie de toate tipurile de pariuri și cote disponibile în Odds Portal pentru un joc specific și să le compar cu aceleași tipuri de pariuri de la Bookies românești pentru acelasi joc . Am nevoie de filtru pentru (ore înainte de începutul jocului, Valoare, Comutare între Bookies Românești, Odds Drop (asta înseamnă că cred că trebuie să stocați cotele vechi și să le comparați cu cele noi după actualizare). Am nevoie și de comparație între valori între cote ...
De cateva luni am descoperit o noua oportunitate de business online ce poate produce un venit pasiv lunar. In general nu dedic mai mult de o ora pe zi dar nu pot scala singura, am nevoie de o echipa. Asadar, daca esti dispus(a) sa oferi o ora pe zi, esti serios(a), determinat(a) si crezi in ideea de business online lasa un mesaj si te voi contacta pt mai multe detalii. Daca ai auzit de trading si te intereseaza sa inveti mai mult, cu siguranta acest tip de business iti va parea atragator. ROiMarketsLive Community
I'm in need of someone to help me scrape a website daily, note down a list of traders and run some checks on them. Qualifications: - Knowing how to use a computer. Tasks Involved: - Visit the website daily, note down a list of traders, and run some checks on them. - This needs to be done by hand, as it cannot be automated due to Cloudflare.
I'm looking for a proficient web scraper who can extract text content from a specific website on a daily basis. The scraped data should be compiled and delivered in a spreadsheet. Key requirements include: - Daily scraping of text content from the designated website - Compilation and formatting of this data into a spreadsheet Your experience in web scraping, data compiling, and spreadsheet management will be greatly valued for this project. Accuracy, timeliness, and consistent daily delivery are crucial aspects of this job. Understanding of automation tools for data scraping would be a big plus. I am looking to collate some data from this website and need an ongoing scrape of this website to set up an ever-updating excel spreadsheet with the fields as per the...
I'm looking for a skilled professional to scrape and collect specific sports-related statistics from Website A. The template is made, its really jsut a copy and paste exercise. Code is already written. Key Responsibilities: - Extract sports statistics from Website A. Your Skills and Qualifications: - Proficiency in web scraping and data extraction. - Previous experience with similar projects. - Understanding of sports statistics is a plus. This is a one-time project with the potential for future work if successful. I look forward to discussing the project further with you.
I need a seasoned expert to scrape data from a specific website for data analysis. The scope of the project, types of data to be scraped, and further details will be discussed once we move forward. Ideal Skills: - Strong understanding of web scraping techniques - Proficiency in data scrapers (ex: Octoparse, Content Grabber) - Understanding of data analysis Your application should highlight your experiences in these areas, provide examples of past projects, and present a brief proposal on how you'd tackle this project. Creativity, clarity, and specificity will be highly appreciated.
I'm looking for a data analyst to scrape LinkedIn data and create a series of analytics from the information. Linkedin Recruiter or Premium Account will be needed for this task. Output should be presented in Google Sheets or EXCEL.
...list of 2060 SKUs in an Excel sheet that I need corresponding images scraped from Website A. Each image should be saved with the SKU number as the filename (e.g., for SKU 32440). Key Requirements: - Scrape images from Website A for 2060 SKUs - Save each image as a high-resolution jpg with the SKU number as the filename Delivery: - I will provide you with the Excel sheet containing the list of SKUs via email. - You should deliver the images in a compressed file with 2060 images, each named according to the corresponding SKU. Ideal Skills and Experience: - Experience in web scraping, particularly image scraping - Proficient in Excel for managing SKU lists - Ability to deliver high-resolution images - Attention to detail to ensure correct matching of SKUs and images Ple...
I require a Python script that can scrape specific data and images from the top 10 property websites in the UK. The script should be able to: - Extract property prices - Obtain property descriptions - Retrieve contact information for listings - Retrieve the property images I have a list of the top 10 property websites, and the script should be able to work across them all. Since these websites might have different structures, the script should be flexible enough to adapt to these differences. I would also accept 10 different scripts of varying logic if that helps the project to success. Skills and experience needed for this project: - Proficiency in Python programming - Prior experience with web scraping, particularly from dynamic websites - Ability to work with and mani...
I need a skilled PHP developer who can create a script that fetches information from a specific website when a us...2X0BHSB6AUXW5QAX (use this serial to test with) Site B : where the info need to retrive from to scrape information from to site A. Sorry for the bad image, But it is an illustration. Budget is $50 USD for this. If you cant meet this budget, dont bid on this work. Key Requirements: - Develop a PHP script to scrape information from Website B when a user inputs a serial ID on website A. - Ensure the script is efficient and able to handle multiple requests without performance degradation. Ideal Skills and Experience: - Proficient in PHP and web scraping techniques. - Familiarity with handling user input and displaying output in a web interface.
I'm in need of a skilled individual who can scrape data from various websites for the purpose of lead generation. The data should be delivered in Excel or CSV format. Key Requirements: - Proficient in web scraping - Experience with lead generation - Ability to deliver data in Excel/CSV Ideal Skills: - Proficiency in Python/R for web scraping - Previous experience in similar projects - Strong understanding of lead generation techniques If you have experience in web scraping and lead generation, I'd love to hear from you.
I'm in need of a skilled data scientist who can create a web scraping tool specifically for Shopify websites. I need to extract Product details, Pricing information, and Customer Reviews from a wide range of Shopify websites including those in the Clothing and fashion, Electronics, and Home and decor etc. Key requirements: - The tool should efficiently scrape the specified data points from the mentioned categories of Shopify websites. - The extracted data should be well-structured and easily exportable for further analysis. - The tool should be able to scrape a large number of websites in a relatively short period of time. Ideal Skills: - Proficiency in web scraping and data extraction - Experience with data structuring and analysis - Good knowledge of...
I need a tool that can scrape text content and tables from LinkedIn quickly and efficiently into an Excel format. The tool needs to be able to: - Extract text content and tables from LinkedIn - Export the scraped information into Excel format - Operate quickly and efficiently to meet a tight deadline The ideal candidate should have: - Experience in web scraping, particularly with LinkedIn - Proficiency in Excel - Ability to develop a tool that can operate quickly and effectively Given the urgency of this project, I need someone who can start ASAP and deliver the tool in a timely manner. Experience with rapid tool development would be a huge plus.
I need an experienced web scraping expert who can help me scrape relevant data from a specific website on a daily basis. Key Details: - I'm looking for data in text format including headlines, product descriptions, and any other relevant information available on the site. - There is no requirement for authentication to access the data, so the process should be straightforward. - The extraction needs to happen daily, so you should be able to set up a recurring scraping process. Skills and Experience: - Proficiency in web scraping tools and techniques. - Experience in extracting text data from websites and setting up automated daily scraping routines. - Good understanding of data formats and storage to deliver data in a usable format. I'm looking for a reli...
I am looking for a professional to scrape LinkedIn profiles for the purpose of lead generation. - The data I need extracted includes Name, Mobile Number, Email ID, and Company. - The intention is to use this information for email marketing. I need the freelancer to scrape more than 5000 profiles for this project. Ideal Skills: - Proficient in LinkedIn data scraping - Experience in lead generation - Strong attention to detail - Excellent communication skills Please let me know if you have handled similar projects in the past. Thank you.
I'm looking for a professional who can scrape specific tables on a government website for insurance claim statistics. Key Requirements: - Web Scraping: You should have prior experience in web scraping and can navigate through the website's structure to extract relevant data. - Data Extraction: The main focus will be on compiling data related to insurance claim statistics. The final deliverable should be a well-organized dataset with accurate claim statistics. Please share your experience in similar projects.
I urgently need a Python script created to scrape data from Website 1 and write it to a CSV file. The data I need to extract is specific to TVL daily total. Site: Key Requirements: - Develop a Python script for web scraping - Extract TVL daily total data from - Save the data into a CSV file Ideal Skills: - Proficient in Python programming - Experience with web scraping tools and techniques - Strong understanding of data handling, especially writing to CSV files - Good communication for timely updates on the project's progress.
I'm seeking a skilled web developer to create a financial information website with features similar to forexfactory.com. The website will be designed with a modern and minimalist aesthetic. Key features include: - Live forums page: This will allow users to engage in financial discussions, share insights, and connect with other members of the community. - Economic calendar: We need a comprehensive economic calendar that notifies users of upcoming reports, events, and indicators that may impact the financial markets. We will need to find all the sources the main information comes from and scrape them using provided API's from the government sites that they provide usually. - SEC Insider Traders Page: This is a vital component of the website. It should include: - A ...
I have a web scraper script that needs fixing. It's designed to scrape various URLs from the Apollo website. Key Requirements: - Scraper debugging: The script is currently not working properly, and needs to be fixed. - URL scraping: The script should be able to successfully pull the data from the selected URLs on Apollo website. Experience with: - Web Scraping: Previous experience in web scraping is essential, as the data needs to be pulled accurately from this specific website. - Script Debugging: Ability to identify and fix issues within an existing script. - Proficiency in Python or relevant language for web scraping. - Knowledge of Apollo website structure. Please make sure your bid includes information on how you plan to approach fixing ...
I'm seeking an experienced data extraction specialist to scrape both HTML and text files for specific data. Particulars to look for will involve the text content within these files that follows a mixed format structure so would require vast knowledge and understanding of both table format data and paragraph-style data. Key Skills and Experience Required: - Strong abilities in web scraping - Adept with HTML, text parsing - Knowledge of data formats and how to transform data - Proficient in CSV file generation. We need a comprehensive extraction that maintains the integrity and accuracy of the data. As these files do come in multiple formats, versatility and attention to detail are paramount on this project.
Înregistrează-te sau Conectează-te pentru a vedea detaliile.
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardc...company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put i...
I am looking for a freelancer to help me with a data entry project. The main task is to submit contact us forms on 1500 different websites for lead generation purposes. If you could also scrape website links according to our Keywords and Location that would be better. Requirements: - Experience in data entry and form submission - Attention to detail and accuracy - Proficiency in English language - Ability to follow instructions Key Details: - The project involves submitting contact forms on 1500 websites - I will provide specific messages to be sent through the contact forms If you have the necessary skills and are interested in this project, please submit your proposal. Thank you.
...Python expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...
I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experience with similar projects wil...
I'm searching for an expert who can assist me in generating high-quality leads and databases. The candidate should be an expert in scrapping and generating leads, as per the requirement. We are open to buying the lead list and paying for the consultation. Please apply only if you know how to generate and scrape leads in bulk and are an expert or have rich experience in it. We are looking for experts only. Budget is not a constraint for the right candidate. To ensure you have read the description, start your application with the word "Blue" to be considered. Thank you.
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
My Python script is intended to scrape specific Telegram groups, but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that
I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - pyth...
We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including ...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that demonstrate your ability in this area.
I'm in need of skilled machine learning developers with experience in SpringBoot and Scala. Your primary responsibility will be: - Training and tuning a clustering model. We are planning to apply this model for customer segmentation purposes. As such, the ideal candidate should: - Have previous experience in creating clustering models. - Understand the dynamics of customer segmentation. - Be proficient in data cleaning and preprocessing. - Have experience integrating and deploying machine learning models. You should be able to translate technical requirements into effective machine learning solutions and measure the effectiveness of the model's performance.
I have a project that requires extensive knowledge in Scala Java, focused on analyzing post metrics from social media. Responsibilities include: - Coding in Scala Java to retrieve and analyze social media post metrics - Performing data analysis in order to draw actionable insights The suitable freelancer for this job is someone with previous experience in Scala Java and data analysis, preferably involving social media data. The task requires in-depth knowledge in data sorting and categorization methods and a good understanding of social media platforms.
I'm looking for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible...link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during scraping is ...
I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler
I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the t...
I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+
I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise....
I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would like to s...
scrape data from darty site and export it into excel file.
I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.
... The ideal candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this project. Skills required: - Web scraping - Data collection - Experience w...
I'm searching for a skilled individual who can help me scrape data from a website. The data I'm interested in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages
...Developer >6 years of experience in agile development of scalable SaaS apps in the cybersecurity area: Improve our app (URL Risk assessment) Improve our app (Domain Typosquatting) Improve our project (Darknet Monitoring) Create an app "hackerview" for passive attack surfave enumeration Create an app for detecting spoofed social media profiles Create an app to scrape ransomware threat actor website and maitain stats about those sites Improve an existing app to monitor paste sites Mininmal Tech Experience: MERN, REST API (JWT), Django, Python, Github, CI/CD, Celery, Redis, Linux, Postgress, Kubernetes, Docker, Nginx, JS, HTML5, Protocols (DNS, SMTP, SSL, HTTP..).Detailed app specifications will be shared at a later stage. |--------------------------------
