Informatica powercenter etl jobs
...the next recommended sales action. ### 5. AI Agents & Future Integrations The platform should eventually support: - Scheduled intelligence collection. - AI-assisted research workflows. - CRM integrations. - Sales reporting. - MCP server integrations where useful. - Automated business opportunity alerts. ## Preferred Technical Skills **Essential:** - Python - PostgreSQL - Data engineering and ETL pipelines - Web data extraction using appropriate tools such as Scrapy or Playwright - API development using FastAPI or similar - Data cleaning, matching, deduplication and validation - Full-stack dashboard development - Production deployment and documentation **Preferred:** - LLM integrations: Claude, OpenAI or Gemini - LangGraph or similar workflow orchestration - RAG and Graph...
...rate-limiting, and error/exception handling under heavy workloads. • Deep knowledge of document classification, layout analysis, OCR engines, and prompt engineering/GPT-based LLMs for structured metadata extraction from complex PDFs, tables, and scanned reports. 2. Data Quality, Enterprise Loading & Upstream Domain • Advanced Python and SQL skills for large-scale data transformation, automated ETL/ELT pipelines, and data validation. • Comprehensive understanding of document taxonomy, metadata standards, and end-to-end data lineage (page-level source attribution). • Experience with PostgreSQL, Microsoft SQL Server, or enterprise search datastores. • Experience preparing verified result packages for integration and loading into target enterprise r...
...pipelines and ingestion tooling for enterprise well data models. Mandatory requirements: 1. Data Engineering, ETL & Drilling Operations • Bachelor’s degree in Computer Science, Data Science, Software Engineering, Petroleum Engineering, or related field. • At least 5 years of data engineering or data science experience, including 3+ years processing unstructured or semi-structured technical documents. • Upstream Oil & Gas domain knowledge: Daily Drilling Reports (DDRs), drilling technical documents, BHA/casing/mud data, and well operations. • Hands-on familiarity with industry-standard well engineering data models and well management databases (strongly preferred). • Advanced Python for ETL/ELT pipeline design, data manipulation,...
We are an EV DC fast charger manufacturer seeking an experienced EPLAN Pro Panel / Electrical Design Engineer with proven experience designing DC fast EV chargers for the US market, specifically for UL/ETL (NRTL) certification requirements. Our objective is to develop and optimize the complete electrical design, internal component layout, wiring and mechanical mounting arrangements of our 120–400 kW DC fast chargers to support successful UL/ETL certification in the United States. Scope of Work Electrical Design: Develop or revise electrical schematics, wiring diagrams, protection circuits and power distribution arrangements using EPLAN Electric P8. 3D Cabinet Design: Create or update detailed EPLAN Pro Panel 3D layouts showing exact component locations, dimensions a...
Key Responsibilities Report & Dashboard Design: Build clear, interactive visualizations, graphs, and reports using Power BI Desktop. Data Preparation (ETL): Extract, clean, and transform raw data from various sources (SQL, Excel, cloud services) using Power Query. Data Modeling: Create scalable data models, relationships, and hierarchies. DAX Development: Write custom DAX (Data Analysis Expressions) queries and calculations for advanced metrics. Performance Tuning: Optimize slow-running reports, data models, and underlying SQL queries. Stakeholder Collaboration: Meet with business teams to translate needs into technical reporting specifications. Required Skills Technical Tools: Proficiency in Power BI Service, Power BI Desktop, Power Query, and DAX Studio. Database Knowledge: ...
I’m working with a Microsoft SQL Server database that holds our raw operational records, and I need those tables pulled out, cleaned for data quality, and then re-loaded in a form that is immediately useful for downstream machine-learning and analytical work. Your mission is to build a repeatable ETL workflow that: • Extracts the source data directly from SQL Server with efficient, well-structured queries. • Applies thorough cleaning: deduplication, missing-value handling, type standardisation, outlier checks, and consistent naming so that the dataset meets common ML requirements. • Loads the refined data back into a staging database or delivers it as flat files (CSV, Parquet, etc.) ready to drop into my analytics notebooks. I’m comfortable working ...
...against the TRAX source tables • Designing clear source-to-target mappings for the new platform • Building an ETL routine (your choice of tooling, as long as it can be automated and version-controlled) • Running a trial load, then validating and reconciling counts and key attributes between source and target I will supply schema information, sample data, and secure VPN access to both databases. A short findings report summarising load results and any data quality issues will complete the proof of concept. If this phase goes smoothly, there is significant follow-on work to migrate the remaining fleet and additional data domains. Prior work with TRAX, Strong Oracle SQL and hands-on ETL development experience are must-haves; TRAX or other aviation MRO d...
I need an experienced Informatica PowerCenter developer to dive into one specific folder of mappings in our repository, break down every transformation, and explain exactly how each source field becomes its target value. That means capturing look-ups, filters, joins, default values—the full story, field by field. I will grant read-only access to the repository (or export XML if you prefer) plus any existing spec sheets so you can trace the logic. You may pull additional metadata through the XML export or the Repository Manager as needed; the goal is to translate that technical detail into clear, human-readable documentation and an easy-to-follow visual flow. Deliverables • Source-to-target mapping document for the selected folder, showing field lineage and tr...
... others inside accounting software, and a few tucked away in different databases. Manually copying figures across systems is slow and error-prone, so I’m looking for someone who can design and execute a repeatable consolidation process. Your task is to: • Identify every current data source and map each field to a unified structure. • Build or script the extraction and transformation steps (ETL) so data flows automatically into a single repository—Excel, SQL, Power BI, or a tool you recommend. • Validate totals and subtotals to be sure the consolidated ledger ties back to the original sources. • Deliver clear documentation so I can rerun or expand the process without starting from scratch. Success means I end up with one up-to-date dataset...
I have a sizeable batch of raw text files that need to live in a structured database so they can be queried and analysed down the line. The core of the job is to design and execute a clean import process: parse the text, map the relevant fields, then load everything into a well-organised schema. I’m flexible on technolog...me to maintain or rerun if the dataset grows. A simple command-line or Python script that: • reads the source files from a given folder, • validates and normalises the content, • inserts the records without duplicates, • logs any errors for review will be perfect. A concise read-me explaining how to configure and execute the import rounds out the deliverable. If you’ve handled similar ETL work before and can turn this arou...
...scripts that handle data cleaning, aggregation, and visualization. Line graphs will be the primary visual, so please design them to update dynamically when new data is dropped into the source folder. If you believe an additional chart type would clarify the story, feel free to suggest it, but keep the focus on clean, insightful line-based views. Key deliverables • Fully commented Python code for ETL, analysis, and visualization • An interactive dashboard that responds to filters for month, region, and customer segment • Clear documentation explaining how to refresh the data and extend the analysis Acceptance criteria 1. All metrics (sales totals, profit margins, rankings) recompute correctly when the dataset is replaced. 2. Filters work smoothly with ...
**Project Title: Python Data Mapping and Data Transformation Automation** I am looking for a Python developer to build a data mapping and transformation solution that can read data from CSV, Excel, JSON, or SQL sources, map source fields to target fields, transform data according to predefined business rules, and generate clean output files or load the results into a database. ...reports. - Write reusable, well-documented, and maintainable code. **Expected Deliverables:** - Complete Python source code. - Configurable source-to-target mapping rules. - Sample input and output files. - Data validation and error-handling logic. - Setup instructions and documentation. Please share your approach, estimated delivery time, and relevant experience with Python, Pandas, SQL, and ETL/data en...
...cent lands in the right place before we go live. You will design and document the mapping logic, build the ETL pipelines, and work side-by-side with our Portuguese-speaking finance and IT teams to validate each rule. Once the pipelines run, I’ll look to you to reconcile GL balances, customer positions, and every subsidiary ledger until we hit 100 % accuracy. Mock migration cycles are already planned by the wider programme team; your outputs must plug straight into those rehearsals so the data track never becomes the bottleneck. Our target stack is a modern relational database (SQL-based), so advanced SQL scripting, performance-tuning skills, and hands-on experience with enterprise ETL tools are essential. Prior work inside regulated banking environments—esp...
...SQL Integration: Querying your database directly or building automated ETL pipelines (using SQL/Python) for seamless data refreshes. • Robust Data Modeling: Building clean Star Schema models with well-structured, optimized DAX measures. • Executive & Drillable Dashboards: Designing clean, intuitive visual layouts with revenue trends, conversion funnels, AOV (Average Order Value), and region/product filters. • Interactive UX Features: Adding custom Tooltips, Drill-Throughs, and Bookmark navigations for non-technical leadership. • Cross-Device Optimization: Fully responsive dashboard layouts tailored for both Desktop and Mobile views. Deliverables: - Fully functional Power BI (.pbix) file. - Clean SQL scripts / Python ETL scripts used for integration...
I manage a product team that logs every engineering and analytics task as a Jira ticket. I need a reliable specialist who can step in on a ticket-by-ticket basis and close work related to both AWS data engineering and Power BI dashboard development. On the AWS side the tickets you will pick up revolve around building or extending data pipelines and handling the transformation / ETL layers that feed our analytics stack. Expect hands-on work with typical services—think S3, Glue, Lambda, Redshift or Athena—and plenty of Python or SQL scripting to keep things automated and testable. Once the data is landed, many tickets jump straight into Power BI. Your focus there will be on stitching new data sources into existing models and turning those datasets into polished, well-doc...
This project centers on designing, building, and maintaining production-grade data pipelines that move and transform large volumes of structured data. I’ll rely on your expertise in SQL, Python, and modern ETL orchestration to collect, process, and serve datasets reliably, while enforcing rigorous data quality and governance standards. Infrastructure expectations • Cloud: the core deployment targets are AWS and Google Cloud Platform, so solutions should align with services such as S3, RDS, Lambda, BigQuery Storage API, or similar offerings on those clouds. • Warehouse layer: Snowflake will be the single source of truth; pipelines need to load, model, and optimize data within that environment. • Workflow optimisation: automated monitoring, logging, and alert...
Project Title: Informatica IDMC/CDI Oracle Cloud ERP Data Migration – Technical Job Support I am looking for an experienced Informatica IDMC/IICS CDI professional to provide hands-on technical guidance and job support for an Oracle Cloud ERP data migration project. Required Skills: - Strong experience in Informatica IDMC/IICS Cloud Data Integration (CDI). - Creating and troubleshooting mappings, mapping tasks, and taskflows. - Strong Oracle SQL and PL/SQL knowledge. - Experience with Oracle EBS 11i/R12 and Oracle Fusion Cloud ERP. - FBDI file generation and data migration. - Data validation, reconciliation, error handling, and troubleshooting. - Experience migrating data from legacy ERP systems to Oracle Cloud ERP. Expected Support: - Practical, hands-on tec...
I need a freelancer to extract all data from QuickBooks Online and populate an easy to access relational database for Microsoft PowerBI use. The Freelancer will need to establish a process that pulls QBO data at recuring intervals or establish a live connection QuickBooks and writes to th...or establish a live connection QuickBooks and writes to the database, create the database storage system, and train the contractor on maintaining the system. Required Data: - Sales and Invoices - Expenses and Purchases - Inventory - Customer and Vendor Information The ideal candidate should have expertise in: - QuickBooks Online - Relational databases - Microsoft PowerBI - Data integration and ETL processes Please include examples of similar work and ensure you have the necessary skills and e...
...government, infrastructure, or enterprise GIS projects and can demonstrate relevant technical experience through completed projects and professional references. Relevant Experience Esri ArcGIS Enterprise, ArcGIS Server, and ArcGIS Pro WebGIS application development and GIS system integration GIS architecture, administration, and technical consulting Safe Software FME Form / FME Flow and spatial ETL workflows VertiGIS / Geocortex Essentials or comparable WebGIS platforms SQL Server, SSIS, spatial databases, and data management Python scripting, GIS automation, and data transformation GIS governance, spatial data quality, and metadata management Experience across all technologies is not mandatory, but candidates should have substantial professional experience in at least ...
...third-party data feeds/datasets, we would love to collaborate with you. Key Responsibilities Database Design & Construction: Design, build, and optimize scalable relational/non relational database architectures tailored to our operational needs. Big Data Procurement & Sourcing: Identify, evaluate, negotiate, and acquire relevant external datasets and third-party data providers. ETL & Data Pipeline Setup: Establish efficient ETL pipelines, data ingestion flows, and automated validation scripts to integrate procured datasets. Data Quality & Compliance: Implement data governance, cleaning processes, and ensure compliance with relevant data privacy/licensing laws (e.g., GDPR, CCPA). Technical Documentation & Advisory: Provide recommendations on technology s...
...mentoring to help me develop practical, job-ready AWS Data Engineering skills. **Looking for someone who:** - Has **real-time/production experience as an AWS Data Engineer** - Has hands-on experience **building, deploying, and maintaining data pipelines on AWS** - Has worked with services such as **S3, Glue, Redshift, Athena, Lambda, Kinesis, EMR, and Step Functions** - Can teach **Python/PySpark, SQL, ETL/ELT, data lakes, and data warehouses** - Can explain **real-world production workflows, pipeline architecture, and best practices** - Can guide me through hands-on work and practical scenarios **Format:** 1:1 video sessions, weekly or biweekly **Duration:** Long-term; open to a trial session first **Important:** I’m specifically looking for someone with **actual real...
...changes land reliably with minimal iteration. - Deliver within regulatory controls, and propose ways to speed up delivery without weakening them. - Build security in by default: secure coding, threat modelling, dependency and secrets management, and AI workflows that protect data and the supply chain. - Run services on AWS (ECS/EKS) with GitHub for source control and CI. - Handle data analysis, ETL and data QA, supported by AI tooling. What we're looking for - Strong full-SDLC engineering track record, with hands-on experience in at least two of Ruby, Node and Go, and good frontend skills. - Demonstrable evidence of moving your own workflow to AI-driven delivery, with a concrete example of AI-assisted refactoring in a legacy monolith and the judgement to know where AI helps...
I need a hands-free SQL workflow that runs every 24 hours and reliably moves raw data all the way through extraction, transformation, and loading so it is analytics-ready each morning. I have not locked myself into a single platform yet, so whether you prefer MySQL, PostgreSQL, or Microsoft SQL Server, please build with portability in mind and note any engine-specific features you use. Robust logging, error handling, and clear configuration (no hard-coded secrets) are essential because I want to monitor runs without hovering over them. Deliverables • Code or stored procedures that handle: – Data extraction – Data transformation – Data loading • A scheduler setup (native DB agent, cron, Task Scheduler, or similar) that triggers the pipeline dai...
...automation solution that connects directly to my SQL databases, extracts the required tables on a schedule, transforms the data to a clean analytics-ready format, and deposits the results into a target store I can easily query or feed into BI dashboards. Here is what I’m expecting: • Connection and authentication set-up for multiple SQL instances (mostly PostgreSQL and MySQL). • A repeatable ETL/ELT pipeline written in Python, SQL scripts, or a modern orchestration tool such as Airflow, Prefect, or dbt—whichever you’re most comfortable with. • Parameter-driven jobs so I can adjust table lists, filters, or load frequency without touching the code. • Logging, basic alerting, and clear documentation so future maintenance is straightforw...
...need a reliable specialist to move our existing dataset—about 1 GB to 10 GB—into a fresh PostgreSQL instance. I will share full access to the current environment and a clear mapping of every table and field; your job is to extract the data, load it into PostgreSQL, and confirm that counts and formats match what we expect. You may script the transfer with psql, pg_dump/pg_restore, or your preferred ETL tool so long as the process is repeatable and can be documented. When the run is complete, I want a concise hand-off package that includes: • the migration script(s) • a short README explaining how to execute them • a verification log that shows row counts before and after the move If any edge cases appear—encoding issues, constraint conflicts...
...and Workday data into Xactly, perform field-level validation with SQL, and expose a handful of downstream reports for Finance and Sales Ops. Here is how I see the work unfolding: • Configuration & Mapping – review our current Incent setup, document the source-to-target mappings, and build any new Connect tables or jobs needed to pull data from Salesforce, Workday, and a small NetSuite feed. • ETL Development – create or update the Connect pipelines, including any incremental logic, error handling, and scheduling. • Validation – write the SQL checks so we can reconcile counts, amounts, and key fields before and after each load. • Reporting – stand up a core set of compensation and exception reports that the team can run witho...
...period : Immediate About the Role We are seeking a highly skilled Data Engineer to join our onsite team. In this role, you will design, build, and optimize complex, highly scalable big data pipelines and infrastructure on AWS to support advanced regulatory analytics, surveillance systems, and market research. Key Responsibilities Pipeline Development: Design, develop, and maintain high-performance ETL/ELT data pipelines capable of ingesting and transforming massive volumes of structured and unstructured financial data. Big Data Processing: Utilize PySpark, Apache Spark, and AWS EMR to process billions of records efficiently, ensuring low latency and high reliability. Cloud Architecture: Architect and optimize solutions within FINRA’s AWS data lake and data warehousing en...
We are seeking a highly skilled Data Engineer to join our onsite team. In this role, you will design, build, and optimize complex, highly scalable big data pipelines and infrastructure on AWS to support advanced regulatory analytics, surveillance systems, and market research. Key Responsibilities Pipeline Development: Design, develop, and maintain high-performance ETL/ELT data pipelines capable of ingesting and transforming massive volumes of structured and unstructured financial data. Big Data Processing: Utilize PySpark, Apache Spark, and AWS EMR to process billions of records efficiently, ensuring low latency and high reliability. Cloud Architecture: Architect and optimize solutions within FINRA’s AWS data lake and data warehousing environment (S3, Athena, Glue, Snowflake...
Finance Systems AI Engineer Focused on building AI-powered automation and intelligent workflows within Strategic Finance and Financial Systems. Key Requirements: Strong understanding of financial workflows such as forecasting, reporting, variance analysis, and close processes Experience with automation, ETL workflows, reporting tools, and system integrations Exposure to AI, data transformation, or intelligent automation initiatives is highly valued Ability to work cross-functionally with Finance, Financial Systems, and technical teams Opportunity to work on next-generation AI-driven finance solutions in a highly impactful environment.
I have an existing ETL workflow that moves data from SQL Server through Talend into downstream tables. Extraction and loading are stable; the transformation layer is where I need focused help. Using Talend as the primary tool, I want to tighten up three areas: • Data cleaning – removing duplicates, fixing malformed values, standardising dates and numeric fields directly inside Talend components. • Data mapping – aligning source columns to a new schema, building look-ups, and handling slowly changing dimensions so the target tables receive correctly typed and formatted data. • Data enrichment – pulling in reference datasets, adding calculated fields, and appending meta-information during the transformation stage before the load runs. SSMS is ava...
...capabilities to perform semantic search using embeddings, metadata filtering, and Top-K retrieval techniques. • Created metadata-driven search filters using application, environment, severity, and support-group attributes to improve answer accuracy. • Developed conversational AI prompts and prompt templates for support workflows, troubleshooting guidance, and knowledge retrieval. • Built Python-based ETL pipelines to ingest documents from SharePoint, knowledge repositories, CSV files, and operational databases. • Developed automation workflows using n8n to orchestrate document ingestion, embedding generation, notification workflows, and incident enrichment processes. • Created multi-step AI workflows integrating retrieval, reasoning, recommendation genera...
I am looking for someone who knows Informatica Intelligent Cloud Services, specifically the Cloud Application Integration module, to build an application-level integration for me. The core of the job is to take a deeply nested JSON payload, walk through every level, pick only the columns I specify, and loop through the structure so the data can be handed off cleanly to downstream services. Here is what I need you to deliver: • An IICS CAI process (or set of processes) that accepts the incoming JSON, iterates through all nested arrays/objects, and produces a flattened or re-nested structure containing only the required fields. • Parameterisation so I can change field selections without redeploying the whole flow. • Error handling and logging inside CAI so malform...
I want a dynamic Tableau dashboard that pulls live financial data directly from our SQL database and turns it into clear, decision-ready visuals. Once connected, the workbook should automatically refresh, highlight key metrics such as revenue, expenses, cash flow, and profit margins, and allow simple drill-downs by period, business unit, and region. Prefer Tableau’s native SQL connector so no ETL layer is required; any calculated fields or parameter controls you create need to run efficiently on the data source itself. The final dashboard must be neatly formatted for both desktop and tablet viewing, with intuitive filters and tooltips so non-technical stakeholders can explore the numbers without guidance. Deliverables • Tableau workbook (.twbx) linked to the SQL instanc...
...time-series extraction for indices like EVI and LSWI. Cloud Storage Optimization: Manage and pipe processed raster assets from GEE directly into Cloud Object Storage buckets (AWS S3 / Google Cloud Storage), formatting files into cloud-native formats like Cloud-Optimized GeoTIFFs (COGs), Parquet, or Pipeline Execution: Orchestrate end-to-end pipelines that extract, transform, and load (ETL) data from cloud buckets into the VPRM environment for Net Ecosystem Exchange (NEE) calculations. Core Required Skills Prerequisite Terrestrial Biosphere Modeling: Strong theoretical and applied understanding of the Vegetation Photosynthesis and Respiration Model (VPRM). Deep familiarity with the pyVPRM framework or legacy MODIS-based VPRM preprocessors is required. Google Earth Engine (GEE)...
...Engineer – Pune I am looking for a hands-on Azure Data Engineer for a personal project in Pune. This is a part-time, on-site/in-person opportunity. The selected freelancer will work directly with me for approximately 5 hours per day. Required Skills: • Azure Databricks • PySpark / Python • Strong SQL / SQL Server • Azure Data Factory (ADF) • Azure Data Lake Storage Gen2 (ADLS Gen2) • Delta Lake • ETL/ELT • Historical and incremental data processing • Delta MERGE / Upsert • JSON and nested JSON processing • Data transformation and deduplication • Source-to-target data validation and reconciliation • Basic Spark/Databricks performance optimization Healthcare or Insurance domain experience is preferred. Experi...
...data ingestion, transformation, validation, and processing using Microsoft Azure services. The project involves working with structured and semi-structured data, including healthcare/insurance-related data. Required Technical Skills - Azure Databricks - PySpark / Python - Strong SQL / SQL Server - Azure Data Factory (ADF) - Azure Data Lake Storage Gen2 (ADLS Gen2) - Delta Lake - Databricks SQL - ETL / ELT development - Incremental and historical data processing - Delta MERGE / Upsert operations - JSON parsing and nested JSON handling - Data deduplication - Data validation and source-to-target reconciliation - Performance optimization in Databricks - Git / basic CI-CD knowledge Preferred Domain Experience Experience in any of the following is preferred: - Healthcare - Insura...
... classify them, and draft responses; – forecast commodity or land prices using historical data and current feeds; – generate weekly executive summaries in natural language; – flag anomalies (price spikes, schedule overruns) and propose corrective actions. Deliverables 1. Deployed cloud application with role-based dashboards for both business lines. 2. Documented data integrations and ETL scripts. 3. Library of AI agents with clear prompts, model specs, and retraining instructions. 4. Admin guide plus a recorded hand-off session. Acceptance criteria: every listed role must be able to log in with the right permissions, see real-time data from all three source types, and interact with at least five functioning AI agents that pass a live demo using o...
...layouts. Here is how I picture the engagement: • Audit & field mapping – review current exports, confirm objects, design the mapping sheet, identify the custom fields to be built. • Salesforce configuration – create the agreed custom fields, adjust page layouts, and prepare a clean sandbox or production org for import. • Data migration – use Data Loader, Data Import Wizard, or an equivalent ETL tool to bring across customers, related opportunities, activities, and support records in the right order to preserve lookups. • Validation & clean-up – spot check critical records, run duplicate rules, and provide a summary report showing record counts before and after. • Handover – short walkthrough (video call or...
...Complete Consistent Reliable Timely Relevant Unit 12: Data Governance Data governance is the management of data availability, usability, integrity, and security. Components Policies Standards Compliance Data ownership Monitoring Unit 13: Data Warehouse A data warehouse stores large amounts of historical data for analysis. Features Subject-oriented Integrated Time-variant Non-volatile Unit 14: ETL Process ETL stands for: Extract – Collect data Transform – Clean and convert data Load – Store data in the warehouse Unit 15: Big Data Big Data refers to very large datasets that traditional databases cannot process efficiently. 5 Vs of Big Data Volume Velocity Variety Veracity Value Unit 16: Cloud Database A cloud database is hosted on cloud servers and...
I have several data sources that need to be brought together into one con...Your task is to design and build this joining process. I’m open to whatever stack you feel is most efficient—Python (pandas, SQLAlchemy), SQL procedures, an ETL tool, or a lightweight integration written in another language—as long as it can be repeated on demand and run on a modest cloud instance. The final dataset should be easy for me to export or consume programmatically. Deliverables: • Source code or ETL job definition • Clear instructions for installation and re-running the join • A short walkthrough (video or screenshare) showing the pipeline in action Please highlight any previous projects where you built data-joining or ETL pipelines, and note ...
Audit an existing Python ETL pipeline running on an Ubuntu DigitalOcean droplet extracting public registry records (Lis Pendens, Deeds, Liens) and loading to Supabase/PostgreSQL. Milestone 1 ($50): Review current code/cron setup, verify upsert/deduplication logic, and build/test Pinellas County ingestion. Milestone 2 ($75): Build and deploy Pasco County data extraction and Supabase ingestion. Milestone 3 ($75): Build and deploy Orange County integration, verify daily cron jobs, and validate data integrity. Require strong Python, session/pagination handling, PostgreSQL composite key upserts, and Linux VPS management. Bids must start with the word "PIPELINE" to confirm full review of requirements.
...production deployment. Platform Overview The platform is an enterprise data intelligence application that integrates data from customer business systems, processes and standardises it into a canonical data model, and provides management dashboards, analytics and AI-assisted querying. The intended stack includes: * React / TypeScript frontend * Node.js / TypeScript backend * PostgreSQL * REST APIs * ETL/data-processing pipelines * Docker * Kubernetes/Helm for production deployment * Authentication and RBAC * Monitoring, logging and auditability * Local/private deployment within customer environments A key architectural principle is one configurable product codebase, rather than separate custom versions for individual customers. Scope of Engagement The selected developer wil...
...Candidates without formal certification are encouraged to apply if they have substantial experience developing with the Zoho ecosystem. Relevant experience includes: Zoho Recruit API Zoho CRM API Zoho Books API Zoho OAuth/API authentication Zoho custom modules and fields Zoho record relationships Zoho attachments/files Deluge Supabase PostgreSQL SQL REST APIs Backend development Database migrations ETL/data pipelines Authentication and authorization Production system maintenance Experience with ATS platforms, recruitment systems, HR software, or job portals would also be helpful. When Applying Please include: Your experience working with Zoho Recruit, Zoho CRM, or Zoho One Examples of projects where you worked directly with Zoho APIs or Deluge Any Zoho certifications or Par...
...learning classification models to enhance anomalous behavior detection. • Achieved 88% accuracy in identifying high-risk taxpayers through advanced predictive modeling. • Developed a scalable analytics pipeline using PySpark for distributed data processing and an interactive Streamlit dashboard with 7 analytical views with KPIs, Tables and Graphs for real-time compliance monitoring. Built an end-to-end ETL data analytics pipeline with 500K+ transaction records for customer purchasing insights. • Preprocessed the dataset, performed an 80/20 train-test split, and conducted EDA and feature engineering. • Designed customer segmentation ML models using RFM analysis to classify users into 3 behavioral groups. • Improved decision-making and strategic planning by...
...NumPy. Made an automated ETL/data preprocessing pipeline to take care of data cleaning, changing data making it all the same and checking if it is all the same. Added a PostgreSQL (Neon) database to keep data in a good way and help with machine learning work. Did analysis of the data. Looked at the features to find what helps predict salary. Trained a Random Forest regression model to guess salaries. Found that employee_residence is one of the things to use for guessing salaries. Built a FastAPI backend with places to get analytics and predictions. Linked the machine learning backend to a React frontend to show information and results in a way. Technologies: Python, Pandas, NumPy, Scikit-learn, Random Forest, PostgreSQL, Neon, FastAPI, React, ETL. This...
I need an exp...SQL database after applying several transformations. The raw worksheet contains multiple sheets of mixed data types, so before anything is loaded I’ll need column mapping, type casting, and a few calculated fields added (we can review the exact logic together). Once the transformation rules are approved, please import everything into the live SQL instance and provide: • A repeatable script or ETL package (Python, SSIS, or similar) • A short README explaining how to rerun the job and tweak the mappings • Verification that every record landed in the correct table with accurate data types and relationships I’ll supply the sample XLS, the current SQL schema, and the transformation notes as soon as we start. Looking forward to a smoo...
...can also grant read-only access to the underlying SQL database if a live connection is preferable. Once the data model is clean, I’d like a series of drill-through dashboards that let stakeholders slice performance by region, product line, and individual rep, complete with trend indicators and shareable links. Deliverables • A tidy, well-documented data model (joins, calculated fields, and any ETL scripts) • One core “Efficiency Snapshot” dashboard plus supporting views for deeper dives • A short video or live walkthrough so the team can maintain and extend the visuals I’ll handle deployment; you focus on insight-rich design, clear labeling, and responsive performance. Let me know which tool you’ll lean on first and how quick...
AI-Powered Sales & Operations Reporting System with Automated ETL Pipeline and Power BI Dashboard We are looking for an experienced Data Analytics & Automation Developer to build a fully automated reporting solution that consolidates business data from multiple sources into a centralized Power BI dashboard. Project Overview: Our company currently relies on several disconnected systems including Excel reports, SQL databases, CRM exports, and online APIs. Reporting is manual, time-consuming, and prone to errors. We require an automated data pipeline that extracts, cleans, validates, and combines data into a single reporting database while providing executive-level Power BI dashboards with real-time KPIs. The selected freelancer will be responsible for designing and implemen...