Optimise scraper system

Only for registered members Canada

1 month ago

Default job background
$5,000 - $0 (USD) budget
I have a complex scraper system in python, scraping several sites 24/7, and many many URLs on these several sites. · It runs across multiple virtual machines. It is not set up efficiently to scale, and is very heavy on CPU usage, hence having to run it across a number of virtual ...
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Work in company Remote job

    Build Automated Nationwide Contractor Lead Scraper + Daily Email Delivery System

    Only for registered members

    I need an experienced developer to build a stable daily automated scraping system that gathers new contractor-related business leads from high-growth states. · ...

    Freelance

    3 weeks ago

  • Work in company Remote job

    Python Developer Needed for Web Scraper Integration

    Only for registered members

    We are seeking a skilled Python developer to create a web scraper that will seamlessly integrate with our existing backend system. The ideal candidate should have experience in developing scrapers that can efficiently extract and process data. Strong familiarity with Python libra ...

    $10 - $15 (USD) per hour

    1 week ago

  • Work in company Remote job

    Senior Airflow and Playwright Selenium Scraper Engineer

    Only for registered members

    We're looking for a senior engineer to help us with our scraping architecture. · Currently we are implementing airflow, · and most scrapers run as headless selenium, · playwright or direct api calls. ...

    $20 - $45 (USD) per hour

    1 month ago

  • Work in company Remote job

    Web Scraping Expert for News Aggregation

    Only for registered members

    We seek an experienced web scraping specialist to develop a scraper collecting news articles from predefined websites across multiple categories and storing them on WordPress. · ...

    1 month ago

  • Work in company Remote job

    Robust Web Scraper and Cron Job Deployment

    Only for registered members

    We are seeking a skilled freelancer to build a robust web scraper and deploy a cron job for it on our system. · ...

    $80 - $0 (USD) budget

    2 weeks ago

  • Work in company Remote job

    Python Web Scraper Setup

    Only for registered members

    We are looking for a skilled freelancer to assist with the setup and configuration of an existing Python web scraper. This role requires a solid understanding of Python, web scraping techniques and troubleshooting skills. · ...

    2 weeks ago

  • Work in company Remote job

    Experienced Web Scraping Specialist for Ticket Marketplaces

    Only for registered members

    We're looking for an experienced web scraping professional to support data collection from primary and ticket marketplaces. · This role is ideal for someone who has built and maintained reliable scrapers and values stability, accuracy and discretion. This role requires building m ...

    1 month ago

  • Work in company Remote job

    Complex Data Scraping

    Only for registered members

    We're looking for a Senior Engineer to own our property data pipeline. · Design and operate distributed scraping systems processing 300K+ records daily with 99.5%+ reliability. · Architect parallel processing pipelines with concurrent workers, intelligent rate limiting, and horiz ...

    $30 - $70 (USD) per hour

    1 month ago

  • Work in company Remote job

    Web Scraper Development for Leaderboards

    Only for registered members

    We are looking for a serious and capable person who understands real-world web scraping challenges implements practical scalable solutions focuses on reliability performance and correctness. This scraper must handle hundreds of sites per run execute in a timely predictable manner ...

    $500 - $0 (USD) budget

    1 month ago

  • Work in company Remote job

    Apify + Python Web Scraping Expert for Automated Tender Monitoring

    Only for registered members

    I'm building an automated monitoring system that scans government offices, school districts, and public organizations' noticeboards and procurement portals to identify tender-related documents and early-stage procurement opportunities. · The goal is to detect potential leads (ten ...

    $10 (USD) per hour

    2 weeks ago

  • Work in company Remote job

    Data Science

    Only for registered members

    We are looking for a strong Machine Learning Engineer / Automation Engineer who will build intelligent systems for discovering strategic auxiliary segments — additional flight segments and routes that dramatically reduce the price of premium tickets while remaining 100% compliant ...

    1 month ago

  • Work in company Remote job

    Build N8N server on AWS and automate tasks including scraping and email

    Only for registered members

    Project Overview · We currently use + Apify to scrape product data. While functional, the process is too slow for large datasets. · We need to move to a faster, scalable architecture built in N8N, capable of efficiently scraping: · -5,000 – 20,000 SKUs per batch · -Large dataset ...

    2 weeks ago

  • Work in company Remote job

    Apify + Python Web Scraping Expert for Tender Monitoring System

    Only for registered members

    I'm building an automated monitoring system that scans government offices, school districts, and public organizations' noticeboards and procurement portals to identify tender-related documents and early-stage procurement opportunities. · The goal is to detect potential leads (ten ...

    $10 - $18 (USD) per hour

    2 weeks ago

  • Work in company Remote job

    Full-Time Lead Scraper

    Only for registered members

    We're looking for a full-time lead scraper who can build and manage high-intent lead generation systems for multiple outbound campaigns. · This position requires someone who understands intent signals, segmentation, enrichment, automation, · and has experience with tools like n8n ...

    Full time

    3 weeks ago

  • Work in company Remote job

    Recruitment Operations

    Only for registered members

    You will start by fixing a messy CRM structure, move into automating our entire market mapping process, · as well as our reporting system and finally internalize our lead generation to replace a high-cost external · agency. · Phase 1: CRM Infrastructure & Data Architecture · The ...

    $8 - $25 (USD) per hour

    2 weeks ago

  • Work in company Remote job

    Automated deal-scraping engine

    Only for registered members

    Automated deal-scraping engine, scrape multiple sources, deduplicate listings and store data in a partitioned PostgreSQL database. · Technical Stack · • Language: (v20+) Non-blocking I/O · • Scraping: Playwright with playwright-stealth. · • Database: PostgreSQL (v16+) with pgvec ...

    $150 - $0 (USD) budget

    1 week ago

  • Work in company Remote job

    Python Web Scraper for Healthcare Job Listings

    Only for registered members

    We need an automated system to collect publicly available healthcare-related job postings across Australia and generate a clean weekly CSV report. · The system should scrape multiple job boards and extract listings related to healthcare roles (for example: nursing, aged care, dis ...

    $150 - $0 (USD) budget

    19 hours ago

  • Work in company Remote job

    Python Developer — Automated Event Scraper + Google Sheets CAC Decision Tool

    Only for registered members

    OVERVIEW: · We're a national field sales and brand ambassador agency operating across 33+ states. We deploy sales teams at live consumer events — home shows, festivals, trade expos, and similar — on behalf of our brand clients. Right now, finding and vetting events is entirely ma ...

    $1,000 - $0 (USD) budget

    1 day ago

  • Work in company Remote job

    Linux Web Scraper Development

    Only for registered members

    We are seeking a skilled freelancer to develop a web scraper that can automatically fill fields in a Linux environment with a pyton script without using a browser. The scraper should be able to handle picture captchas effectively. The ideal candidate will have experience in web s ...

    $60 - $0 (USD) budget

    1 week ago

  • Work in company Remote job

    CRM Automation and Integration Specialist

    Only for registered members

    This freelancer will organize and enhance my Follow-up Boss CRM by cleaning up current automations integrating with SMS systems via Zapier connecting web scrapers to CRM and integrating Blooio/Send Blue texting platform. · Cleaning up current automations. · Integrating with SMS s ...

    $20 - $80 (USD) per hour

    1 month ago