Freelancer crawler developer

We are seeking a skilled freelancer to develop a Crawler AGV project. The ideal candidate will have experience in robotics and automation, with a strong understanding of mechanical design and simulation. Responsibilities include designing and testing the AGV system, ensuring its ...

The core of this project is to build an automated pipeline that can analyze how digital assets are structured and verified across various e-commerce platforms. · Key Responsibilities: · CMS-Agnostic Crawling: Build/configure a crawler (using tools like Crawl4AI, Playwright, or se ...

We are seeking a skilled developer to create scripts for getting RSS feed / website content and performing automation tasks. Sample scripts will be provided as a reference to guide the development process. The ideal candidate should have experience with web scraping and automatio ...

I'm building a reusable research tool that extracts publicly listed contact emails from a defined set of organizational websites. This is a small pilot project (fixed price $1,000) to validate the approach and produce an initial dataset. If successful, additional follow-on milest ...

We are building a grant-matching platform for African NGOs and purpose-driven organisations. We need an experienced specialist to improve our existing web crawler to extract all relevant data reliably at scale. · Review and improve an existing crawler · Strengthen deep web discov ...

Web Crawler / Data Scraper Developer (Apify) · We are seeking a skilled and reliable freelance web scraper/crawler developer to extract product data from various webshops. The scrapers will be run on Apify using Crawlee, and our technical task will involve creating scrapers for s ...

We are seeking a skilled developer to complete and polish our existing web crawler built with NestJS.The project involves refining the current setup to match our full specification ensuring seamless integration with BullMQ Redis and Postgres. · ...

We are seeking an experienced developer to help us implement measures to block affiliate link scanner tools such as Integrishield and Mfilterit. · The ideal candidate will have prior experience in link protection, affilaite marketing or adtech solutions.Web Development · HTML · P ...

The goal is: To automatically monitor appointment availability on BLS Spain and BLS Portugal · To detect instantly when new slots appear · To either notify immediately or assist in starting the booking process quicklyWeb Scraping Framework · Selenium Puppeteer Python Core PHP Lar ...

We are looking for an experienced developer to build a job aggregation platform.Build crawler-based or data-heavy systems and understands stability, monitoring and long-term maintenance. · ...

...

+Job summary · We need someone to diagnose the root cause of our website blocking AI crawlers (Claude, Google AIO) despite Cloudflare allowlist rules.+ResponsibilitiesDiagnose the root cause - Identify what's blocking specific LLLM crawlers (Claude, Google AIO) · Implement the so ...

Overtime develop a web crawler for search engine. In the beginning focus on crawling and scraping a few websites with 40 hours per week. · ...

I am looking for an experienced Python developer to help build a general-purpose website mapping crawler (or site mapper) for primary use on National Statistical Office (NSO) websites and similar large institutional sites that publish open data. · ...

We are losing a lot of traffic due to bot verification on our website when crawled by LLMs like GPT-4. A custom rule in Cloudflare was added but it's not working. · ...

+We are seeking an experienced Web Crawler and Data Engineer to develop a robust system for aggregating power outage data from various sources.The ideal candidate will have expertise in web scraping, data processing, and data storage. · ...

About Us · We are building advanced property intelligence products powered by AI, geospatial datasets and real-world asset data. Our platform ingests multiple public and proprietary data sources and transforms them into structured, standardised, usable intelligence for insurers, ...

I need to build a video website using uni-app and create a backend to manage video categories. The videos will be sourced from other websites using a crawler, and the backend should handle video links and cover images. Additionally, the system should support ad settings. · Contra ...

We are seeking a skilled freelancer to develop a web crawler that can automatically search for RFP opportunities on various websites. The ideal candidate will have experience in web development, data mining, and web crawling. The project involves creating a tool that can efficien ...

We are seeking a skilled developer to create an automated web crawler solution for an international trading company to extract company contact information to find potential clients and record their contact info in Google Sheets or other CRM software. Ideal candidates should have ...