Our website returns bot verification when crawled by LLMs

+Job summary · We need someone to diagnose the root cause of our website blocking AI crawlers (Claude, Google AIO) despite Cloudflare allowlist rules.+ResponsibilitiesDiagnose the root cause - Identify what's blocking specific LLLM crawlers (Claude, Google AIO) · Implement the so ...

NDA will be required to move forward. · *ROLE · Python / AI Data Engineer — Web Crawling + LLM Structured Extraction (1,000+ domains, 383-column Excel output) · *ABOUT · We're an early-stage startup building an internal "company intelligence" dataset that powers a comparison prod ...

I need a developer that is great at scraping/extracting data from a website in an organized manner for the purpose of LLM fine tuning · ...

We are building an AI-first SEO + Answer Engine Optimization (AEO) system designed to rank not only on Google, but inside ChatGPT. This is not traditional SEO. · ...

We are seeking an experienced QA Automation Engineer to test our AI-powered web crawling system and perform LLM analysis at scale. · Create and maintain test scripts · Ensure high quality and performance of our web crawling and screenshot capture capabilities · ...

Data Scraper for job descriptions and roles needed. · PythonAi DevelopmentFastAPIDjango ...

We're looking for an experienced SEO specialist to set up and optimize our B2B SaaS website from the ground up. · Our site has not yet been crawled or indexed by any search engine or AI platform—we need someone to handle the complete A-Z setup and ongoing optimization for both tr ...

+Need an experienced technical SEO specialist to diagnose and resolve indexation issues on our site. · Deep dive into Search Console data to identify why 532k crawled pages aren't indexing · Content quality audit to determine if pages should be improved, consolidated, or removed ...

We are seeking an experienced Data Engineer & Web Crawling Expert to build a modern scalable data collection system. · - Develop custom scrapers using Crawl4AI to extract structured data (JSON/Markdown) optimized for LLMs. · - Implement advanced extraction strategies (Pydantic s ...

Need an experienced technical SEO specialist to diagnose and resolve indexation issues on our site. · ...

We are seeking a skilled developer/SEO engineer to address indexing issues. The ideal candidate will have experience with Google Search Console. · Experience with Google Search Console · ...

We are looking for an experienced engineer to design and implement a highly scalable solution for extracting structured data from large language model interfaces. · ...

The Shopify Technical SEO Specialist is responsible for optimizing Shopify websites to achieve maximum organic visibility, AI/LLM search readiness, and indexing accuracy.This role combines deep e-commerce SEO knowledge with targeted technical expertise ensuring the store is struc ...

+I'm looking for an experienced n8n Automation Engineer to set up an AI-enabled workflow for real estate dealflow. · +Crawl/scrape specified broker/agent websites (HTTP Request + optional Playwright) · Extract & normalize property listings · ...

This evaluation is best suited for practitioners who actively think about how LLMs interpret and summarize content. They have experimented with AI-driven search, answer engines, or generative discovery. · ...

We are moving past traditional SaaS by deploying AI agents to solve the high-friction problem of material sourcing and supplier discovery. · Agentic Infrastructure: Design and implement autonomous agents that can research, crawl, and synthesize complex technical specifications wi ...

We are building a B2B SaaS web platform to automate the retrieval and intelligent processing of specific documents from several property management extranets. · ...

Looking to build agent who can proactively take down fake/duplicate profiles from all the tech platforms which are publicly available. · ...

We are looking for an experienced SEO Specialist who can help improve our website rankings, organic traffic, and overall search visibility. · This is a long-term opportunity for someone who understands modern SEO including On-Page SEO, Technical SEO, Content Optimization, and SEO ...

Looking for a technically strong scraping / automation expert to help set up a scalable, long‑running pipeline that extracts product titles, categories and SEO keywords from , orchestrated via an AI/browser automation layer. · ...