Vibe Coding Web Scraping Expert (Freelance) at Mindrift in Remote

Summary: Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project and drive specialized data scraping workflows within their hybrid AI + human system. In this freelance role, you will manage end-to-end data extraction workflows, ensuring accuracy and reliable delivery of structured datasets while collaborating with Tendem Agents. Responsibilities: - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes Required Qualifications: - At least 1 year of relevant experience in data analysis, AI automation, data engineering, or software development - Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields - Python web scraping: Build reliable scraping scripts using BeautifulSoup, Selenium (or equivalents) for multi-level sites, dynamic JS content (infinite scroll, AJAX), and API endpoints via provided proxy - Data extraction expertise: Navigate complex hierarchical structures (regions → companies → details), handling archived pages and varied HTML formats - Data processing: Clean, normalize, and validate scraped data; deliver high-quality datasets in well-structured formats (CSV, JSON, Google Sheets) with clear, consistent presentation - Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving - Strong attention to detail and commitment to data accuracy - Self-directed work ethic with ability to troubleshoot independently - English proficiency: Upper-intermediate (B2) or above Required Skills: Python web scraping, Data extraction expertise, Data processing Important Skills: Hands-on experience with LLMs, Attention to detail Nice-to-Have Skills: English proficiency, Self-directed work ethic Benefits: Work fully remote on your own schedule, Participate in performance-based bonus programs that reward high-quality work and consistent delivery.