Senior Python Data Scraping Engineer (Freelance)

About This Opportunity

Our talent team is representing a confidential technology client seeking a Senior Python Data Scraping Engineer for a specialized freelance engagement in Japan. This remote, part-time role focuses on building and maintaining complex web scraping workflows that deliver production-quality datasets for real-world applications.

As the recruiter managing this search, we're looking for seasoned data engineering professionals who can own end-to-end extraction pipelines, handle anti-bot mechanisms, and ensure data accuracy at scale.

Responsibilities

• Design and execute complete data extraction workflows across complex websites, ensuring comprehensive coverage and reliable delivery of structured datasets
• Build custom scraping solutions and leverage available tools to accelerate data collection, validation, and task execution while meeting defined requirements
• Extract data from dynamic and interactive web sources, adapting approaches to handle JavaScript-rendered content and evolving site structures
• Implement data quality controls through validation checks, cross-source consistency verification, formatting compliance, and systematic pre-delivery review
• Scale operations for large datasets using efficient batching or parallelization techniques, monitor failures, and maintain stability against site structure changes

What We're Looking For

Required Experience:

• 5+ years of relevant experience in data engineering, web scraping, automation, or software development
• Strong proficiency in Python web scraping using BeautifulSoup, Selenium, or similar libraries
• Demonstrated ability to extract data from dynamic content including JavaScript, AJAX, and infinite scroll implementations
• Proven experience working with complex data structures including hierarchies, archived pages, and inconsistent HTML
• Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or similar formats

Technical Requirements:

• Experience handling anti-bot mechanisms and dynamic site structures at scale
• Hands-on experience with cloud infrastructure (AWS or equivalent) and containerization using Docker
• Practical experience with LLM frameworks such as LangChain, OpenRouter, or similar tools applied to automation tasks
• Strong attention to detail and commitment to data accuracy
• Self-directed work ethic with ability to troubleshoot independently
• English proficiency at Upper-Intermediate (B2) level or above

Preferred:

• Bachelor's or Master's degree in Engineering, Applied Mathematics, Computer Science, or related technical field
• GitHub portfolio demonstrating relevant work

Time Commitment: This freelance role requires approximately 10–20 hours per week during active project phases. This is an estimate based on project requirements and not a guaranteed workload.

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will conduct an initial screening to assess your technical background and project fit. Qualified candidates will then be submitted to our client for consideration. Please do not attempt to contact the client directly, as all communication is managed through our team to ensure a professional and organized hiring process.

Pay

Pay via Get A Job.ai will be discussed during the screening process based on experience level and contribution scope.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from all qualified candidates regardless of background.