Senior Python Data Scraping Engineer (Freelance)

About This Opportunity

We are representing a confidential technology client seeking a Senior Python Data Scraping Engineer for freelance engagement based in Egypt. Our talent team at Get A Job.ai is looking for experienced data engineering professionals who can execute complex web scraping workflows with precision and reliability.

This is a part-time remote role requiring approximately 10–20 hours per week during active project phases. You'll work independently on data extraction tasks that demand technical excellence and attention to detail.

Responsibilities

• Design and execute end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
• Build and maintain custom workflows that accelerate data collection, validation, and task execution while meeting defined technical requirements
• Extract data reliably from dynamic and interactive web sources, adapting approaches to handle JavaScript-rendered content and evolving site architectures
• Implement data quality standards through validation checks, cross-source consistency controls, formatting specifications, and systematic verification before delivery
• Scale scraping operations for large datasets using efficient batching or parallelization techniques, monitor failures, and maintain stability despite site structure changes

What We're Looking For

Required Experience:

• Minimum 5+ years of relevant experience in data engineering, web scraping, automation, or software development
• Strong proficiency in Python web scraping using BeautifulSoup, Selenium, or similar libraries
• Proven ability to extract data from complex structures including hierarchies, archived pages, and inconsistent HTML
• Experience handling dynamic content (JavaScript, AJAX, infinite scroll) and working with APIs through proxies
• Solid background in data cleaning, normalization, and validation, with ability to deliver structured datasets in CSV, JSON, or similar formats
• Demonstrated experience managing anti-bot mechanisms and dynamic site structures at scale
• English proficiency at Upper-Intermediate (B2) level or above

Technical Requirements:

• Hands-on experience with cloud infrastructure (AWS or equivalent) and containerization using Docker
• Practical experience with LLM frameworks such as LangChain or similar technologies applied to automation tasks
• Strong attention to detail and commitment to data accuracy
• Self-directed work ethic with ability to troubleshoot independently

Preferred Qualifications:

• Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields
• GitHub portfolio demonstrating relevant projects

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team conducts an initial screening to assess technical fit and experience level. Qualified candidates are then submitted to our client for consideration. Please do not attempt to contact the client directly—all communications should go through our talent team to ensure a smooth process for everyone involved.

Pay

Compensation details will be discussed during the screening process based on experience level and project scope.

Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We evaluate all candidates based on qualifications and merit, and we encourage applications from professionals of all backgrounds.