Senior Python Data Scraping Engineer (Freelance, Remote)

Job summary

This freelance position seeks a Senior Python Data Scraping Engineer to manage specialized data scraping workflows in a hybrid AI and human system. The role involves collaborating with agents to ensure accurate data extraction and processing from complex websites.

Qualifications

• Minimum of 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.
• Proficient in Python web scraping tools (BeautifulSoup, Selenium) and handling dynamic content.
• Experience in data cleaning, normalization, and validation.
• Familiarity with cloud infrastructure (AWS) and containerization (Docker).
• English proficiency at upper-intermediate level (B2) or higher.

Responsibilities

• Manage end-to-end data extraction workflows, ensuring accuracy and reliability of structured datasets.
• Utilize internal tools (Apify, OpenRouter) and custom workflows for efficient data collection and validation.
• Adapt scraping techniques for dynamic web sources and maintain stability against site changes.
• Implement data quality standards through validation checks and consistency controls.
• Scale scraping operations for large datasets and monitor for failures.

Skills

Compensation

Earn up to $37 per hour, with variations based on project complexity and expertise. This role offers flexible remote work and performance-based bonuses.

• Strong attention to detail and commitment to data accuracy.
• Self-directed with the ability to troubleshoot independently.
• Experience with LLM frameworks (LangChain, OpenRouter) is advantageous.