Senior Python Data Scraping Engineer (Remote)

Job summary

This is a freelance, fully remote position for a Senior Python Data Scraping Engineer to work on specialized data scraping workflows within an AI-assisted project. The role involves collaborating with agents to ensure accurate and actionable data extraction from complex websites.

Qualifications

• Minimum of 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.
• Strong technical foundation in scripting, automation, and AI-assisted workflows.
• Proficiency in Python web scraping tools (BeautifulSoup, Selenium) and handling dynamic content.
• Experience with data cleaning, normalization, and validation.
• Familiarity with cloud infrastructure (AWS) and containerization (Docker).
• English proficiency at upper-intermediate level (B2) or above.

Responsibilities

• Manage end-to-end data extraction workflows, ensuring accuracy and reliability of structured datasets.
• Utilize internal tools and custom workflows for efficient data collection and validation.
• Adapt scraping techniques for dynamic and interactive web sources.
• Maintain data quality through validation checks and consistency controls.
• Scale scraping operations for large datasets and monitor for stability against site changes.

Skills

• Strong experience in Python and web scraping techniques.
• Ability to handle anti-bot mechanisms and complex data structures.
• Detail-oriented with a commitment to data accuracy.
• Self-directed with strong troubleshooting skills.

Tools

• Apify, OpenRouter, AWS, Docker, and LLM frameworks (LangChain, OpenRouter).