Senior Python Data Scraping Engineer (Freelance, Remote)

Job summary

This freelance position seeks a Senior Python Data Scraping Engineer to manage specialized data scraping workflows within a hybrid AI and human system. The role requires collaboration with agents to ensure high-quality data extraction and processing.

Qualifications

• Minimum of 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.
• Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
• Proficiency in Python web scraping tools (BeautifulSoup, Selenium, etc.) and handling dynamic content.

Responsibilities

• Oversee end-to-end data extraction workflows from complex websites, ensuring accuracy and reliability of structured datasets.
• Utilize internal tools (Apify, OpenRouter) and custom workflows for efficient data collection and validation.
• Adapt scraping techniques for dynamic web sources and enforce data quality standards through systematic verification.
• Scale scraping operations for large datasets and monitor for stability against site structure changes.

Skills

• Expertise in extracting data from complex structures and handling anti-bot mechanisms.
• Experience with cloud infrastructure (AWS or similar) and containerization (Docker).
• Familiarity with LLM frameworks (LangChain, OpenRouter) for automation tasks.
• Strong attention to detail and self-directed work ethic.

Education

• Bachelor’s or Master’s Degree in a relevant technical field is a plus.

Tools

• Proficient in Python, web scraping libraries, cloud services, and containerization tools.