Senior Python Data Scraping Engineer (Remote, Freelance)

Job summary

This freelance position involves driving data scraping workflows within a hybrid AI and human system, focusing on web extraction and processing tasks. The role requires collaboration with Tendem Agents to ensure data accuracy and quality control while handling complex scraping operations.

Qualifications

• Minimum of 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.
• Proficient in Python web scraping tools (BeautifulSoup, Selenium) and handling dynamic content.
• Experience with data cleaning, normalization, and validation.
• Familiarity with cloud infrastructure (AWS) and containerization (Docker).
• English proficiency at an upper-intermediate level (B2) or above.

Responsibilities

• Manage end-to-end data extraction workflows from complex websites, ensuring accuracy and reliability.
• Utilize internal tools (Apify, OpenRouter) and custom workflows for efficient data collection and validation.
• Adapt scraping techniques for dynamic and interactive web sources, including JavaScript-rendered content.
• Maintain data quality through validation checks and systematic verification before delivery.
• Scale scraping operations for large datasets, monitor failures, and ensure stability against site changes.

Skills

• Strong attention to detail and commitment to data accuracy.
• Self-directed work ethic with troubleshooting capabilities.
• Experience with LLM frameworks (LangChain, OpenRouter) is a plus.

Tools

• Python, BeautifulSoup, Selenium, Apify, OpenRouter, AWS, Docker.