Senior Python Data Scraping Engineer (Remote)

Job summary

This is a freelance role focused on specialized data scraping workflows for real-world applications. The position involves applying expertise in web scraping, data extraction, and data processing to deliver accurate and high-quality results.

Qualifications

• Minimum of 5 years of relevant experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is advantageous.

Responsibilities

• Manage end-to-end data extraction workflows across complex websites, ensuring accuracy and reliable delivery of structured datasets.
• Utilize available tools and custom workflows to enhance data collection and validation while meeting defined requirements.
• Adapt extraction methods for dynamic web sources, including JavaScript-rendered content.
• Maintain data quality through validation checks and systematic verification before delivery.
• Scale scraping operations for large datasets, monitor failures, and ensure stability against minor site structure changes.

Skills

• Proficient in Python web scraping (BeautifulSoup, Selenium, etc.), including handling dynamic content and APIs.
• Strong ability to extract data from complex structures and deliver structured datasets (CSV, JSON, Google Sheets).
• Experience with anti-bot mechanisms and dynamic site structures at scale.
• Familiarity with cloud infrastructure (AWS or equivalent) and containerization (Docker).
• Experience with LLM frameworks (LangChain, OpenRouter, etc.) for automation tasks.
• Strong attention to detail and commitment to data accuracy.
• Self-directed with troubleshooting skills.
• English proficiency: Upper-intermediate (B2) or above.

Education

• Bachelor’s or Master’s Degree in relevant fields is a plus.

Tools

• Familiarity with tools such as Apify, OpenRouter, and other relevant technologies.