Senior Python Data Scraping Engineer (Remote)

Job summary

This is a freelance role focused on driving specialized data scraping workflows for real-world applications. The position requires expertise in web scraping, data extraction, and data processing to deliver accurate and high-quality results.

Qualifications

• Minimum of 5 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.

Responsibilities

• Manage end-to-end data extraction workflows across complex websites, ensuring accuracy and reliable delivery of structured datasets.
• Utilize available tools and custom workflows to enhance data collection and validation processes.
• Adapt scraping techniques for dynamic and interactive web sources, including JavaScript-rendered content.
• Maintain data quality through validation checks and systematic verification before delivery.
• Scale scraping operations for large datasets and monitor for stability against minor site changes.

Skills

• Proficient in Python web scraping tools (e.g., BeautifulSoup, Selenium) and handling dynamic content.
• Strong background in data cleaning, normalization, and validation, delivering structured datasets in formats like CSV and JSON.
• Experience with anti-bot mechanisms and cloud infrastructure (AWS or equivalent).
• Familiarity with containerization (Docker) and LLM frameworks (LangChain, OpenRouter) is a plus.
• Strong attention to detail and self-directed work ethic.

Education

• Relevant degree in a technical field is advantageous.

Tools

• Experience with tools such as Apify and OpenRouter, along with modern development technologies.