Senior Data Engineer (Finance, Remote)

Job summary

The role involves building and maintaining data systems that support various functions within the organization, focusing on real-time data processing and analytics. As a key member of the Central Data Team, you will contribute to the development of the Data Platform, ensuring that data is accessible and reliable for trading, asset management, and compliance.

Qualifications

• 8+ years of experience in building production data systems.
• Strong proficiency in Python and SQL, with a deep understanding of database engines.
• Experience in data modeling for both streaming and analytical workloads.

Responsibilities

• Develop streaming and batch data pipelines for market and trading data.
• Create self-serve tools for other teams to utilize data products independently.
• Manage data contracts and schema evolution to prevent coordination issues.
• Design lakehouse and time-series layers based on consumer query patterns.
• Establish Data Governance and Quality Framework, including stale-feed detection and schema validation.
• Generate derived analytics for trading desks and asset management.
• Ensure observability, cost-efficiency, and performance from the start.
• Collaborate with various teams and document processes.

Skills

• Experience with streaming systems (Kafka, Redpanda, etc.) and time-series databases (ClickHouse, TimescaleDB).
• Familiarity with lakehouse architecture and its impact on query performance.
• Proficient in using Docker, Terraform, and CI/CD practices.

Education

• Relevant degree in Computer Science, Engineering, or a related field is preferred.

Tools

• Proficient in Python, SQL, Docker, Terraform, and CI/CD tools.