DRW: Senior Data Engineer
weworkremotely.com
As a Senior Data Engineer on our Unified Platform team, you will play an integral role in designing and building an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.Technical requirements summary:Have experience designing and building data-intensive distributed systemsHave experience working within the modern batch and streaming data ecosystemsAn expert in Java/Scala or Python and have experience with SQL and BashAble to own, organize, and steer team projectsBe able to contribute to project management and project reportingBe a leader/mentor to junior members of the team concerning engineering best-practices and code-qualityWhat you will do in this role:Help design, build, and manage DRW's Unified Data Platform and support its users.Work closely with Traders and Researchers to determine appropriate data sources and implement processes to onboard and manage new data sources for analysis to unlock future trading opportunities.Design and develop data solutions to help discover, purchase, organize, track usage, manage rights, and control quality of data sets to address the needs of various DRW trading teams and strategies.Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Contribute to the monitoring and quality control software and processes.What you will need in this role:7+ years of experience working with modern data technologies and/or building data-intensive distributed systemsExpert level skills in Java/Scala or Python with a proven ability to output high-quality, maintainable, codeStrong familiarity with SQL and BashExperience leveraging and building cloud-native technologies for scalable data processing.Prior experience with both batch and streaming systems and an understanding of the limitations those paradigms imposeExperience with an array of data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)Experience with an array of data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.)Experience with an array of data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)Experience managing complex data ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)Prior experience dealing with schema governance and schema evolutionPrior experience developing data quality control processes to detect data gaps or inaccuraciesA desire to mentor less experienced team-members and champion both engineering best-practices and high code-quality standards.Strong technical problem-solving skillsProven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environmentThe annual base salary range for this position is $180k to $250x, depending on the candidates experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.
0 Commenti ·0 condivisioni ·58 Views