Data Engineer (Data Quality)

New York, NY

Posted: 10/15/2019 Industry: IT Perm Job Number: 12779355

Job Description

About the opportunity

We are seeking an experienced Data Engineer to join our recently created Data Management team as we help build and launch our data and analytics platform, serving our growing capital markets clientele. You will work in a dynamic group of cross-functional team-members and be responsible for designing and developing systems that will ensure the correctness of our data, as we build a strong data foundation for our new business.

You will be successful in this role if you:
  • Have knowledge (3+ years) of data modelling, ETL processes and SQL Server
  • Can write advanced SQL Queries (including aggregation and analytical functions)
  • Love learning new technologies and have exposure to cloud services (especially Microsoft Azure)
  • Have experience with Docker, Kubernetes and serverless functions (e.G. AWS Lambda, Azure Functions, Google Cloud Functions)
  • Proficient with one or more OOP or Scripting language (Java, C#, Python, etc)
  • Possess an understanding of distributed data technologies (Cassandra, Spark, Hive, Hadoop, Flink, Kafka, etc.)
  • Have experience collaborating with Product Managers and Content Owners in an agile framework
  • Are highly motivated, self-directed and collaborative

In this role, you will:
  • Develop generalized data-driven solutions that will track data changes and verify their correctness
  • Develop and implement Change Data Capture (CDC) techniques and build event-based data pipelines for integrating our data with various commercial, open-source or proprietary systems
  • Model complex financial data domains. Prior experience with Financial Data (e.G. Company fundamentals, market data, M&A transactions) is preferred
  • Execute complex engineering projects and propose appropriate technology choices
  • Work with and/or direct offshore technical teams

Meet Your Recruiter

Kathy King

Apply Online

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.