Senior Data Engineer (Ex-Microsoft candidates Only) contract Remote Position

 

Job Description

Support real-time streaming and batch data processing use cases

• Ensure data security, privacy, and compliance with enterprise standards Architect, build, and maintain large-scale data ingestion and transformation pipelines
• Develop and optimize ETL/ELT workflows to ensure reliable and high-performance data processing
• Design and manage data storage systems using cloud-based architectures (Azure preferred)
• Implement data governance, data quality frameworks, and monitoring solutions
• Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions
• Develop reusable data engineering components, tools, and processes

Additional Job Description

This Senior Software Development Engineer role will partner with other business/engineering PMs and technical engineering teams to design and drive the implementation of Risk Data Platform. The Risk Data Platform manages PBs of data, runs complex data processing, enables multiple teams’ self-serve use of data for ML model training, pattern detection, fraud investigation, performance reporting, and powers all other data-driven activities.

In this position you will be expected to play a leading role to design, build, and validate the features that you and peers work on, build monitoring on data quality. You will contribute to delivering new and improved functionality to customers and partners each sprint and be responsible for ensuring that the design and implementation is of high quality. You will achieve these by working with other engineers and program managers along the way, quickly learning/applying data management best practices, and leveraging Azure data management products (such as Azure Data Factory, Azure Data Lake, Azure Synapse, etc)

Qualifications:

• Bachelor’s or higher degree in engineering, computer science, or equivalent field
• 7+ years data pipelines and platform development experience
• Experience of Azure technologies (Azure Data Factory, Azure Data Lake, Azure Synapse, etc) are required.
• Experience with Azure SQL, Kusto, Azure storage accounts
• Proficiency with Python is required, and with C# is highly desired
• Understand data security best practice, and able to establish development process to achieve data security.
• Ability to drive technical investigations, 3rd party solution evaluation, and prototyping in a fast-paced startup-like environment. 
• Strong sense of curiosity and a willingness to learn, share, and improve. 
• Team player with excellent cross-group collaboration skills