Job Title: Manta Developer
Location: Remote, anywhere in USA
Duration: 24 Nov 2022 – 24 Nov 2023
Client: Thomson Reuters (IBM)
Visa: Any open except H1s
Resumes Needed By: ASAP
Job Requirements:
TECHNICAL SKILL SET
- Experience in Manta
- Experience working with Databases, BI and ETL tools, Data and Platform architecture.
- Expertise in Python to write code that Interacts with REST APIs to fetch metadata.
- Hands-on exposure of Alteryx Designer to perform data transformation.
- Knowledge of GIT repository, Postman etc.
- Experience in managing AMI, terraform, AWS code Pipeline, Secret Manager, etc., cloud application & storage (AWS)
- Document technical requirement
Scope – Data Lineage would help in improving transparency to provenance, change impact and regulatory implications surrounding Thomson Reuters’ critical Data assets. Manta which is a best-in-class data lineage solution has been procured by Thomson Reuters for the purpose.
Manta has been implemented on AMI [Amazon Machine Image] with out of the box [OOTB] and custom scanners implemented. The need is to bring resources to develop or modify custom scanners for new use cases, support implemented OOTB and custom scanners, and interact with Manta product team and other relevant product teams to meet TR business goals. These resources would work on Manta development of new use cases, under the leadership of TR or TR designated teams.
AWS provisions AMI, and TR platform engineering team hardens the AMI with TR specific software. The hardened AMIs are called ‘Golden AMIs’ in TR parlance. The Golden AMIs are revised every 60 days, and Manta would get re-installed which involves terraform, AWS codePipeline, Secret Manager, etc. The resources are expected to manage the re-implementation, storage, and related infrastructure aspects of this implementation, as well.
Requirements
• Technical teams who are experienced in three or more end to end implementation of Data Lineage solutions spanning across Cloud and on-premise sources
• Technical teams who are experienced in three or more end to end implementation of Manta out of the box scanners & custom scanners and code development, as needed
• Configure and test new OOTB scanner
• Develop and test custom scanners using Open Manta
• Executing new scanner revision
• Scheduling scanners
• The above is not a comprehensive list, but, a few to understand the resource requirements
• Technical teams experienced in Agile/SCRUM ways of execution with industry best practices in Fortune 500 companies
• Consultants who are experienced in designing data governance solutions within a data lineage solutions adhering to industry best practices
• Need technical support teams to do Managed Services type of work [80% support, 20% development] during the BAU support process
• Engineers is expected to be 4+ years experienced in Manta
• Accountable to implement security standards aligned with industry and TR best practices to protect TR from vulnerabilities and protection of data
• Accountable to implement monitoring solutions using DataDog or out of the box tool options for infrastructure consumption and health which can be integrated with a reporting tool like Power BI or other tools, as applicable
• Need partners who have an onshore-offshore presence to deliver value in a cost effective manner, and to scale to the resource needs of the TR within a 2-3 week lead time
• BAU
• Responsible to work along with TR lead and Product vendor to understand the product roadmap and keep all TR stakeholders informed
• Accountable to resolve TR issues with Product vendor by adhering to the TR and Product vendor processes
• Adhere to industry and TR best practices/processes for SIAM [Service Integration and Management] while supporting the application
• Maintain and support the application as per established SLAs of TR, or create SLAs in consultation with TR where needed
• Accountable to maintain golden AMIs
