AWS Data Architect

AWS Data Architect

Tarrytown NY Onsite

Skills: PySpark, AWS Redshift, EMR, Databricks, Python, Healthcare/Pharma/Life Sciences domain

Job Description:

Candidate should have strong 12+ Years of experience in data engineering architecture for large-scale platforms.
Contribute towards defining platform roadmap/Architecture/ solution, Design, POCs, prototype, technical evaluation for tech stack finalization and guiding principle for the best practices etc.
Data platform development strategy, Data migration strategy, Data validation strategy, To review code, checklist / coding standards etc.
Creating data models to reduce system complexities and hence increase efficiency & reduce cost.
Expertise with data ingestion/orchestration tools and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift, Apache Airflow and EMR etc
Strong coding background in Python, SQL, PySpark. Proficiency in data virtualization (Dremio or similar).
Experience with data governance and access control frameworks (Privacera, Apache Ranger, etc.).
Knowledge of search & discovery platforms (Solr, Elasticsearch, Looker).
Solid understanding of data security, authentication (Okta), and compliance frameworks.
Familiarity with CI/CD pipelines and DevOps practices (Jenkins, Git, Docker, Kubernetes).
Prior experience designing enterprise data platforms in healthcare, pharma, or regulated industries.
Knowledge of machine learning pipelines and integration into data platforms.