Databricks Architect

Sr Databricks Architect

Location : Princeton, NJ

Experience : 15+ Years

Job Description

12-15+ years relevant experience in building data strategy on various data management tools.
Extensive experience in Databrick (8-10 years)
Integrate and transform data from various sources, ensuring data quality and consistency.
Write and optimize Apache Spark code in Scala, Python, or other supported languages.
Analyze business requirements and design efficient and scalable data processing solutions using Databricks.
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and requirements.
Strong SQL skills for querying and manipulating data in various data storage systems.
Proficiency in at least one programming language, such as Scala or Python, for implementing data processing logic.
Knowledge of ETL (Extract, Transform, Load) tools and methodologies.
Experience designing and implementing data pipelines for efficient data movement and transformation.
Understand the Databricks Unified Analytics Platform and its components.
Proficiency in using Databricks Notebooks for interactive data exploration and development.

Cloud Architect (15+ Experience, hand on) :

Cloud Architecture and Design and Development

• Demonstrate knowledge of cloud architecture and implementation features (OS, multi-tenancy, virtualization, orchestration, elastic scalability)

• Demonstrate knowledge of DevOps tool chains and processes

• Act as a Subject Matter Expert to the organization for CLIENT cloud end-to-end architecture, including Azure, AWS. Experience in Cloud migration and defining Cloud strategy.

• Develop a library of deployable and documented cloud design patterns, based on the Client application portfolio, as a basis for deploying services to the cloud

• Demonstrate leadership ability to back decisions with research and the “why,” and articulate several options, the pros and cons for each, and a recommendation

• Maintain overall industry knowledge on latest trends, technology, etc.

• Develop solutions architecture and evaluate architectural alternatives for private, public and hybrid cloud models, including IaaS, PaaS, and other cloud services

• Contribute to DevOps development activities and complex development tasks

• Define optimal design patterns and solutions for high availability and disaster recovery for applications

• Drive scope definition, requirements analysis, functional and technical design, application build, product configuration, unit testing, and production deployment

• Ensure delivered solutions meet/perform to technical and functional/non-functional requirements

• Provide technical expertise and ownership in the diagnosis and resolution of an issue, including the determination and provision of workaround solution or escalation to service owners

• Ensure delivered solutions are realized in time frame committed; work in conjunction with project sponsors to size and manage scope and risk

• Provide support and technical governance, expertise related to cloud architectures, deployment, and operation

• Provide thought leadership in industry and to fellow team members across business and technical project dimensions solving complex business requirements

• Demonstrate forward thinking around where the organization is going and how technology can support these efforts

• Advocate and define cloud architecture vision from a strategic perspective, including internal and external platforms, tools, and systems Mentoring (10%)

• Act as the coach and mentor to team members and technical staff on their assigned project tasks

• Develop a cohesive team and ensure their continued success

• Lead the definition and development of cloud reference architecture and management systems • Conduct product work reviews with team members

Basic Qualifications:

Bachelor’s degree in computer science, systems analysis or a related study, or equivalent experience

• 10 + years of relevant experience including technical architecture, network management, application development, middleware, database management or operations

• Experience with Azure(primary) and AWS enterprise implementations

• Exposure to multiple, diverse technologies and processing environments

• Knowledge of all components of a technical architecture

• Knowledge of business process re-engineering principles and processes

Thanks and Regards,

Sapna Verma (Technical Recruiter )

1603, Capitol Ave, Suite 310 A461, Cheyenne Wyoming 82001

Email : sapna@laibatechnology.com

top 10 staffing companies in usa

Corp to corp remote jobs

Updated bench sales hotlist

US IT recruiter vendor list