SCALA Data Engineer
Work location: Atlanta GA
Job Description:
• Develop data pipelines to ingest and transform data using Scala
/PySpark and SQL on Azure Synapse Spark.
• Source and version control code/configuration artifacts using GitHub.
• Create tables/views (using SQL) in Synapse SQL Serverless pool for
consumption.
• Investigate and remediate data pipeline errors or performance issues.?
• Capable of writing and testing code in Scala/ PySpark and SQL.
• Knowledge of source code repository like GIT/Azure Repos & build
tools like Maven
• Experience working with Azure Synapse.
Additional skills
1. Participate in cross-functional team meetings to identify
modifications & capabilities desired by end user/ consumer teams
2. Responsible for build, testing, configuration, cutover and
implementation tasks as required for this project
—
