Java Developer OR data engineer Remote only Plano, TX

Contract

Data Engineer

Title: Data Engineer
Location:Fully Remote

Duration: 6 months contract

Visa Restrictions: No H1b/CPT

 

 

Job Description:

Responsibilities:

Data Pipeline Development: Design, develop, and deploy robust and scalable data pipelines using Kafka and Azure Functions to ingest, process, and transform large volumes of data.
Data Modeling: Create efficient data models and schemas to optimize data storage and retrieval.
Data Integration: Integrate data from various sources, including databases, APIs, and cloud storage systems.
Data Quality Assurance: Implement data quality checks and monitoring to ensure data accuracy and consistency.
Performance Optimization: Identify and resolve performance bottlenecks in data pipelines.
Cloud Infrastructure: Leverage Azure cloud platform to deploy and manage data engineering solutions.
Collaboration: Work closely with cross-functional teams to understand data requirements and provide technical guidance.
Problem-Solving: Troubleshoot and resolve complex data engineering issues.
Continuous Improvement: Stay up-to-date with the latest data engineering technologies and best practices.
Responsible for designing, developing, and maintaining data pipelines to support our data-driven initiatives. You will work closely with data analysts, data scientists, and other stakeholders to ensure data quality, integrity, and accessibility.
 

Qualifications:

Technical Skills: Strong proficiency in Java programming language, including core Java concepts, collections, and concurrency.
In-depth knowledge of Kafka and its ecosystem.
Experience with Azure Functions or other serverless computing platforms.
Solid understanding of SQL and database concepts.
Familiarity with Databricks is a plus.
Basic understanding of algorithms and data structures.
Experience with Spring Boot and Spring Framework components (Hibernate, Spring Batch, Spring Security).
Debugging and troubleshooting skills.
Knowledge of vulnerability remediation techniques.

To apply for this job email your details to sarfaraz@convextech.com