Kafka /SSIS Engineer Dallas, TX (Day 1 Onsite and Hybrid)

Job Title: Kafka /SSIS Engineer

Location: Dallas, TX (Day 1 Onsite and Hybrid)

Job Type: Contract

Must Have 12+ Years of Experience.

Key responsibilities may include:

Kafka Integration:

·         Design and implement Kafka producer and consumer applications to ingest and distribute data streams from various internal and external sources across the Builders FirstSource ecosystem.

·         Manage Kafka topics, partitions, and consumer groups to optimize data flow and performance.

·         Monitor Kafka cluster health and troubleshoot potential issues related to data delivery.

SSIS Development:

·         Develop robust SSIS packages to extract data from source systems (e.g., ERP, CRM, databases) using appropriate connectors.

·         Perform data cleansing, transformation, and aggregation within SSIS packages to prepare data for analysis and downstream applications.

·         Implement data quality checks and validation rules within SSIS workflows to ensure data integrity.

Data Pipeline Management:

·         Design and architect data pipelines that leverage both Kafka and SSIS to efficiently move data between systems.

·         Monitor data pipeline performance, identify bottlenecks, and implement optimization strategies.

·         Implement error handling mechanisms to address data failures and ensure data recovery.

Collaboration:

·         Work closely with business stakeholders to understand data requirements and translate them into effective data pipelines.

·         Collaborate with IT teams to ensure seamless integration with existing infrastructure and applications.

Technical Skills:

·         Proficient in Apache Kafka concepts (producers, consumers, topics, partitioning, etc.)

·         Expertise in developing SSIS packages using the visual designer and advanced transformation components.

·         Familiarity with SQL and database management systems (e.g., SQL Server)

·         Understanding of data warehousing concepts (if applicable)

Soft Skills:

·         Strong analytical and problem-solving abilities

·         Excellent communication skills to collaborate with cross-functional teams

·         Ability to work independently and manage multiple projects simultaneously

·         Attention to detail and commitment to data quality