Data Engineer with Snowflake Architect and (GEN AI exp)
Austin, TX (5x/ week onsite)- Local to TX
6+ Months C2H
Rate: $60-$65 C2C
JD:
MUST HAVE:
⢠Hands-on experience with writing Complex queries using ā Joins, Self Joins, Views, Materialized Views, Cursor also Recursive, use of GROUP BY, PARTITION BY functions / SQL Performance tuning
⢠Hands-on experience with ETL and Dimensional Data Modelling ā Slowly Changing Dimensions (SCD ā Type 1, 2, 3)
o Good understanding of concepts like schema types, table types – fact-dimension etc. like how to design a dimension vs fact, design considerations factored etc.
⢠Proficiency in Python scripting/programming ā using Pandas, PyParsing, Airflow.
o Pandas, Tableau server modules, Numpy, Datetime, Apache Airflow related modules, APIs
o Setting up Python scripts on DataLab, scheduling processes, connecting with DataLake (S3 etc )
o Data Pipeline automation
⢠Good understanding on Snowflake Architecture – experience with designing and building solutions.
o Architecture, design aspects, performance tuning, time travel, warehouse concepts – scaling, clustering, micro-partitioning
o Experience with SnowSQL, Snowpipe
⢠Must Have – Experience with Snowflake performance optimization techniques
⢠Own project delivery collaborating with Offshore.
⢠Actively participating in discussions with business to understand requirements and provide suitable solutions.
⢠Experience with AI (very beneficial) and advanced AI integration ā
o Good experience with Gen AI and LLM Integration which includes:
§ Having good understanding of RAG
§ Prompt and Context Engineering ā structure, query and manage data context fed to LLMs
§ Vector Data Management ā handling and storing data (also unstructured) in vector databases, indices for semantic search and RAG
§ Experience with LLM Orchestration frameworks ā LangChain, LlamaIndex
Contact Information
Email: navneet.jha@siriinfo.com
Click the email address to contact the job poster directly.