|
Hi Greetings!
I am pleased to present a highly experienced Lead Data Engineer with 12+ years of experience in designing and delivering scalable enterprise data platforms, cloud data solutions, real-time streaming pipelines, and modern Lakehouse architectures across utility, financial services, banking, and retail domains.
The candidate has strong hands-on expertise in Databricks, Delta Lake, Snowflake, BigQuery, Redshift, Azure Synapse, Spark/PySpark, Kafka, Airflow, dbt, Python, SQL, AWS, Azure, and GCP. He has extensive experience in data architecture, ETL/ELT, batch and real-time processing, data modeling, governance, CI/CD, performance optimization, and AI-enabled analytics.
Client Experience
CenterPoint Energy – Houston, TX | Lead Data Engineer | Sep 2025 – Present
- Architected Databricks Lakehouse/Medallion architectures with Delta Lake, Lakeflow, DLT, Auto Loader, and Unity Catalog.
- Built batch and real-time pipelines supporting utility telemetry, damage assessment, restoration forecasting, and crew/resource planning.
- Developed Python/Streamlit customer journey and complaint analytics solutions using unstructured data and AI.
- Implemented data quality, governance, CDC, observability, CI/CD, and conversational analytics using Databricks Genie.
PayPal – Austin, TX | Lead Data Engineer | Aug 2018 – Aug 2025
- Architected large-scale financial data platforms and Lakehouse solutions using Databricks, Spark, Kafka, Snowflake, BigQuery, Redshift, AWS, Azure, and GCP.
- Developed real-time streaming pipelines processing 100K+ events/second with exactly-once processing.
- Built financial data marts supporting Transaction Events, Payment Volume, Liabilities, Daily Balances, Accounting, Regulatory, Forecasting, and Treasury.
- Led migration of legacy Hadoop/Hive/Spark workloads to modern cloud platforms and implemented Airflow, dbt, CI/CD, and data governance frameworks.
SFF Credit Union – San Francisco, CA | Senior Data Engineer | Jan 2017 – Aug 2018
- Built Airflow/Python ETL pipelines for loan, banking, regulatory, and mortgage data.
- Developed real-time analytics for DTI, LTV, credit risk, underwriting, and interest-rate calculations.
- Automated regulatory reporting and OCR-based document processing.
Walmart – San Bruno, CA | Data Engineer | Jan 2015 – Jan 2017
- Developed real-time Spark Streaming/Kafka pipelines for campaign analytics and personalization.
- Built Hadoop/Hive, HBase, MapReduce, Flume, Sqoop, and Oozie-based data pipelines supporting large-scale customer and product analytics.
Key Technologies
Databricks | Delta Lake | Spark/PySpark | Kafka | Snowflake | BigQuery | Redshift | Azure Synapse | AWS | Azure | GCP | Airflow | dbt | Python | SQL | Terraform | CI/CD | Unity Catalog | Databricks Genie
Certifications: Google Cloud Professional Data Engineer, Databricks Certified Data Engineer Professional
Overall, this candidate combines strong hands-on engineering expertise with Lead-level architecture and technical leadership, making him a strong fit for Lead/Senior Data Engineer, Cloud Data Engineer, Data Platform Engineer, and Data Engineering Architect opportunities.
Please review the attached resume and let me know if you would like to discuss the candidate or proceed with the submission.
Thank you,
Bhasker
Sales Lead.
✉: Bhasker@peachitpros.com 📞: 732-344-4258
Osprey Way, West Windsor Township, NJ 08550, USA
www.peachitpros.com
|
