Senior Data Engineer
Roles and Responsibilities: ● Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments. ● Key Responsibilities ● Manage large-volume ingestion and backfill operations ● Implement Bronze to Silver transformation pipelines ● Develop…
- Tamil Nadu India
- Permanent
- 10+ years
About this role
Roles and Responsibilities: ● Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments. ● Key Responsibilities ● Manage large-volume ingestion and backfill operations ● Implement Bronze to Silver transformation pipelines ● Develop incremental load and CDC logic ● Optimize Lakehouse performance and storage patterns ● Implement monitoring (record counts, load duration, failure tracking) ● Support Dev/Test/Prod promotion processes Required Qualifications ● 6+ years of data engineering experience ● Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory ● Strong experience with similar ELT tools ● Experience handling high-volume datasets (hundreds of millions of records) ● Proficiency in SQL, Python, and data modeling concepts ● Strong understanding of Medallion architecture
Skills
- Data Engineer
- Microsoft Fabric
- Azure Synapse
- Data Factory
- ELT
- SQL
- Python