Senior Data Engineer

Job title: Data Engineer – Azure Synapse & Microsoft Fabric

Location: Atlanta, GA

Visa- GC and USC

Job Summary

We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based data platforms. The ideal candidate will have hands-on experience designing and implementing scalable data solutions, building robust data pipelines, and leveraging Data Lake architectures to support enterprise analytics and reporting initiatives.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines using Azure-based technologies.

• Build and maintain enterprise data solutions using Azure Synapse Analytics.

• Develop data transformation and processing workflows using PySpark and Spark SQL.

• Design and implement Data Lake solutions following Medallion Architecture (Bronze, Silver, Gold layers).

• Work with structured and unstructured data from multiple sources to support business analytics needs.

• Optimize Spark workloads and troubleshoot performance issues in distributed data processing environments.

• Collaborate with architects, analysts, developers, and business stakeholders to deliver high-quality data solutions.

• Support data quality, governance, and reliability initiatives across the data platform.

• Contribute to the adoption and implementation of Microsoft Fabric capabilities where applicable.

Required Qualifications

• 8+ years of experience in Data Engineering and Data Platform development.

• Strong hands-on experience with Azure Synapse Analytics.

• Solid understanding of Microsoft Fabric and its data engineering capabilities.

• Deep knowledge of Apache Spark architecture and distributed computing concepts.

• Extensive experience with PySpark and Spark SQL.

• Strong understanding of Data Lake concepts and modern data architecture patterns.

• Experience implementing Medallion Architecture and large-scale data processing solutions.

• Strong SQL development and performance tuning skills.

• Excellent analytical, troubleshooting, and problem-solving abilities.

• Strong verbal and written communication skills.

Preferred Qualifications

• Experience with Azure Data Lake Storage (ADLS), Azure Data Factory, and other Azure data services.

• Exposure to data warehousing, ETL/ELT frameworks, and cloud-native analytics solutions.

• Experience working in Agile/Scrum environments.

• Knowledge of data governance, security, and performance optimization best practices.

Rajmurat Yadav

E:[email protected] | https://www.linkedin.com/in/raj-yadav-1bb721223/

 www.t3pillars.com

23710 Schooler Plaza Office 2024, Ashburn | VA - 20148