Tech3pillars technologies LLC ¡ Manager
đ Hiring Now | Data Engineer – Databricks
đ Location: Los Angeles / Irvine, CA, USA
đź Experience: 7+ Years
đŻ Mandatory Skill: Hands-on Databricks Production Experience
We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks, Apache Spark, PySpark, and Delta Lake to build and maintain scalable, production-grade data engineering pipelines.
đš Must-Have Technical Skills:
• Hands-on Databricks Production Experience
• Apache Spark and PySpark
• Delta Lake and Delta Tables
• Databricks Jobs and Workflows
• ETL/ELT Pipeline Development
• Data Ingestion and Transformation
• SQL and Data Processing
• Production Pipeline Monitoring and Troubleshooting
đź Key Responsibilities:
âď¸ Design, develop, and maintain scalable data pipelines using Databricks
âď¸ Build production-ready ETL/ELT pipelines using Spark and PySpark
âď¸ Create, manage, and optimize Delta tables
âď¸ Develop and schedule Databricks Jobs and Workflows
âď¸ Optimize Spark jobs for performance, scalability, and cost efficiency
âď¸ Implement data validation, error handling, and quality checks
âď¸ Monitor production pipelines and resolve data processing issues
âď¸ Collaborate with data architects, analysts, and engineering teams
â
Mandatory Candidate Requirements:
• 7+ years of overall IT experience
• Proven hands-on experience building and deploying pipelines on Databricks
• Production experience with Spark/PySpark and Delta Lake
• Experience developing and managing Databricks Jobs and Workflows
• Strong pipeline troubleshooting and performance optimization skills
Apache Spark
SQL
Python
Delta Lake
ETL Pipeline Development
Databricks Workflows
Cloud Data Platforms
Databricks
Databricks
IT Staffing & IT Consulting
Download MeeBoss