Data Engineer – Databricks

Contract
Hybrid
Undisclosed
Los Angeles, CA; Irvine, CA

Job description

🚀 Hiring Now | Data Engineer – Databricks
📍 Location: Los Angeles / Irvine, CA, USA
💼 Experience: 7+ Years
🎯 Mandatory Skill: Hands-on Databricks Production Experience
We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks, Apache Spark, PySpark, and Delta Lake to build and maintain scalable, production-grade data engineering pipelines.
🔹 Must-Have Technical Skills:
• Hands-on Databricks Production Experience
• Apache Spark and PySpark
• Delta Lake and Delta Tables
• Databricks Jobs and Workflows
• ETL/ELT Pipeline Development
• Data Ingestion and Transformation
• SQL and Data Processing
• Production Pipeline Monitoring and Troubleshooting
💼 Key Responsibilities:
✔️ Design, develop, and maintain scalable data pipelines using Databricks
✔️ Build production-ready ETL/ELT pipelines using Spark and PySpark
✔️ Create, manage, and optimize Delta tables
✔️ Develop and schedule Databricks Jobs and Workflows
✔️ Optimize Spark jobs for performance, scalability, and cost efficiency
✔️ Implement data validation, error handling, and quality checks
✔️ Monitor production pipelines and resolve data processing issues
✔️ Collaborate with data architects, analysts, and engineering teams
✅ Mandatory Candidate Requirements:
• 7+ years of overall IT experience
• Proven hands-on experience building and deploying pipelines on Databricks
• Production experience with Spark/PySpark and Delta Lake
• Experience developing and managing Databricks Jobs and Workflows
• Strong pipeline troubleshooting and performance optimization skills

More information

Job skills

Apache Spark

SQL

Python

Delta Lake

ETL Pipeline Development

Databricks Workflows

Cloud Data Platforms

Databricks

Certifications

Databricks

Company overview

company-logo
Tech3pillars technologies LLC

IT Staffing & IT Consulting

For over 8 years, T3Pillars Technologies has been at the forefront of the digital transformation wave in the US market. What started as a focused IT staffing agency in the DC corridor has evolved into a comprehensive consulting firm specializing in enterprise Salesforce implementations, CRM/ERP integrations, custom application development, and managed support. Headquartered at 11974 Grey Wing Ct, Reston, VA, we are strategically positioned in the heart of the DC technology corridor — one of the most competitive technology markets in the country. This location has shaped our culture: we operate with the precision and accountability demanded by the government contractors, healthcare systems, and financial institutions that form our client base. Today, T3Pillars serves clients nationwide, bringing world-class talent and technical architecture to industries that demand reliability, compliance, and measurable outcomes. Our 50+ certified consultants have collectively delivered over 200 projects — on time, on budget, and to lasting effect.