Role: Databricks Data Engineer

Shaik Nasir

Totalebiz · US IT Recruiter

Job description

🚨 Now Hiring: Databricks Data Engineer 🚨
📍 Location: New York, NY 10036 (Hybrid)
💼 Employment Type: W2
💰 Rate: $75/hr on W2
🛂 Work Authorization: U.S. Citizens & Green Card Holders Only
📅 Experience Required: 10+ Years
Our direct client is seeking an experienced Databricks Data Engineer to design and deliver scalable data engineering solutions that power enterprise analytics, performance reporting, and Sales Incentive Compensation (SIC) processes.
Required Skills:
✔️ 10+ years of Data Engineering experience
✔️ 3+ years of hands-on experience with Databricks
✔️ Expertise in Delta Lake, Delta Live Tables (DLT), Unity Catalog, and Databricks Workflows
✔️ Strong programming skills in Python and/or Scala
✔️ Advanced SQL and ETL/ELT development experience
✔️ Experience with data modeling, pipeline orchestration, and enterprise data architectures
✔️ Hands-on experience integrating Databricks with Azure, AWS, or GCP
✔️ Experience with Azure Data Factory, Kafka, Event Hubs, or similar data integration technologies
Preferred Experience:
⭐ Sales Incentive Compensation (SIC) processes including:
Quota Management
Attainment Tracking
Commission Calculations
Payout Processing
⭐ Experience with SIC platforms such as:
Anaplan
Oracle ICM
Varicent
Key Responsibilities:
✅ Design, develop, and optimize Databricks-based data pipelines and Delta Lake solutions
✅ Build scalable ETL/ELT workflows for enterprise analytics and reporting
✅ Design data models supporting Sales Incentive Compensation processes
✅ Collaborate with Sales Operations, Finance, and Business stakeholders to translate business requirements into scalable technical solutions
✅ Implement and optimize Databricks features including Unity Catalog, Delta Live Tables, and Photon
✅ Perform testing, debugging, and performance tuning of data pipelines
✅ Document technical designs, pipeline configurations, and development standards
📩 Interested candidates, please send your updated resume, expected rate, and contact details to:
📧 [email protected]
Please apply only if you are a U.S. Citizen or Green Card Holder and are available to work in a Hybrid model in New York, NY.

More information

Minimum education level

Bachelor's

Experience level

Expert and leadership (9+years)

Job skills

Apache Spark

Data Warehousing

ETL Processes

SQL

Cloud Computing

Data Modeling

Python

Scala

Company overview

Totalebiz

Technology, Information and Internet·51-200 employees

Welcome to TOTAL eBIZ LLC, a specialized consulting firm delivering expert implementation, configuration, optimization, and support services across the IBM Sterling B2B ecosystem. We help organizations modernize and secure their electronic data interchange (EDI) environments while improving operational efficiency, scalability, and compliance. With deep expertise in complex enterprise integrations, we provide hands-on solutions for IBM Sterling platforms—ensuring seamless connectivity between trading partners, internal systems, and mission-critical infrastructure. From architecture design and system deployment to performance tuning, troubleshooting, and knowledge transfer, our approach is practical, results-driven, and tailored to each client’s business objectives. In addition to consulting services, TOTAL eBIZ LLC serves as a strategic recruitment partner, delivering top-tier technology talent for highly specialized roles. We connect organizations with proven experts who can strengthen integration teams, accelerate projects, and solve complex technical challenges. Headquartered in Sugar Land, Texas, USA, TOTAL eBIZ LLC supports clients nationwide with enterprise-grade solutions and trusted expertise.