Cloud Data Engineer

Full-time
Remote within US
$45-50/hr
Supports visa sponsorship

Job description

Cloud Data Engineer – 5 Open roles
Remote
JD:
Minimum of 6+ years of experience as a Cloud Data Engineer.
Hands-on experience with Databricks, Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage), Apache Spark, PySpark and Snowflake.
Experience leading or participating in enterprise data warehouse modernization initiatives, migrating workloads from SQL Server, Oracle, Teradata, or other on-prem platforms to cloud-based data platforms.
Experience with Delta Lake and Lakehouse architectures and optimization techniques.
Strong experience in ETL development using on-premises databases and ETL technologies.
Experience with Python or other scripting languages for data processing.
Advanced SQL development and performance tuning experience.
Experience writing complex stored procedures, views, and ETL transformations
Experience with GitHub branching, pull requests, and GitHub Actions
Experience with code reviews and engineering best practices.
Experience implementing automated testing and data quality frameworks.
Experience working within Agile delivery methodologies.
Ability to adapt to new technologies and learn quickly.
Experience using AI-assisted development and automation tools to improve data engineering efficiency and productivity.
Excellent analytical, problem-solving, communication, and stakeholder management skills.
Demonstrated ability to work independently, manage ambiguity, and deliver high-quality solutions.
Demonstrated ability to work within tight deadlines and effectively raise critical issues.
Ability to travel, if needed, based on business needs and permissible travel conditions.


Preferred Qualifications:
Experience with other cloud platforms and data solutions.
Experience with data modeling and database design.
Experience implementing Bronze/Silver/Gold (Medallion) architecture patterns.
Experience designing scalable solutions.
Knowledge of data governance and data quality best-practices.
Experience with development in Snowflake for data engineering and analytics workloads.
Experience with healthcare payer data domains including Claims, Membership, Enrollment, Provider, Clinical, and Financial data.
Experience with Airflow or other orchestration frameworks.
Experience with performance optimization in Databricks and Snowflake.
Certification in Azure or Databricks.


More information

Minimum education level

Bachelor's

Job skills

Cloud Data Engineering

Databricks

Azure Cloud Tools

Apache Spark

Python

SQL Development

ETL Development

Data Quality

Agile Methodologies

GitHub

Certifications

Azure Certification

Databricks Certification

Languages

English

Company overview

company-logo
Agile Squad Inc

IT Services and IT Consulting·51-200 employees

Agile Squad Inc. is a New Jersey-based technology consulting firm helping businesses navigate digital transformation through expert-driven solutions in Generative AI, Cloud, Cybersecurity, and Software Engineering. We partner with forward-thinking organizations to solve complex challenges, accelerate innovation, and build future-ready systems. Our core strength lies in blending deep technical expertise with agile execution. Whether launching a new AI initiative, strengthening security infrastructure, or modernizing cloud architecture, we deliver tailored consulting services that drive measurable business outcomes. To support our consulting engagements—and help our clients stay flexible—we also provide specialized staffing and recruitment services, offering access to a pre-vetted network of high-impact IT professionals ready to make an immediate impact. Our unique hybrid model ensures that clients not only get the strategy—they get the people to make it real. 🚀 Our Services Include: 🔵 Strategic Technology Consulting 🔵 AI, Cloud, and Cybersecurity Solutions 🔵 Project-Based Delivery & Team Augmentation 🔵 Specialized IT Recruitment & Talent Placement 🔵 Visa Sponsorship, Payroll, and Compliance Support At Agile Squad, we don't just fill roles—we help you build what's next.