Data Engineer

Nikhil B

nttdata · Consultant

Active within past 3 days

Job description

Responsibilities:

Design and implement end-to-end data pipelines using Python and PySpark to ensure efficient data processing.
Utilize Databricks for data engineering tasks, optimizing performance and scalability.
Troubleshoot and resolve pipeline issues in Databricks, ensuring minimal downtime and data integrity.
Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
Monitor and maintain data pipeline performance, making improvements as necessary.

Qualifications:

Proficiency in Python and PySpark for data manipulation and analysis.
Experience with Databricks for building and managing data pipelines.
Strong problem-solving skills, particularly in troubleshooting data pipeline issues.
Familiarity with data warehousing concepts and ETL processes.
Excellent communication skills for effective collaboration with cross-functional teams.

More information

Job skills

Data Modeling

ETL Processes

SQL

Big Data Technologies

Data Warehousing

Python

Apache Spark

Cloud Computing

Company overview

nttdata

IT Services and IT Consulting·5,001+ employees

NTT DATA – a part of NTT Group – IT and business services headquartered in Tokyo. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. NTT DATA enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term success and combine global reach with local client attention to serve them in over 50 countries around the globe.