Databricks Developer

Databricks Developer

We are seeking a skilled Databricks Developer to join our Data Development team. Reporting to the Team Lead, the role focuses on implementing robust data pipelines using Apache Spark on Databricks, supporting advanced data transformation, and enabling scalable data products that serve enterprise analytics and reporting needs.

Responsibilities

• Design, build, and maintain scalable data pipelines and workflows using Databricks (SQL, PySpark, Delta Lake).
• Develop efficient ETL/ELT pipelines for structured and semi-structured data using Azure Data Factory (ADF) and Databricks notebooks/jobs.
• Integrate and transform large-scale datasets from multiple sources into unified, analytics-ready outputs.
• Optimize Spark jobs and manage Delta Lake performance using techniques such as partitioning, Z‑ordering, broadcast joins, and caching.
• Design and implement data ingestion pipelines for RESTful APIs, ...