Databricks SC Cleared Data Engineer

Contract: Outside IR35
Location: UK‑based, Hybrid / Remote
Clearance: Active SC clearance required (minimum)
Start: June
Day Rate: Competitive market rates

Overview

We are recruiting a contract Databricks Data Engineer for a large‑scale UK Government programme delivering critical, cloud‑native data platforms. This is a long‑term engagement within a high‑profile public sector transformation, working with sensitive, mission‑critical data at national scale.

You must already hold active SC clearance to be considered.

Responsibilities

• Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL)
• Implement Delta Lake / Lakehouse architectures (Bronze, Silver, Gold)
• Develop scalable ELT/ETL workflows for batch and streaming data
• Optimise performance, reliability and c...