Lead Data Engineer

Lead Data Engineer - Remote - AWS - Databricks - up to £110,000

I am working with a client specialising in AI‑driven learning platform used by enterprise clients across the globe. They are scaling fast, innovating constantly, and they are investing heavily in data engineering as a core pillar of the business. This is the kind of environment where a strong engineer can genuinely influence direction, modernise the stack, and build things the right way.

If you want to lead real transformation, drive architectural decisions, and work in a company where data is at the heart.



Your work will include:

* Leading the adoption of Databricks and building a modern Lakehouse architecture.
* Designing and implementing AWS‑native ETL pipelines using S3, Glue, Athena, Step Functions.
* Building scalable, ACID‑compliant datasets using Apache Iceberg.
* Running cost‑efficiency initiatives across Redshift and broader AWS services.
* Consolidating fragmented environments into a secure, multi‑tenant data platform.
* Implementing automated data quality and validation workflows.
* Establishing platform‑wide security baselines (encryption, deletion policies, access control).
* Working cross‑functionally with product, sales, and operations teams to deliver high‑value data products.
* Mentoring junior engineers and shaping the data engineering culture as the team grows.



Benefits

* Competitive salary + performance‑aligned progression
* Hybrid working with flexibility around Cambridge HQ
* Opportunity to define and own the data engineering roadmap
* A collaborative, mission‑driven team using cutting‑edge tooling
* Exposure to AI‑powered learning technologies and large‑scale enterprise deployments
* Clear path for leadership and technical authority as the team expands



Key Experience

* 5+ years in data engineering, including experience in a senior or lead position
* Strong expertise across AWS
* Hands‑on experience with Databricks, PySpark, and Lakehouse patterns
* Strong Python and SQL engineering ability
* Experience implementing scalable ETL/ELT pipelines
* Background in data modelling and building analytics‑ready datasets
* Understanding of security best practices and compliance‑driven architecture
* Ability to influence, mentor, and collaborate with stakeholders across the business



Ready to take ownership and shape the future of data at a fast‑growing AI company?

This is a high‑impact role with real influence and roles at this level don't stay open for long.

Apply now or send your CV directly!