Data Engineer - Azure

Data Engineer - Automotive

We are looking for a skilled Data Engineer to help design and build the next generation of data platforms that power large-scale telematics, IoT, and fleet-management systems. In this role, you will work with high-volume, real-time data generated from connected devices, vehicles, sensors, and safety systems, and help transform this data into reliable, accessible, analytics-ready products.

You will play a key part in modernising our data ecosystem across Azure and AWS, enabling scalable ingestion, advanced analytics, machine learning, and real-time operational insights for internal teams and enterprise clients.

What You'll Do

Core Responsibilities

* Design and build cloud-native data pipelines for high-velocity telematics and IoT data using Azure and AWS services.
* Develop and maintain data lake / lakehouse architectures (S3, ADLS, Delta Lake, Iceberg).
* Implement streaming and batch processing frameworks using tools such as Spark, Databricks, Kinesis, Event Hub or Kafka.
* Build reliable ETL/ELT jobs for preparing and curating bronze/silver/gold datasets.
* Support real-time analytics, including geofencing, driver behaviour analysis, alerting, and operational monitoring.
* Create and maintain data APIs, microservices, and integrations for internal teams and external partners.
* Work closely with ML engineers to enable feature stores, training datasets, and productionised ML workflows.
* Implement robust data governance, POPIA compliance, lineage, and access controls across the data environment.
* Participate in the modernisation and migration of legacy data systems to cloud platforms.
* Optimise for reliability, cost efficiency, performance, and scalability.

What You'll Bring

Essential Skills

* Experience building data platforms on both Azure and AWS.
* Strong skills in Python, SQL, and distributed processing frameworks (e.g., Spark).
* Hands-on expertise with:

* Azure Data Factory, Event Hub, Databricks, ADLS
* AWS Glue, S3, Lambda, Kinesis, API Gateway

* Experience with streaming architectures and real-time data processing.
* Understanding of data lakehouse design, metadata management, and data modelling.
* Familiarity with IoT or telematics-style data (high-volume events, time-series data) is a strong advantage.

Nice to Have

* Knowledge of containerisation (Docker, Kubernetes).
* Experience with infrastructure-as-code (Terraform, CloudFormation, Bicep).
* Exposure to ML pipelines, driver scoring, or predictive maintenance models.
* Background in fleet, IoT, logistics, telecoms, or similar data-heavy industries.

What We Offer

* Work on high-impact, real-time data systems used by thousands of businesses and millions of devices.
* Opportunities to innovate within cloud, IoT, telematics, and AI-driven analytics.
* A modern engineering environment with autonomy, collaboration, and continuous learning.
* Competitive salary, benefits, and growth opportunities.