• Lieu: Edinburgh, Scotland
  • Date de publication: 24th Mar, 2021
  • Référence: DMA309485JFI

Data Manager - Edinburgh


Up to £70k DOE



As Manager with our Data Engineering group, you will be responsible for leading our Data Engineering and Data Analysts. You will architect, design, estimate, developing and deploy cutting edge software products and services that leverage large scale data ingestion, processing, storage and querying, in-stream & batch analytics for Cloud and on-prem environments.


Your role will be focused on delivering high quality solutions while driving design discussions across Data Engineering topics (ingestion, consumption, storage, computation, data models, performance, DevOps, Test automation & Security).


As a hands-on technologist you will be excited to join super talented and supportive community of Data Engineers who are passionate about building the best possible solutions and endorse a culture of life-long learning and collaboration.



What You'll Bring



  • Extensive experience with Data related technologies, to include knowledge of Big Data Architecture Patterns and Cloud services ideally AWS but Azure / GCP will considered.

  • Experience delivering end to end Big Data solutions on premise and/or on Cloud

  • Knowledge of the pros and cons of various database technologies like Relational, NoSQL, MPP, Columnar databases

  • Expertise in one or more NoSQL database (Mongo DB, Cassandra, HBase, DynamoDB, Big Table etc.)

  • Experience of one or more big data ingestion tools (Sqoop, Flume, NiFI etc.), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub etc.)

  • Expertise in the Hadoop eco-system with one or more distribution-like Cloudera and cloud specific distributions

  • Expertise with at least one distributed data processing framework e.g. Spark (Core, Streaming, SQL), Storm, Flink etc.

  • Experience building DevOps pipelines for data solutions, including automated testing


You'll Also Likely Have Some Of The Following



  • Knowledge of containerization, orchestration and Kubernetes engine

  • An understanding of how to setup Big data cluster security (Authorization/ Authentication, Security for data at rest, data in transit)

  • A basic understanding of how to manage and setup Monitoring and alerting for Big data clusters

  • A certification in one or more cloud platforms or big data technologies

  • Any active participation in the Data Engineering thought community (e.g. blogs, key note sessions, POV/POC, hackathon)


To apply or more info contact o.king@nigelfrank.com or call 0191 814 7785.


Emplois similaire

Senior IT Supplier Manager - Edinburgh / Remote
Edinburgh, Scotland

DevOps Engineer
Edinburgh, Scotland

Lead DevOps Engineer
Edinburgh, Scotland

Azure DevOps Engineer - Edinburgh
Edinburgh, Scotland

Azure DevOps Engineer - Glasgow
Glasgow, Scotland