• Location: Houston, Texas
  • Date Posted: 4th Nov, 2021
  • Reference: 9958263DG

Lead Senior Data Engineer


  • Responsible for data engineering, data analysis, and end user support

  • Experience working with Azure Databricks and Cloudera Hadoop

  • Deep understanding of Python and Scala languages

  • Able to design, develop, and maintain highly scalable cloud based processing

  • Experience writing efficient, reusable and well documented code

  • Deliver big data projects using Databricks, Data Factory and other Azure services

  • 7 years experience of software development and design

  • 2 years experience leading a team of software developers

  • Experience developing and tuning Spark applications using Databricks

  • Deep understanding of Spark architecture, Spark SQL, data frames and tuning big data spark applications

  • StrongPython, Scala, SQL and Shell scripting

  • Hands-on experience working with Microsoft Azure

  • Strong understanding of Database Design and Data Modelling

  • Any experience in Synapse, Snowflake or Google BigQuery is a plus

Similar Jobs

QA Engineering Manager
Houston, Texas