Ihre aktuelle Jobsuche

Role: GCP data engineer

Description:

Role entails building and supporting data pipelines of which must be scalable, repeatable and secure. This role functions as a core member of an agile team whereby these professionals are responsible for the infrastructure that provides insights from raw data, handling and integrating diverse sources of data seamlessly. They enable solutions, by handling large volumes of data in batch and real-time by leveraging emerging technologies from both the big data and cloud spaces.

Additional responsibilities include developing proof of concepts and implements complex big data solutions with a focus on collecting, parsing, managing, analysing and visualising large datasets. They know how to apply technologies to solve the problems of working with large volumes of data in diverse formats to deliver innovative solutions. Data Engineering is a technical job that requires substantial expertise in a broad range of software development and programming fields.

These professionals have a knowledge of data analysis, end user requirements and business requirements analysis to develop a clear understanding of the business need and to incorporate these needs into a technical solution. They have a solid understanding of physical database design and the systems development lifecycle.



Responsibilities

* Architects Data analytics framework
* Translates complex functional and technical requirements into detailed architecture, design, and high performing software
* Leads Data and batch/real-time analytical solutions leveraging transformational technologies
* Works on multiple projects as a technical lead driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
* Development and Operations
* Database Development and Operations
* Policies, Standards and Procedures
* Business Continuity & Disaster Recovery
* Research and Evaluation
* Creating data feeds from on-premise to AWS Cloud
* Support data feeds in production on break fix basis
* Creating data marts using Talend or similar ETL development tool
* Manipulating data using python
* Processing data using the Hadoop paradigm particularly using EMR, AWS's distribution of Hadoop
* Develop for Big Data and Business Intelligence including automated testing and deployment

Join a forward-thinking organisation as an AWS Data Engineer, where you will play a crucial role in leveraging cloud technologies to drive data-driven insights.

This permanent, hybrid position is ideal for a motivated individual who is eager to work with cutting-edge technologies. You will have the opportunity to engage with a diverse range of AWS products including AWS DevOps, AWS IaaS, AWS Data, and AWS AI & Machine Learning.

Required skills include:

- Proficiency in AWS and AWS Big Data technologies
- Experience as an AWS Developer and in AWS DevOps
- Background in Big Data Engineering and Data Engineering
- Strong analytical and problem-solving skills
- Effective communication and collaboration abilities

The right candidate will have a passion for innovation, a dedication to fostering an inclusive environment, and a commitment to driving impactful solutions through data.

If you are ready to make a meaningful contribution in a role that values collaboration and adaptability, we encourage you to apply. This position offers core benefits that enhance your professional journey and support work-life balance.

The Data Engineer's role entails building and supporting data pipelines of which must be scalable, repeatable and secure. This role functions as a core member of an agile team whereby these professionals are responsible for the infrastructure that provides insights from raw data, handling and integrating diverse sources of data seamlessly. They enable solutions, by handling large volumes of data in batch and real-time by leveraging emerging technologies from both the big data and cloud spaces. Additional responsibilities include developing proof of concepts and implements complex big data solutions with a focus on collecting, parsing, managing, analysing and visualising large datasets. They know how to apply technologies to solve the problems of working with large volumes of data in diverse formats to deliver innovative solutions. Data Engineering is a technical job that requires substantial expertise in a broad range of software development and programming fields. These professionals have a knowledge of data analysis, end user requirements and business requirements analysis to develop a clear understanding of the business need and to incorporate these needs into a technical solution. They have a solid understanding of physical database design and the systems development lifecycle.



Responsibilities



* Architects Data analytics framework
* Translates complex functional and technical requirements into detailed architecture, design, and high performing software
* Leads Data and batch/real-time analytical solutions leveraging transformational technologies
* Works on multiple projects as a technical lead driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
* Development and Operations
* Database Development and Operations
* Policies, Standards and Procedures
* Business Continuity & Disaster Recovery
* Research and Evaluation
* Creating data feeds from on-premise to AWS Cloud
* Support data feeds in production on break fix basis
* Creating data marts using Talend or similar ETL development tool
* Manipulating data using python
* Processing data using the Hadoop paradigm particularly using EMR, AWS's distribution of Hadoop
* Develop for Big Data and Business Intelligence including automated testing and deployment



Requisite Experience, Education, Knowledge and/ or Skills



* Bachelor's Degree in Computer Science, Computer Engineering, or equivalent
* AWS Certification
* Extensive knowledge in different programming or scripting languages
* Expert knowledge of data modelling and understanding of different data structures and their benefits and limitations under particular use cases
* Capability to architect highly scalable distributed systems, using different open source tools
* 5+ years Data engineering or software engineering experience
* 2+ years Big Data experience
* 2+ years' experience with Extract Transform and Load (ETL) processes
* 2+ years AWS experience
* 5 years demonstrated experience with object-oriented design, coding and testing patterns as well as experience in engineering (commercial or open source) software platforms and large-scale data infrastructures
* Big Data batch and streaming tools
* Talend
* AWS: EMR, EC2, S3
* GCP Cloud, BigQuery
* Python
* PySpark or Spark

We are looking for a skilled Data Scientist/ Data Analytics Engineer to enhance our data infrastructures and support our AI and machine learning initiatives across various cloud platforms, including AWS and Azure. In this role, you will be integral to developing data pipelines and analytics solutions that directly impact business performance, while collaborating with cross-functional teams in a hybrid work setup of 2 days on site.

* Proficient in AWS services such as Redshift, S3, and Lambda, as well as GCP analytics tools
* Solid experience with data warehouse design and implementation
* Expertise in programming languages, preferably Python or SQL
* Familiarity with machine learning algorithms and their practical applications
* Understanding of data governance and compliance regulations

This hybrid position offers a chance to contribute to innovative projects while enjoying a balanced work-life dynamic. Core benefits include a 'Pension' Retirement Savings Plan/401(K) Match/Pension Contributions. If you are ready to make a substantial impact in data engineering, we encourage you to apply.

Data Science Contract

Key Responsibilities

* Support the development, deployment, and optimisation of predictive analytics and machine learning solutions that drive business value.
* Analyse large and complex datasets to uncover trends, patterns, and actionable insights.
* Monitor, evaluate, and improve model performance to ensure accuracy, scalability, and reliability.
* Partner with business and technical stakeholders to understand requirements and translate them into analytical solutions.
* Design and execute experiments, proof-of-concepts, and analytical studies to validate assumptions and measure business impact.
* Contribute to the continuous improvement of data-driven decision-making processes across the organisation.

Requirements

Education

* Bachelor's degree in Data Science, Computer Science, Mathematics, Statistics, Physics, Engineering, or a related quantitative field.

Experience

* 6+ years experience

Technical Skills

* Strong SQL skills for data extraction, transformation, and analysis.
* Proficiency in Python for data analysis, machine learning, and automation.
* Experience creating dashboards and visualisations using modern BI tools (e.g., Power BI, Tableau, or similar).
* Exposure to cloud-based data and analytics platforms such as Azure, AWS, GCP, Databricks, or equivalent technologies.
* Understanding of statistical modelling, predictive analytics, and machine learning concepts.

Additional Requirements

* Strong analytical and problem-solving skills.
* Excellent communication skills with the ability to present technical findings to both technical and non-technical audiences.
* Fluent written and spoken English.

2 days a week in office in Sandton.

Up to R 650 per hour