Ref.: lm0718detpa_1658177114

100% Remote Data Engineer


Descripción del puesto

100% Remote Data Engineer


Data Engineer

Permanent, Full Time

100% Remote

$140k - $175k Salary

Duties and Responsibilities

Design and develop Systems including operational requirements and infrastructure setup in an Agile software development paradigm

Quickly learn new technologies and produce proof of concepts, specially using AWS, Big Data and Open-Source technologies

Work on high priority production support issues, troubleshoot and formulate solutions for those issues in a time sensitive manner

Develop processes to make Operations more manageable and robust, including code refactoring and tuning performance. Analyze existing systems and create technical documentation

Qualifications & Requirements

5+ years of solid hands-on software development experience with focus on backend technologies and large volume distributed data processing including production support

Bachelor's Degree in computer science or similar discipline

Expertise in building backend systems using AWS Redshift, AWS EMR, SQL Server, PostgreSQL

Expertise in AWS development. AWS Developer Certified is preferred

Experience in building systems using programming language like SQL, Python and Scala

Knowledge of Tableau, Time series databases, Data Lakes, Docker, AWS EKS (Kubernetes), Airflow will be pluses, but not required

Must be knowledgeable in Data Warehousing, Big Data Analytics and Distributed data processing

Databases - AWS Redshift, PostgreSQL, MS SQL Server; Familiarity with Timescale, Elastic Search/MongoDB

Programming Languages - SQL, Python; exposure to JAVA

Exposure to Tools - AWS - EMR, Lambda, EKS; Apache - Spark, Scala, Airflow; Talend, Tableau

Strong System analysis, design, and development skills in an Agile environment