Data Engineer

at WHD Consulting Ltd
Published March 11, 2023
Location Maidenhead, United Kingdom
Category Data Science  
Job Type Full-time  

Description

We are looking for a Data Engineer with experience building and maintaining data pipelines, with knowledge of cloud data platforms and experience working alongside data scientists for the provision of data science solutions. This is a hybrid role and 2 days a week are required onsite in Maidenhead

Responsibilities

Engineering cloud-based data lake solutions to connect and leverage organisational and external data

Capture, process and store large volumes of data for multiple data science use cases

Support and evolve existing ETL and data pipeline solutions

Work collaboratively with architects and consultants to build data solutions that deliver the expected outcomes

Contribute to estimating activities

Contribute to comprehensive technical documentation that supports the deployment and administration of the solutions we build

Help to diagnose and fix issues in complex technical environments

Knowledge, Skills and Abilities

Experience building and managing robust and scalable data pipelines

Experience with ETL and ELT

Knowledge of processes and solutions for data distribution and data archiving

Strong SQL

Good knowledge of R

Knowledge of Python - desirable

Experience of Big Data platforms, particularly Snowflake and Databricks

Experience working in a cloud environment, particularly AWS

Exposure to and knowledge of data science and machine learning models and solutions

Experience working within an SDLC

Experience of Agile methodologies

Excellent oral and written communication

Multi-tasking and managing multiple priorities

Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience

Please apply today if this sounds of interest.