Senior Data Integration Developer (Maternity Cover)

Data Integration team - Senior Data Integration Developer - 12-month FTC

Role overview:

Working with a wide array of tools, you will work through the full, streaming, enrichment & curation of data into a cloud-based data environment, verifying data, and making sure that links to other key data sets are obtained to allow for simple, effective data analysis for our insight team and data scientists.

The role will involve you both engineering data solutions and managing more junior team members working on wider projects.

Responsibilities:

Assisting in the automation & maintenance of pipelines within a cloud-based environment, the candidate would also be involved in the sourcing of data using a range of different methods, whilst carrying out verification that the data is acceptable for ingestion.

• Analysis of large data sets using tools such as Python & SQL
• Setting up new pipelines for the full stream/enrichment/curation process
• Upkeep of source code locations

 

Role objectives and KPI’s:

• Analysis of large data sets using tools such as Python & SQL
• Creation stream/enrichment/curation process utilising a wide variety of data sources
• Upkeep of source code locations/Git Hub Repositories
• Set up of tables/views/procedures
• Data aggregation & manipulation
• Building of large scale analytical data sets
• Investigation of new/alternative technology
• Managing team members and supporting their development

 

Competencies and behaviours:

• Deciding and Initiating Action
• 2.1 Working with People
• 3.1 Relating and Networking
• 4.2 Applying Expertise and Technology
• 5.1 Learning and Researching
• 6.1 Planning and Organising
• 8.1 Achieving Personal Work Goals and Objectives

 

Skills and Experience:

Extensive hands-on experience with Google Cloud Platform (GCP), including cloud storage, BigQuery and related data services.

Proven experience using Cloud Run and Python to design, build and automate data workflows with GCP

Experience managing a wider team of Data Integration Developers / Data Engineers and ensuring they deliver against plans

Ability to decide on the overall concept and vision 

Creating road maps 

Experience of Pyspark coding or equivalent

Excellent problem solving skills

Strong attention to detail

Strong stakeholder management

Strong communication skills