Senior Big Data Engineer

The job in a nutshell

Are you interested in an opportunity to utilise cutting edge capability in Big Data technologies to further build the foundations upon which GoCo Group can advance further benefit to the business? Are you keen to be an instrumental force in creating big data platforms and pipelines to give multiple businesses within GoCo Group access to data via data lakes and Big Data cloud tech?

Data is at the heart of everything we do at GoCo and you will work with a well established data team inclusive of data science, web analytics, data warehousing and data intelligence. You will be a key point of contact for stakeholders across the business to understand data requirements, data structures, data frequency and ingest the data models into the data lake. You will be able to build appropriate schemes to allow data teams to automate reporting. 

This role will involve you working on a blank canvass for a newly acquired GoCo Group business to integrate this into the wider group.

Skills and experience you’ll need to have

  • Educated to degree level and/or equivalent and relevant professional experience in Computer Science or related field.
  • Knowledge in big data cloud architectures with proven experience working with Microsoft Azure big data technologies e.g. data lakes, data factory etc.
  • Experience of several programming languages such as Python, Scala or Java.
  • Experience in data warehousing, within a data platform.
  • Strong background in data processing, software engineering design and data modelling concepts.
  • Good understanding of application life cycle management ideally using TFS or Visual Studio Online.
  • Strong communication skills to effectively partner with data scientists and engineering stakeholders.
  • Very good experience in gathering and analysing business requirements and translating them into solutions.
  • A track record of delivering solutions against challenging timescales with quality.
  • Ability to pick up new languages and technology quickly.

What you’ll be responsible for

  • Acts as subject matter expert for cloud data services, technically leading the company approach to big data solutions, designing and implementing cloud data services, as appropriate.
  • Leads on the migration, transformation, cleansing and ingesting of high volume data from the group into the Group Data Platform.
  • Creates reliable, distributed data pipelines and builds intuitive data products that allow our stakeholders to easily leverage data in a self-service manner.
  • Contributes to the group data platform roadmap, utilising the latest technologies, as required.
  • Designs and implements ETL strategies and solutions.
  • Works with data science team to ensure that data is appropriate for Machine Learning and Deep Learning work.
  • Designs, develops, configures, debugs/tests, implements, manages and documents BI solutions and processes.
  • Undertakes Data Transformation and tuning / optimisation of code and ensures all code is version controlled with work clearly documented and centrally located, enforcing coding standards & design styles across the team.
  • Provides technical oversight and coaching to the rest of the team for Cloud/Big data services including peer reviews of team members work as part of the release process.
  • Ensures the provision of a stable environment and continuity of service.
  • Identifies opportunities to automate tasks and deliver generic frameworks which can be leveraged by different technical teams.
  • Participates in the development of architectures, strategies, and policies around data governance; including master data management, metadata management, data quality and data profiling.

Who you’ll be working with

  • Works closely with the business to ensure clear understanding of data.
  • Works with business stakeholders to understand business needs and requirements and in keeping them informed of progress.
  • MyVoucherCodes team.
  • Data science team.
  • All 1tech team members.

About us

We’re on a mission to help people everywhere save time and money – whether that’s on essential outgoings or on the things that they enjoy.

If someone is looking for an insurance policy for the first time, wants to beat their renewal quote, is searching for the right financial product, or is after a great utility deal, our comparison website – GoCompare – is there to help. We work with trusted insurance providers, financial services organisations and partners to provide a real breadth of coverage across the market.

Through MyVoucherCodes we bring savings from thousands of fashion, retail, restaurant, entertainment, travel and tech brands to millions of people.

Energylinx, our Ofgem-accredited energy comparison and switching service, brings great energy deals from more suppliers than any other UK switching site to UK households and businesses.

And weflip, an automatic switching service that helps people save time and money by flipping them onto better energy tariffs, uses technology to bring a new, hands-off approach to staying on great deals, forever.

GoCompare embraces diversity and truly believe in equal opportunities for all. We believe that inclusion and diversity increases creativity, delivers innovation, improves performance and better serves our customers.

We truly believe in the ethos that companies with greater diversity perform better than those without. It is for these reasons that all qualified applicants will be considered for employment regardless of age, race, religion, genetic information, sexual orientation, gender identity, parental status, disability, educational background or any other characteristic for that matter that doesn’t relate to your ability to perform the role.

Benefits

GoCompare offer a competitive benefits package including:

  • Flexible working hours
  • Bonus
  • 25 days holidays plus bank holidays
  • Birthday day off
  • Death in service
  • Matched pension (up to 6%)
  • Private medical cover
  • Buy and sell holiday options
  • Extra holidays for length of service
  • Share save scheme
  • Enhanced maternity and paternity policies
Go for it
Salary:

Competitive

Location:

Newport

Job Reference:

gocompare/TP/41/209

Closing date:

30th June 2019

Contract details:

Permanent

Working hours:

37.5 hours per week

Go for it