Senior Big Data Engineer

The job in a nutshell

Are you interested in an opportunity to utilise cutting edge capability in Big Data technologies to further build the foundations upon which GoCo Group can advance further benefit to the business? Are you keen to be an instrumental force in creating big data platforms and pipelines to give multiple businesses within GoCo Group access to data via data lakes and Big Data cloud tech?

Data is at the heart of everything we do at GoCo and you will work with a well established data team inclusive of data science, web analytics, data warehousing and data intelligence. You will be a key point of contact for stakeholders across the business to understand data requirements, data structures, data frequency and ingest the data models into the data lake. You will be able to build appropriate schemes to allow data teams to automate reporting. 

This role will involve you working on a blank canvass for a newly acquired GoCo Group business to integrate this into the wider group

Skills and experience you’ll need to have

  • Knowledge in big data cloud architectures with proven experience working with Microsoft Azure big data technologies e.g. data lakes, data factory etc.
  • Experience of several programming languages such as Python, Scala or Java.
  • Experience in data warehousing, within a data platform.
  • Strong background in data processing, software engineering design and data modelling concepts.
  • Good understanding of application life cycle management ideally using TFS or Visual Studio Online.
  • Strong communication skills to effectively partner with data scientists and engineering stakeholders.
  • Very good experience in gathering and analysing business requirements and translating them into solutions.
  • A track record of delivering solutions against challenging timescales with quality.
  • Ability to pick up new languages and technology quickly.

What you’ll be responsible for

  • Acts as subject matter expert for cloud data services, technically leading the company approach to big data solutions, designing and implementing cloud data services, as appropriate.
  • Leads on the migration, transformation, cleansing and ingesting of high volume data from the group into the Group Data Platform.
  • Creates reliable, distributed data pipelines and builds intuitive data products that allow our stakeholders to easily leverage data in a self-service manner.
  • Contributes to the group data platform roadmap, utilising the latest technologies, as required.
  • Designs and implements ETL strategies and solutions.
  • Works with data science team to ensure that data is appropriate for Machine Learning and Deep Learning work.
  • Designs, develops, configures, debugs/tests, implements, manages and documents BI solutions and processes.
  • Undertakes Data Transformation and tuning / optimisation of code and ensures all code is version controlled with work clearly documented and centrally located, enforcing coding standards & design styles across the team.
  • Provides technical oversight and coaching to the rest of the team for Cloud/Big data services including peer reviews of team members work as part of the release process.
  • Ensures the provision of a stable environment and continuity of service.
  • Identifies opportunities to automate tasks and deliver generic frameworks which can be leveraged by different technical teams.
  • Participates in the development of architectures, strategies, and policies around data governance; including master data management, metadata management, data quality and data profiling.

Who you’ll be working with

  • Works closely with the business to ensure clear understanding of data.
  • Works with business stakeholders to understand business needs and requirements and in keeping them informed of progress.
  • MyVoucherCodes team / AutoSave team
  • Data science team.
  • Wider tech team members.

About us

We’re on a mission to help people everywhere save time and money – whether that’s on essential outgoings or on the things that they enjoy.

If someone is looking for an insurance policy for the first time, wants to beat their renewal quote, is searching for the right financial product, or is after an outstanding utility deal, our comparison website – GoCompare – is there to help. We work with trusted insurance providers, financial services organisations and partners to provide a real breadth of coverage across the market.

Through MyVoucherCodes we bring savings from thousands of fashion, retail, restaurant, entertainment, travel and tech brands to millions of people.

Look After My Bills is a leading automated energy savings service. The free service cuts customers’ gas and electricity bills without them having to do a thing. Customers sign up once and Look After My Bills seeks to get them the best deal they can from an energy supplier they trust with good customer service. When that deal ends they automatically switch customers on to another.

Our Platform Services business partner with third party brands so that they can offer savings opportunities to their customers. godemand is a cloud based SaaS platform that will allow any market-vertical, be it broadband, energy, insurance, rewards and more, to be introduced by a third-party website or app on-demand.

Being your authentic self at work is vital to success

GoCompare embraces diversity and truly believe in equal opportunities for all. We believe that inclusion and diversity increases creativity, delivers innovation, improves performance and better serves our customers.

We truly believe in the ethos that companies with greater diversity perform better than those without. It is for these reasons that all qualified applicants will be considered for employment regardless of age, race, religion, genetic information, sexual orientation, gender identity, parental status, disability, educational background or any other characteristic for that matter that doesn’t relate to your ability to perform the role.


GoCompare offer a competitive benefits package including:

  • Flexible working hours
  • Bonus
  • 25 days holidays plus bank holidays
  • Birthday day off
  • Death in service
  • Matched pension (up to 6%)
  • Private medical cover
  • Buy and sell holiday options
  • Extra holidays for length of service
  • Share save scheme
  • Enhanced maternity and paternity policies
Go for it

Up to £70,000 plus benefits (Flexible working, bonus etc.)


Newport / Remote

Job Reference:


Closing date:

31st December 2020

Go for it