Lead Data Engineer, Technology Consulting- London, Leeds, Manchester or Newcastle

Summary

Lead data engineer at a technology consultancy building AI-enabled data platforms on AWS for clients across regulated industries. Designs data lakes, lakehouses and pipelines using Spark, Python, SQL and AWS services, and delivers ML, GenAI and LLM solutions with MLOps and IaC practices.

Agency:

Credera

Job Function:

Consulting

Job Subfunction:

Technology Consulting

Job Description:

Would you like to be part of a fast-growing technology and engineering organisation that nurtures an open, collaborative learning environment? Are you passionate about technology, people and developing your coding skills? If this describes you, we’re trying to create the best engineering consultancy in the UK and would love for you to be part of the journey.

We draw on our reputation for outstanding delivery to allow our engineers to do the right thing for our clients, and not necessarily the easy thing. Innovation is in our DNA, and we encourage our engineers and consultants to work together to rethink conventional wisdom on how problems should be solved.

Our engineers take a holistic approach that addresses technology, process, and structure to make a lasting impact.

At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power machine learning, Generative AI and Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies.

Based out of any of our UK offices, this is a permanent role within our Data Function. At Credera, we operate a flexible hybrid working model. This requires 3 days per week working onsite - either at client site (as required) or in your local Credera office (London, Manchester, Leeds or Newcastle). We value collaboration and client impact, so our hybrid model is designed to strike a balance between flexibility, in-person connection, and delivering exceptional outcomes for our clients.

Requirements

As a Lead Engineer at Credera, you will spend most of your time on client work, with the remainder of your time spent working on internal projects as well as training and development. Consultancy to us is about customer delivery first, carried out by technically excellent people. Our aim is not to pigeon-hole but rather upskill our engineers so they can learn and expand their expertise, as well as deliver on a variety of business-critical client projects.

You are perceptive, personable, culturally sensitive and demonstrate a high degree of emotional intelligence. Being able to work collaboratively in a matrix organisation is essential, as is the ability to build data platforms using either cloud native products or commercial data analytics / data warehouse software.

You will have:

  • Accountable for leading multiple, complex areas of data engineering delivery to time, cost and quality with minimal direction
  • Experience effectively and inclusively managing teams to deliver agreed scope, acting as the key point of escalation for decisions that impact your area of work
  • Demonstrable experience of building data pipelines using Spark, Python or SQL
  • Experience working with AWS and its data and AI/ML services such as SageMaker
  • Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake)
  • Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads
  • Understanding of Data Security, Data Governance and responsible AI principles
  • The ability to partner with and influence senior stakeholders, building trust across the stakeholder landscape to drive the delivery of outcomes
  • A track record of anticipating the risk landscape across a project and standing up multi-functional teams of SMEs to analyse and resolve issues
  • Recognised as a subject matter expert who drives innovation and market-leading practices, bringing knowledge and experience from multiple clients and industries
  • Have a drive for self-improvement and learning, including learning new programming languages
  • Approach solving problems pragmatically, creating clarity and structure in ambiguous situations
  • Experience productionising and operating data and AI/ML solutions, including Generative AI or LLM-based applications
  • Experience coaching and mentoring engineers, putting in place structured development opportunities to build the capability of junior team members and client counterparts
  • You will be required to hold active SC clearance for this role.

Desirable skills

  • Experience of building automated data quality checks and metrics
  • Experience creating and/or maintaining production software delivery pipelines using common CI/CD tools (GitHub Actions, Azure DevOps, Jenkins, CircleCI etc.)
  • Experience building LLM or foundation-model applications using frameworks such as LangChain, vector databases or agentic AI approaches
  • Experience with MLOps and Infrastructure as Code (Terraform, CloudFormation etc.) for data, analytics and AI services
  • Experience with data reporting and visualisation tools (Power BI, Tableau, Qlik etc.)
  • Experience using AI or Agentic techniques in application of the role through GitHub CoPilot, Claude Code, or equivalent.

Benefits

Along with a great company culture, Credera provides an exceptional compensation package (£84,000-100,000) including a competitive salary and a comprehensive benefit plan.

Our consistent growth over the years and entrepreneurial environment, provides an excellent platform to embark upon an exciting career path, where your contribution really counts, and we will recognise it. With personalised development opportunities, experienced colleagues around the globe and exciting client assignments, progression can be extremely rapid for high performers. We are a social bunch of people and connect as a team on a regular basis.

Learn More

Credera is a global consulting firm that combines transformational consulting capabilities, deep industry knowledge, and AI and technology expertise to deliver valuable customer experiences and accelerated growth across a broad range of industries worldwide. Our one-of-a-kind global boutique approach means we provide our clients with tailored solutions unique to their organisation that can scale due to our extensive footprint. As a values-led organisation, our mission is to make an extraordinary impact on our clients, our people, and our community. We believe it is this approach that has allowed us to work with and transform the most influential brands and organisations in the world, from strategy through to execution.

We are part of the OPMG Group of Companies, a division of Omnicom Group Inc. Credera will never ask for money up front and will not use apps such as Facebook Messenger, WhatsApp or Google Hangouts for communicating with you. You should be very wary of, and carefully scrutinise, any job opportunity that asks for money prior to starting and/or one where all communications take place exclusively via chat.





Omnicom’s policy requires employees to work in the office for a minimum of three days a week, unless additional in-office days are directed by their agency or manager. Our objective is to increase this requirement over time, and many of our agencies as well as Omnicom’s corporate group already require five days of in-office attendance.


Omnicom is committed to hiring and developing exceptional talent. We agree that talent is uniquely distributed, and we’re focused on developing inclusive teams that can bring the best solutions to everything we do. We strongly believe that celebrating what makes us different makes us better together. Join us—we look forward to getting to know you. We will process your personal data in accordance with our Recruitment Privacy Notice.


Link to Recruitment Privacy Notice:

See also

要針對這個職缺調整履歷嗎?

目前無法檢查您與這個職缺的符合程度;請先將履歷加入個人檔案,下次即可查看。

A new version of freehire is available