Data Engineering Lead (GCP, Bigquery, ETL, Prompt Engineering) Associate Director
Summary
Lead a data engineering squad at HSBC building and operating batch/streaming data pipelines on GCP/BigQuery, owning data platform architecture, governance, lineage, FinOps, CI/CD, monitoring, and ETL/ELT delivery while coaching engineers.
- Coach and develop data engineers
- Define data modelling approaches
- Define non-functional testing strategy
- Design batch and streaming pipelines
- Drive CI/CD and automated testing
- Drive FinOps cost optimization
- Ensure service resilience and recovery objectives
- Establish metadata strategy
- Implement data governance and lineage
- Implement orchestration and scheduling
- Lead ELT/ETL pipeline development
- Lead incident problem management
- Manage encryption access control and auditability
- Manage squad and vendor dependencies
- Optimize analytical query performance
- Own data platform architecture
- Perform code reviews and release governance
- Set up monitoring and alerting
- Track KPIs using DORA metrics
- Translate requirements into delivery plans
Perks/Benefits:
- Flexible working
- Inclusive diverse workplace
- Professional development opportunities