Data Engineer II

You will build and optimise scalable, maintainable, and high-performance data pipelines and workflows. You will ingest, transform, and deliver high-volume data from structured and unstructured sources, including MySQL databases and real-time Kafka streams. You will design and maintain performant data models in Redshift and optimise SQL queries to support analytics and reporting. You will contribute to the migration from on-premises systems to AWS cloud and help evolve the data architecture with new ideas and improvements. You will collaborate with cross-functional, globally distributed teams to translate business requirements into robust technical solutions. You will embed data quality, reliability, observability, and security as first-class principles across the data platform, support data solutions operating in a mission-critical payments environment, and continuously learn and share knowledge to raise standards across data governance, quality, and security practices.

Responsibilities

  • Build and optimise scalable, maintainable, and high-performance data pipelines and workflows
  • Ingest, transform, and deliver high-volume data from structured and unstructured sources, including MySQL databases and real-time Kafka streams
  • Design and maintain performant data models in Redshift and optimise SQL queries to support analytics and reporting workloads
  • Contribute to the cloud migration journey and help evolve the data architecture with new ideas and improvements
  • Collaborate with cross-functional, globally distributed teams to translate business requirements into robust technical solutions
  • Embed data quality, reliability, observability, and security as first-class principles across the data platform
  • Support and enhance data solutions operating in a mission-critical payments environment
  • Continuously learn, share knowledge, and help raise standards across data governance, quality, and security practices

Requirements

  • Minimum 4 years of professional experience in Data Engineering or a related role
  • Strong SQL expertise, including query optimisation, complex transformations, and data modelling
  • Solid Python skills for data engineering and pipeline development
  • Hands-on experience with AWS services such as Redshift, Lambda, Glue, and S3, as well as Airflow for orchestration
  • Familiarity with modern transformation and modelling practices using tools such as dbt
  • Collaborative mindset, strong problem-solving skills, critical thinking, and willingness to take ownership and initiative
  • Nice to have: experience contributing to large-scale cloud migration initiatives
  • Nice to have: knowledge of real-time data streaming using Kafka
  • Nice to have: exposure to CI/CD pipelines and infrastructure-as-code for data platforms
  • Nice to have: interest in exploring AI/ML use cases within modern data ecosystems
  • Nice to have: understanding of the payments domain or fintech data challenges

Benefits

  • Performance bonuses
  • Sales commissions
  • Equity for specific roles
  • Recognition programs
  • Medical coverage
  • 24/7 employee assistance program
  • Generous vacation programs including year-end shut down
  • Flexible hybrid working environment (3 days per week in the office)
  • Role-specific training
  • Internal workshops
  • Learning stipend
  • Company-wide social events, team bonding activities, happy hours, and team offsites

See also

要針對這個職缺調整履歷嗎?

目前無法檢查您與這個職缺的符合程度;請先將履歷加入個人檔案,下次即可查看。

A new version of freehire is available