Engineering Manager, Data Engineering

Lead and develop a team of data engineers, provide technical coaching and mentorship, own the quality and delivery of critical data services, manage availability and performance, resolve production incidents, design data models, build real-time petabyte-scale ETL pipelines, deploy database clusters, and collaborate cross-functionally on data capabilities.

Responsibilities

  • Lead and develop a team of engineers
  • Provide coaching and technical mentorship
  • Own the quality and delivery of the team's work
  • Manage end-to-end availability and performance of critical services
  • Drive work based on measurable KPIs
  • Encourage best practices in design, documentation, and knowledge sharing
  • Resolve escalations and production incidents
  • Plan, estimate, and prioritize roadmap objectives with stakeholders
  • Build reliable data services integrating with multiple blockchains
  • Develop ETL pipelines processing petabytes of data in real time
  • Design data models for sub-second blockchain data querying
  • Deploy and monitor large database clusters
  • Collaborate with data scientists, backend engineers, and product managers

Requirements

  • Bachelor's degree or equivalent in Computer Science or a related field
  • 5+ years of experience building distributed system architecture from design to production
  • Strong programming skills in Python
  • Proficiency in SQL or SparkSQL
  • Experience with data stores including ClickHouse, Elasticsearch, Postgres, Redis, and Neo4j
  • Experience with pipeline and workflow orchestration tools such as Airflow, dbt, Luigi, Azkaban, or Storm
  • Experience with data processing and streaming technologies such as Spark, Kafka, or Flink
  • Experience with Docker, Terraform, Kubernetes, and Datadog
  • Experience loading, querying, and transforming large datasets
  • Ability to leverage modern AI/ML tools and workflows

Benefits

  • Eligibility to participate in TRM's equity plan

See also

要針對這個職缺調整履歷嗎?

目前無法檢查您與這個職缺的符合程度;請先將履歷加入個人檔案,下次即可查看。

A new version of freehire is available