Senior Software Engineer Data Platform

Build highly reliable data services that analyze blockchain transaction activity at petabyte scale and enable a safer financial system. Collaborate with data scientists, backend engineers, and product managers to create scalable data models and robust data pipelines.

Responsibilities

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real time.
  • Design and architect data models for optimal storage and retrieval with sub-second latency for querying blockchain data.
  • Oversee deployment and monitoring of large database clusters with a focus on performance and high availability.
  • Collaborate with data scientists, backend engineers, and product managers to design data models that enhance TRM products.

Requirements

  • Bachelor's degree or equivalent in Computer Science or a related field.
  • 5+ years of experience architecting distributed systems and guiding projects from ideation through production deployment.
  • Exceptional Python programming skills and proficiency in SQL or SparkSQL.
  • Experience with Iceberg, Trino, BigQuery, StarRocks, and Citus.
  • Proficiency with Airflow, DBT, or similar data pipeline and workflow orchestration tools.
  • Expertise in Spark, Kafka, Flink, and streaming workflows.
  • Experience deploying and monitoring cloud infrastructure with Docker, Terraform, Kubernetes, and Datadog.
  • Ability to load, query, and transform extensive datasets.

See also

要針對這個職缺調整履歷嗎?

目前無法檢查您與這個職缺的符合程度;請先將履歷加入個人檔案,下次即可查看。

A new version of freehire is available