Data Infrastructure Engineer
The Data Infrastructure team builds and operates the platform powering data workloads across PayPay Group. This role focuses on AWS infrastructure, Terraform, Databricks operations, platform services, observability, incident response, governance, security, and collaboration with data engineers.
Responsibilities
- Design, build, and manage AWS cloud infrastructure using Terraform, IaC, and GitOps practices
- Operate and improve the Databricks Lakehouse platform, including workspace provisioning and configuration management
- Build and maintain platform services and tooling for data engineers
- Strengthen reliability through monitoring, alerting, dashboarding, and incident response
- Implement and enforce data governance and security controls
- Collaborate with data engineering teams on infrastructure requirements
- Participate in on-call rotation and operational support
Requirements
- 3+ years of infrastructure or platform engineering experience
- Hands-on experience with Terraform and Infrastructure as Code workflows
- Working knowledge of AWS, including IAM, VPC, S3, EC2, and multi-account setups
- Familiarity with CI/CD pipelines such as GitHub Actions or Jenkins
- Experience with monitoring and observability tools such as Prometheus or Grafana
- Scripting ability in Python and/or Shell
- Knowledge of Linux/Unix, networking, and security best practices
- Experience with Databricks, EMR, or other data platform technologies
- Exposure to Kubernetes and GitOps tooling such as EKS and ArgoCD
- Familiarity with Kafka or event-based data ingestion patterns
- Familiarity with workflow orchestration tools such as Airflow, Dagster, or Prefect
- Experience with Spark, Hadoop, or large-scale data-processing frameworks
Benefits
- Social insurance
- 401K
- Translation and interpretation support
- Visa sponsorship
- Relocation support
- Annual leave
- Personal leave
- Super flex time with no core time