Director - Backend Engineering - AI Infra
Job Description: Director of Backend Engineering (AI Infrastructure)
Company Introduction
We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we are collectively disrupting the multi-billion-dollar commerce industry from the ground up and establishing an unparalleled reputation for being leading and reliable force in South Korean commerce.
We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.
Role Overview
We are seeking a visionary Director of Backend Engineering to lead the teams responsible for the software "brain" that manages our global AI Physical Infrastructure. You will oversee the development of the SDN orchestrators, automated fleet management systems, and the high-performance storage backends that power our AI training and inference clusters.
Your mission is to abstract the complexity of specialized hardware (NVIDIA/HPC) into a seamless, automated, and hyper-reliable cloud platform.
Key Responsibilities
1. Strategic Leadership & Fleet Orchestration
- Software-Defined Infrastructure: Lead the design and delivery of an SDN Orchestrator to automate complex GPU networking (InfiniBand/RoCE/NVLink) and core DC routing.
- Fleet Health Automation: Oversee the development of backend services for GPU Health & Fault Detection, automating the lifecycle from burn-in and diagnostics to global RMA workflows.
- Capacity & Traffic Engineering: Drive the backend logic for global traffic routing, load balancing (NGINX/Kong), and IPAM to ensure zero-bottleneck training environments.
2. Data & Storage Systems
- HPC Data Pipelines: Collaborate with storage engineers to build backend interfaces for Parallel File Systems (Lustre, Weka, VAST etc.), ensuring high-throughput data delivery to compute nodes.
- Storage Durability: Direct the backend strategy for AI Object Storage, focusing on high durability and low-latency retrieval for massive datasets.
3. Engineering Excellence
- Scalable Architecture: Act as the final technical authority for AI Infra Architecture, ensuring systems are resilient, multi-region, and capable of sub-millisecond coordination.
- DevOps & IaC Culture: Champion a "Hardware-as-Code" mindset, utilizing Python, Ansible, and Terraform to eliminate manual intervention in DC operations.
4. Team Development
- Lead a multi-disciplinary org including Backend Developers, SDN Engineers, and Infra Ops teams, AI Infra Engineering
- Establish 24/7 L1/L2/L3 operational standards to maintain > 99.99% availability of the AI fleet.
Required Qualifications
- Experience: 15+ years in Backend Engineering, with at least 5 years in a leadership role managing complex infrastructure (Cloud, FinTech, or HPC).
- Deep Infrastructure Knowledge: Proven experience with Linux internals, hardware-software interfaces (drivers/firmware), and distributed systems.
- Networking Mastery: Solid understanding of L2/L3 networking, and ideally, specialized fabrics like InfiniBand or RoCE.
- The Stack: Professional proficiency in Python, Go, or C++, and deep experience with Terraform, Kubernetes, and Ansible.
- Large-Scale Data: Experience managing high-performance storage backends (GPFS, Lustre, or equivalent parallel systems).
- Hardware Savvy: You don't just write code; you understand power envelopes, liquid cooling constraints, and GPU architecture (NVIDIA/HPE/Dell).
Preferred Skills
- Experience building custom SDN controllers or orchestration layers from scratch.
- Direct experience with NVIDIA or GPUDirect technologies.
- Previous success in a "Hyper-scale" environment (AWS, Azure, GCP, Meta, AI Cloouds etc.).
Recruitment Process
- Application Review - Phone Interview - Onsite (or Virtual Onsite) Interview – Offer
The exact nature of the recruitment process may vary according to the specific job and may be changed due to scheduling or other circumstances.
- Interview schedules and the results will be informed to the applicant via the e-mail address submitted at the application stage.
Details to Consider
- This job posting may be closed prior to the stated end date for application if all openings are filled.
- Coupang has the right to rescind an offer of employment if a candidate is found to have submitted false information as part of the application process.
- Those eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws.
Privacy Notice
Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below.
https://privacy.coupang.com/en/land/jobs/
As published by greenhouse
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
- LinkedIn Profile optional
- Coupang Corporation or its affiliates and subsidiaries* (collectively referred to as “Coupang”) does not collect or use any personal information other than the types of information specified in this Consent. Such information is collected and used as per the applicable law including the extant Digital Personal Data and Protection Act, 2023. (“Data Protection Act”) Please ensure that your resume does not include any personal information other than the types specified in this Consent. choose one
- 1. What is your nationality? choose one
- 2. Do you require a visa to legally work in India? choose one
- 1. (Required) By submitting your resume, you consent to the required collection and use, required provision, and consignment as set forth in our Privacy Policy(https://privacy.coupang.com/en/land/jobs/). choose one
- 2. (Optional) Name, contact information, email address, nationality, educational background, work experience, qualifications, national merit status (for special hiring program applicants only), relative’s name/relationship/team and application history are collected and used on an ongoing basis for recruitment purposes and may be provided to any of our affiliates and subsidiaries*, other than the company to which you originally applied, for the purpose of reviewing and conducting recruitment for similar positions. Personal information collected and provided will be retained for the duration of the year-round recruitment retention period defined in the Privacy Policy. You may refuse to provide consent, but such refusal may prevent you from applying. choose one
- 3. (Optional) Recordings of the interview process and transcriptions of interview audio maybe collected and used for the following purposes: i) to record the interview process, ii) to transcribe and document interview audio, iii) to summarize interview results, iv) to verify the interview process and evaluation results, v) to improve the hiring procedures, vi) to check candidate fit for other open positions, vii) to review past interview records. Collected personal information are retained for 4 years from the notification of hiring result, and then deleted. You may refuse to provide this consent, and refusal will not affect the recruitment process. choose one
- 4. (Optional) Coupang affiliate or subsidiary company* will send recruitment notifications through the agreed modes of communication, such as phone, email, and SMS using the contact information obtained with your consent. choose one
- 5. (Optional) I consent to reference checks on me within the following scope: Additional reference checks can be done on applicants who applied for a job at Coupang and passed on-site interviews, and Coupang arranges means to conduct reference checks. choose one
- 1. I understand that working with Relatives in the Coupang group of companies (collectively, the "Coupang Group") -- where they can influence each other’s work -- can potentially create conflicts of interest. Therefore, such a situation requires prior approval from the People Operations. In view of the above, I hereby confirm that I DO NOT have any Relatives working in any company within the Coupang Group or serving on the Board of Directors of any company within the Coupang Group; choose one
- - Name of Relative(s): optional
- - Relationship: optional
- - Working Org/Team: optional
- [For more information] choose one
- [Document Policy] choose one