Staff MaaS Backend Engineer

You will co-own the MaaS system architecture and roadmap, set Go and API standards, build OpenAI- and Anthropic-compatible inference gateways, optimize routing and model serving, operate globally distributed services with strict SLOs, enforce authorization and tenant isolation, implement token metering and billing reconciliation, execute safe migrations, and deliver tracing and cost telemetry with strict log hygiene.

Responsibilities

• Co-own the end-to-end MaaS system design and technical roadmap.
• Author technical decision records and defend architectural trade-offs.
• Set Go and API standards, mentor engineers, and align cross-functional teams.
• Own API compatibility for OpenAI and Anthropic formats, including streaming, tool calling, and structured output.
• Evolve load-aware, model-aware, and prefix-cache-aware routing with circuit breaking and fallback mechanisms.
• Optimize token throughput, KV cache tiering, and time-to-first-token latency.
• Integrate model deployment, LoRA multiplexing, and autoscaling with Kubernetes.
• Operate regional inference pools and active-active control planes while defining strict SLOs.
• Enforce authorization, tenant isolation, rate limits, quotas, and prompt-injection controls.
• Build exactly-once token metering and billing reconciliation.
• Execute incremental platform upgrades with shadow traffic and dual writes.
• Deliver request tracing and cost telemetry while preventing unauthorized retention of prompts, completions, and PII.

Requirements

• 8+ years of backend engineering experience.
• 3+ years owning a high-traffic, multi-tenant API platform for paying customers.
• Experience with multi-region active-active deployments, caching, backpressure, and performance engineering.
• Experience executing zero-downtime brownfield migrations for stateful subsystems.
• Hands-on proficiency with Go-based services and production Kubernetes.
• Experience with Envoy, GPU-aware scheduling, PostgreSQL, Redis, and Kafka.
• Experience with OpenTelemetry and high-cardinality analytics stores.
• Understanding of LLM serving, server-sent-event streaming, KV and prefix caching, and TTFT.
• Experience building exactly-once metering and billing systems.
• Experience designing fail-closed authorization and cross-tenant isolation.
• Willingness to carry on-call responsibilities and conduct blameless incident reviews.

Benefits

• Welfare benefits.
• Inclusive and diverse workplace environment.
• Opportunity to work on new projects and develop processes and systems.
• Personal accountability, autonomy, fast growth, and learning opportunities.
• Training, mentoring, networking, and opportunities to contribute to the digital asset industry.