Join Akvelon — build products used by millions!Akvelon is an IT company with 20+ years of experience and 1,200+ engineers across 15+ locations worldwide.
We work with both well-known global tech companies, including Microsoft, Facebook, Airbnb, Dropbox, and Pinterest, and with growing startups.
Our teams are involved in different types of engineering projects, from cloud solutions and AI/ML systems to big data, web, and mobile applications.
Since we are remote-first, our engineers work in distributed teams with flexible hours. We value ownership, clear communication, and the ability to take responsibility for your part of the work.
About the role
We are looking for a Senior AI Technical Program Manager for a short-term engagement focused on the discovery and evaluation of Agentic AI implementation scenarios for an existing client.
In this role, you will lead cross-functional initiatives to standardize AI engineering workflows, establish evaluation and governance frameworks, and ensure AI solutions deliver reliable, measurable business outcomes. You will work closely with Engineering, Product, Security, and technical leadership to drive alignment and adoption of scalable AI practices.
Requirements- 5+ years of experience as a Technical Program Manager working with AI/ML engineering platforms, AI developer experience, or enterprise workflow automation
- Strong understanding of AI evaluation methodologies, evaluation frameworks, prompt benchmarking, and RAG reliability testing
- Experience defining quality metrics, regression testing, and reliability guardrails for AI solutions
- Strong systems thinking and process engineering skills, with experience standardizing complex engineering workflows
- Excellent executive communication and presentation skills
- Proven ability to influence and align ML Engineers, Data Engineers, Software Architects, Product, Security, and business stakeholders without direct authority
- Ability to translate complex technical and quality metrics into clear, data-driven business narratives
Nice to have
- Experience with Agentic AI and AI workflow orchestration
- Familiarity with Model Context Protocol (MCP) and RAG architectures
- Experience with LLM-as-a-judge, golden datasets, precision/recall, hallucination evaluation, and confidence-based gating
- Experience designing Human-in-the-Loop (HITL) processes
- Experience with AI quality dashboards, scorecards, and ROI reporting
Responsibilities- Lead the discovery phase to identify and evaluate applicable Agentic AI implementation scenarios
- Audit existing AI/ML workflows and identify bottlenecks and opportunities for standardization
- Establish repeatable AI development, testing, evaluation, and deployment practices across engineering teams
- Define evaluation frameworks, test datasets, benchmarks, and quality metrics for AI solutions
- Establish regression testing, monitoring, reliability guardrails, and human-review processes
- Drive adoption of AI engineering best practices across cross-functional teams
- Lead technical reviews, steering committees, and executive alignment sessions
- Prepare executive dashboards, progress reports, quality scorecards, and ROI presentations
- Translate technical findings into actionable recommendations for engineering and business leadership
Availability expectations- Daily availability with working-hour overlap until 10:00 PM PST
|