Generative AI Applications Engineer (Agents & RAG)
Build AI that matters. We ship production GenAI apps for confidential federal programs across defense, national security, public safety, civilian, and military health where reliability, privacy, and safety aren’t optional. AFS is a technology company within global Accenture and a Glassdoor Top 100 Best Place to Work. You’ll join a collaborative, inclusive community with handson growth, certifications, and industry training. We ship in weeks, not quarters, and measure success with latency, reliability, safety, and cost.
Confidentiality matters: We don’t disclose program details publicly. If you advance, we’ll share specifics during the process.
Role Overview
You’ll turn mission needs into secure, reliable, and scalable GenAI applications no model training required. This is a hands-on role across agentic workflows, RAG, prompt/policy design, LLM evaluation, and platform integration. You’ll own the end-to-end path from use case evaluation → production deployment → operational excellence, partnering with product, security, data, and SRE to ship features safely and at scale.
What You’ll Do (Day to Day)
- Design & ship mission grade GenAI: Build agentic workflows and RAG systems tailored to mission data and environments; target low hallucination, tight p95 latency, and predictable cost.
- Agent frameworks & orchestration: Apply patterns from LangChain/LlamaIndex/Semantic Kernel; design task decomposition, tool use, guardrails, and recovery/fallback strategies.
- Platform integration (no model training): Implement with AWS Bedrock, Azure OpenAI, Google Vertex AI, Amazon Kendra, and managed services (e.g., Document AI, Gemini, Gemma).
- LLM selection & evaluation: Compare models for quality, safety, latency, cost; author/test prompts & policies; deploy with observability and safe rollback/fallback.
- RAG done right: Build retrieval pipelines & vector search (Pinecone, Weaviate, OpenSearch, pgvector, FAISS/Chroma); handle data prep, chunking, metadata, and IRstyle evals (e.g., NDCG) to maximize signal to noise.
- Production rigor: Instrument metrics/logs/traces; run A/B experiments; maintain incident playbooks; and implement safety & compliance guardrails.
- SRE & FinOps for AI: Define SLIs/SLOs (quality/latency/safety/cost), run on call and postmortems, reduce MTTR; meter usage and optimize token/spend.
- Reusable platform components: Ship SDKs, CI/CD templates, Terraform/IaC modules, evaluation harnesses that accelerate multiple mission team not one-off projects.
- Operate in real world constraints: Deliver into hybrid, restricted, or air gapped environments with Zero Trust principles and audit ready controls.
You'll Thrive Here If you have
- Built and deployed a production GenAI application (chatbot, copilot, assistant, or enterprise AI).
- Hands-on with LLMs GPT, Claude, Llama, Gemini, Mistral, via APIs or self-hosted.
- Designed and implemented RAG solutions using embeddings, vector databases, and semantic search for enterprise or mission data.
- Shipped AI applications with frameworks like LangChain, LangGraph, LlamaIndex, Semantic Kernel, DSPy, or similar.
- Strong Python development for building and integrating AI/ML applications.
- Owned AI solutions through full production life cycle, deployment and operational support.
- Active U.S. citizenship.
Nice to Have
- Integration with leading cloud AI services or on prem inference stacks
- Background in LLM evaluation, prompt authoring/testing, A/B experimentation, and LLM Ops.
- Responsible AI expertise (privacy, security, bias, transparency, human in the loop) and data governance.
- Experience implementing tool using agents for API integration and external data access.
- Containerization & orchestration (Docker, Kubernetes, VMware) and scripting/automation (Linux Bash, PowerShell).
- Prior work in regulated/secure environments (e.g., ATO, STIGs, Zero Trust) with fast shipping.
- Familiarity with NVIDIA AI Foundations, OpenAI ChatGPT, and AI assisted dev tools (Cursor, Windsurf, Claude).
- Contributions to internal frameworks or opensource; mentorship of engineers.
- Clear communication with engineers, PMs, and security/compliance stakeholders.
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
As published by greenhouse
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
- State choose one
- Are you at least 18 years of age? choose one
- Are you legally authorized to work in the United States? choose one
- Will you now or in the future require sponsorship for employment visa status (for example, H-1B visa status)? choose one
- Have you entered into a non-disclosure or non-compete agreement or understanding of any kind? choose one
- Have you worked at Accenture in the past? choose one
- How did you hear about us? choose one
- Do you hold a security clearance? choose one
- At your current employer, are you currently working on a project with Accenture or have you worked on a project with Accenture in the past 24 months? choose one
- Are you a current employee of the U.S. Government (including U.S. Congress or military) or any state or local government? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). NOTE: answer yes if you have accepted the “Fork-in-the-Road” offer, separated with a Deferred Retirement Plan, or are on administrative leave pending separation from the Government. choose one
- Will you be serving as enlisted personnel in either the Reserves or the National Guard while working for AFS? choose one
- Were you an employee of the U.S. Government (including U.S. Congress or military) or any state or local government within the past 10 years? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). choose one
- Do you have any family members or people you have close relationships with who work for Accenture Federal Services? choose one
- If yes, please list the full name of the employee(s) and your relationship to them. optional
- Affirmation choose one