Senior AI Software Engineer
Job Description:
We are looking for a Senior AI / Software Platform Engineer to help drive the integration of AI-assisted development workflows into a large-scale enterprise Linux environment.
This role is focused on practical AI application within software engineering, including code intelligence, developer tooling, requirements-driven development, and AI-assisted modernization of a large legacy codebase consisting primarily of C/C++ with additional modern languages and frameworks.
The ideal candidate is a strong software engineer first, with hands-on experience integrating and operationalizing modern AI/LLM technologies within real-world development environments.
Environment:
- Large enterprise software platform (~6M+ LOC)
- Primarily C/C++
- Red Hat Enterprise Linux environment
- GitLab-based development workflows
- GPU-enabled internal AI infrastructure
- Complex legacy and modern hybrid systems
Responsibilities:
- Design, develop, and deploy scalable AI/ML and LLM-powered applications in production environments
- Build and optimize high-performance inference pipelines using technologies such as vLLM and modern GPU-serving frameworks
- Develop agentic AI workflows leveraging orchestration frameworks, tool calling, and retrieval-augmented generation (RAG)
- Integrate LLMs, vector databases, APIs, and enterprise systems into production applications
- Collaborate with software engineers, AI researchers, and platform teams to productionize AI prototypes and services
- Improve model performance, throughput, latency, scalability, and operational efficiency
- Implement monitoring, observability, evaluation, and testing frameworks for AI systems
- Develop APIs, backend services, and automation workflows supporting AI-driven products
- Evaluate emerging AI technologies, frameworks, and developer tooling including Open Code, OpenwebUI, Claude Code and modern AI coding assistants
- Contribute to AI platform architecture, deployment standards, and engineering best practices
Required Skills:
- 4 years of software development with experience in any of the following:
- Strong Linux experience (Red Hat / Enterprise Linux required)
- Experience with LLMs, RAG systems, embeddings, or AI-assisted tooling
- Advanced C/C++ experience
- Experience with GitLab workflows and CI/CD
- Strong Python development experience
- Experience with APIs, backend systems, and automation
- Strong understanding of software architecture and large-scale systems
Preferred Skills:
- GPU infrastructure experience
- Experience deploying or operating local/open-source models
- Experience with vector databases and semantic search
- Experience with developer tooling or IDE integrations
- Experience with AI evaluation/testing frameworks
- Experience with secure/offline AI environments
- Familiarity with code indexing and static analysis systems
- Ability to work independently and drive technical initiatives
- Strong debugging and problem-solving skills
- Experience working with legacy systems and modernization efforts
Clearance:
- Must have an active secret federal security clearance
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
As published by greenhouse
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
- State choose one
- Are you at least 18 years of age? choose one
- Are you legally authorized to work in the United States? choose one
- Will you now or in the future require sponsorship for employment visa status (for example, H-1B visa status)? choose one
- Have you entered into a non-disclosure or non-compete agreement or understanding of any kind? choose one
- Have you worked at Accenture in the past? choose one
- How did you hear about us? choose one
- Do you hold a security clearance? choose one
- At your current employer, are you currently working on a project with Accenture or have you worked on a project with Accenture in the past 24 months? choose one
- Are you a current employee of the U.S. Government (including U.S. Congress or military) or any state or local government? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). NOTE: answer yes if you have accepted the “Fork-in-the-Road” offer, separated with a Deferred Retirement Plan, or are on administrative leave pending separation from the Government. choose one
- Will you be serving as enlisted personnel in either the Reserves or the National Guard while working for AFS? choose one
- Were you an employee of the U.S. Government (including U.S. Congress or military) or any state or local government within the past 10 years? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). choose one
- Do you have any family members or people you have close relationships with who work for Accenture Federal Services? choose one
- If yes, please list the full name of the employee(s) and your relationship to them. optional
- Affirmation choose one