Databricks Solution Architect Senior Manager
Overview
As a Databricks Solution Architect, you will be responsible for designing and implementing modern, scalable data solutions that enable advanced analytics, reporting, and operational efficiency. You will lead the architecture, development, and migration of data platforms, ensuring seamless integration with existing systems and alignment with organizational data strategies
The Work:
This role requires close collaboration with cross-functional teams to translate business requirements into actionable technical designs, as well as oversight across configuration, development, testing, deployment, and optimization of Databricks environments. You will establish and enforce best practices in data engineering, governance, quality, security, and metadata management across all stages of the data lifecycle.
Responsibilities
- Lead the architecture and implementation of scalable data solutions using Databricks, including Delta Lake, SQL, Lakeflow pipelines, and cloud-native storage.
- Collaborate with stakeholders to gather requirements and translate business needs into detailed technical designs, data models, and solution architectures.
- Design, build, and optimize data pipelines, workflows, and data models, including ingestion, transformation, orchestration, and metadata management.
- Provide technical leadership, coaching, and mentorship to engineering teams to ensure high-quality development and adherence to architectural standards.
- Establish and enforce best practices for data security, access controls, governance, cataloging, lineage, and compliance within Databricks environments.
- Oversee configuration and management of Databricks Workspaces, Unity Catalog, CI/CD automation, environment setup, and deployment frameworks.
- Troubleshoot and resolve complex technical issues related to performance, data quality, integration, and environment configuration.
- Lead test strategy and quality assurance activities, including unit testing, regression testing, system testing, and readiness reviews.
- Drive platform optimization and cost efficiency, including cluster tuning, storage optimization, and pipeline performance improvements.
- Plan and oversee data migration iterations, parallel runs, and production deployment processes to ensure smooth cutover and minimal business disruption.
- Support knowledge transfer, documentation, and training activities to empower end users and operational teams.
- Stay current with Databricks platform advancements and industry trends, and proactively introduce innovations to improve data engineering capabilities.
- Document architectures, technical designs, processes, and best practices for ongoing reference and compliance.
Here's What You Need:
- Strong expertise in Databricks, Apache Spark, Delta Lake, and cloud platforms such as AWS or Azure
- Experience with ETL/ELT processes, data modeling, CI/CD pipelines, and performance tuning in large-scale environments will be critical
- Leading technical teams, coordinating complex migrations, managing project timelines, and mentoring engineers will further support your impact in this technical leadership role
- Bachelors Degree or 10+ years of industry experience
Bonus Points If:
- Advanced Degree
- 15+ years of industry experience
- Motivated and proactive, with a desire to understand and address complex areas
- Curiosity for learning about new technology, industry best practices, and areas of risk, analyzing and turning new insights into concrete action
- Commitment to delivering tangible outcomes for customers and stakeholders
- Strong written and verbal communication/interpersonal skills to effectively collaborate with cross-functional teams and stakeholders.
- Excellent people management and relationship development skills
- In-depth knowledge of Accenture delivery methodologies and practices
The Extras:
- US Citizenship Required
- The ability to obtain and maintain a government security clearance
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
As published by greenhouse
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
- State choose one
- Are you at least 18 years of age? choose one
- Are you legally authorized to work in the United States? choose one
- Many AFS positions require US citizenship. Please indicate your citizenship status so we can determine eligibility for specific roles. choose one · optional
- If yes, please list the full name of the employee(s) and your relationship to them. optional
- Will you now or in the future require sponsorship for employment visa status (for example, H-1B visa status)? choose one
- Have you entered into a non-disclosure or non-compete agreement or understanding of any kind? choose one
- Have you worked at Accenture in the past? choose one
- How did you hear about us? choose one
- Do you hold a security clearance? choose one
- At your current employer, are you currently working on a project with Accenture or have you worked on a project with Accenture in the past 24 months? choose one
- Are you a current employee of the U.S. Government (including U.S. Congress or military) or any state or local government? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). NOTE: answer yes if you have accepted the “Fork-in-the-Road” offer, separated with a Deferred Retirement Plan, or are on administrative leave pending separation from the Government. choose one
- Will you be serving as enlisted personnel in either the Reserves or the National Guard while working for AFS? choose one
- Were you an employee of the U.S. Government (including U.S. Congress or military) or any state or local government within the past 10 years? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). choose one
- Do you have any family members or people you have close relationships with who work for Accenture Federal Services? choose one
- Affirmation choose one