Senior Data Software Engineer with AWS, LLM, PySpark
We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications.
Responsibilities
- Design and implement scalable ETL/ELT pipelines
- Build and optimize data ingestion frameworks from APIs, databases, SaaS applications, and streaming sources
- Develop data models to support analytics, reporting, AI, and machine learning workloads
- Implement data quality monitoring, lineage, and governance controls
- Support enterprise lakehouse and data warehouse initiatives
- Build serverless and event-driven data processing solutions using AWS Glue, S3, Athena, Redshift, Lambda, EventBridge, and IAM
- Optimize cloud infrastructure costs and performance
- Integrate Generative AI and LLM-based capabilities into enterprise data workflows
- Support Agentic AI and workflow orchestration initiatives
- Implement CI/CD pipelines and automate deployments using Azure DevOps and GitHub Actions
- Support Infrastructure as Code using Terraform or Bicep
- Monitor solution health and performance
Requirements
- 3+ years of working experience with AWS data technologies
- 1+ year of working experience with Generative AI, LLMs, or Copilot Studio
- Experience in Agile product delivery teams
- Proficiency in Python, SQL, PySpark, and Spark SQL
- Expertise in AWS Glue, S3, Athena, Redshift, Lambda, and IAM
- Familiarity with Bedrock
- Knowledge of prompt engineering, RAG (Retrieval-Augmented Generation), and LLM integration
- Background in working with SQL Server and PostgreSQL
- English proficiency at B2 level or higher
Nice to have
- Familiarity with Azure Data Factory, Azure Synapse, and Azure Databricks
- Knowledge of Azure SQL, Azure Data Lake Gen2, and Microsoft Fabric
- Familiarity with Azure OpenAI and Azure Functions
- Skills in Snowflake and Cosmos DB
- Background in Healthcare, Life Sciences, MedTech, or Pharmaceutical industries
- Experience integrating enterprise applications such as SAP, Salesforce, or ServiceNow
- Exposure to Microsoft Fabric and Azure AI Foundry
Benefits
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Four trust days per year for personal needs
- Discounts for fitness clubs
- Benefits package (hotels, restaurants, stores and services)
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
- Discounts in local language schools, including online courses for the Kazakh language
We cover it all:
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Benefits package (sports activities, a variety of stores and services)
- Housing support program: preferential mortgage access via Otbasy Bank partnership
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all:
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Discounts for fitness clubs and sports programs
- Benefits package (sports activities, a variety of stores and services)
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
Discounts in local language schools, including offline courses for the Uzbek language
We cover it all:
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Four trust days per year (sick leave without a medical certificate)
- Discounts for fitness clubs, dance schools and sports programs
- Benefits package (sports activities, a variety of stores and services)