Dataiku Platform Engineer
Job Description: Dataiku Platform Engineer
Role Overview
We are looking for a Senior Platform Engineer to own the end-to-end infrastructure, security, and performance of our Dataiku deployment. You will manage a hybrid environment where the Dataiku control plane resides on-premises on Red Hat Enterprise Linux, while heavy-lift AI model training and inferencing are offloaded to Azure AKS utilizing GPU-accelerated nodes.
Key Responsibilities
• Hybrid Infrastructure Management: Maintain and optimize Dataiku DSS (Data Science Studio) installed on Red Hat Enterprise Linux.
• Kubernetes Orchestration: Manage the lifecycle of Azure Kubernetes Service (AKS) clusters used as execution backends for Dataiku workloads.
• GPU Optimization: Configure and monitor Azure GPU-enabled nodes to ensure high-performance model training and low-latency inference.
• Security & Governance: Implement Role-Based Access Control (RBAC) and integrate Dataiku with Azure Active Directory (Entra ID) for unified identity management.
• DataOps & Automation: Build CI/CD pipelines to automate the deployment of Dataiku bundles and API services using tools like Terraform, Ansible, or Azure DevOps.
• Monitoring & Observability: Establish full-stack monitoring using Azure Monitor, Grafana, or Prometheus to track cluster health, GPU utilization, and Dataiku performance.
Technical Requirements
• Dataiku Expertise: Minimum 4+ years in Dataiku administration, including installation, upgrading, and plugin management.
• Linux Engineering: Strong proficiency in Red Hat Enterprise Linux (RHEL) administration, shell scripting (Bash), and system-level troubleshooting.
• Azure/AKS Specialist: Hands-on experience with Azure networking (VNets, ExpressRoute), AKS cluster management, and Azure Container Registry.
• Cloud-Native Tools: Expertise in Docker and Kubernetes concepts (pods, services, ingresses, and node affinities for GPUs).
• Infrastucture as Code: Experience with Terraform or Bicep for provisioning Azure resources.
Preferred Qualifications
• Dataiku Core Designer or Administrator Certification.
• Red Hat Certified System Administrator (RHCSA).
• Experience with Azure Machine Learning integration or Snowflake push-down execution.