Senior Data Engineer
- Can be worked in Canberra or Sydney
- Contract Opportunity
- NV1 Security Clearance Required
We are seeking an experienced Azure Data Engineer to join a major data and analytics program within a secure Australian Government environment.
Working within a multidisciplinary team, you will design, develop and support scalable ETL/ELT pipelines and analytical datasets using the Microsoft Azure ecosystem.
Key responsibilities:
Candidates must hold an active NV1 security clearance before commencing.
#SCR-madison-lustri
- Contract Opportunity
- NV1 Security Clearance Required
We are seeking an experienced Azure Data Engineer to join a major data and analytics program within a secure Australian Government environment.
Working within a multidisciplinary team, you will design, develop and support scalable ETL/ELT pipelines and analytical datasets using the Microsoft Azure ecosystem.
Key responsibilities:
- Design and build parameterised, metadata-driven pipelines using Azure Data Factory.
- Develop and optimise complex T-SQL, stored procedures, functions and views.
- Design dimensional data models, including star and snowflake schemas.
- Integrate data from REST/SOAP APIs and process JSON/XML responses.
- Work across ADLS Gen2, Azure SQL, Synapse, Key Vault and Azure Functions.
- Maintain Git source control and Azure DevOps CI/CD pipelines.
- Monitor production pipelines, troubleshoot failures and resolve incidents.
- Collaborate with technical teams and business stakeholders.
- Strong hands-on Azure Data Factory and advanced T-SQL experience.
- Experience with API ingestion, incremental loads and robust error handling.
- Strong knowledge of Azure data services and SQL performance tuning.
- Experience supporting production data pipelines.
- Excellent communication, documentation and problem-solving skills.
Candidates must hold an active NV1 security clearance before commencing.
#SCR-madison-lustri