Senior Data Engineer
Title: Senior Data Engineer — 4+ years
Industry: Information Technology | Work Mode: Remote
Role Summary
Embark on an exciting career in the Information Technology industry as a Senior Data Engineer. In this role, you will design and maintain scalable Azure-based data pipelines and data platforms, focusing on government datasets that support AI/ML and analytics. You will be part of a collaborative team, learning to implement effective ETL/ELT workflows using tools like ADF, Databricks, Spark, Kafka, and SQL. Your contributions will directly impact the efficiency and reliability of data management, with a clear path for growth and increased responsibility as you gain experience.
Key Contributions
- Implement small tasks and sub-features from a defined backlog with mentor oversight, ensuring quality and consistency.
- Produce maintainable outputs, including code and documentation, while adhering to team standards and best practices.
- Troubleshoot low-complexity issues and escalate blockers promptly, providing concise context to facilitate resolution.
- Follow established branch strategies and documentation conventions to ensure reproducibility and clarity in your work.
- Participate actively in daily and weekly updates, capturing notes and resources for future reference.
Ways of Working
- Apply the team's acceptance criteria and “definition of done” to ensure deliverables meet quality standards.
- Keep changes small and traceable, writing clear commit messages to enhance project documentation.
- Utilize async-first updates in remote settings, summarizing outcomes, next steps, and any requests for support.
Collaboration & Communication
- Work closely with peers and mentors, asking clarifying questions to enhance understanding and execution of tasks.
- Align project scope and acceptance criteria with adjacent roles such as PM, QA, and Design before commencing work.
Growth Signals
- Complete well-defined tasks on time with minimal rework, demonstrating a clear understanding of project requirements.
- Incorporate feedback swiftly and communicate progress and potential risks succinctly to stakeholders.
Must-Haves
- Skills: AI/ML, ETL/ELT
- Qualification: Bachelor's Degree
Duration: 6 months
Work Mode: Remote
Openings: 1 position available.
Experience: 4+ years
Compensation:
- Hourly Rate: Up to $0.0 per hour
- Annual CTC: Up to $0.00
Additional Comments
Design and maintain scalable Azure-based data pipelines and data platforms for government datasets supporting AI/ML and analytics. Build ETL/ELT workflows using ADF, Databricks, Spark, Kafka, and SQL. Implement data lakes, warehouses, governance, security, monitoring, and optimization across relational, NoSQL, vector, and graph databases. Collaborate with Data Scientists and MLOps teams. Requires 3+ years experience, strong Azure, SQL, Python/Scala, and data modeling expertise.