Senior Software Engineer - CoreAI
Summary
Senior engineer building scalable data pipelines powering GitHub Copilot's model training data, owning ETL/ELT workflows on Azure with Python/C#. Works across full lifecycle—design, deployment, and on-call—on high-volume AI data systems.
We are looking for a Senior Software Engineer – to design, build and operate scalable data pipelines that power GitHub Copilot and related model’s growing data needs. You’ll play a key role in the collection and curation of data powering the latest GitHub CoPilot and coding model innovation across the company.
In this role, you will work across the full development lifecycle-- design, implementation, testing, deployment and live site support – while honing your technical depth and engineering craftmanship.
You will build tools and systems that ingest, process, curate large-scale GitHub Copilot datasets. You will partner closely with product teams to create, enhance and operate data pipelines that are efficient, reliable, compliant and secure.
You will join a world class, collaborative engineering team of engineers using agile methodologies and DevOps practices deliver and run production services.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Design, build, and optimize large-scale, robust data pipelines and architectures that support GitHub Copilot models, eval, and analytics initiatives.
Develop and extend scalable ETL/ELT workflows, ensuring reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources.
Continuously improving systems for availability, reliability, efficiency, observability, and performance while applying and sharing modern engineering practices.
Staying current with new technologies, patterns, and tooling that strengthen our engineering and operational excellence.
Acting as a Designated Responsible Individual (DRI) as part of on‑call rotations to monitor, troubleshoot, and restore data services.
Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, or Python
- OR equivalent experience.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 3+ years of experience in developing scalable, multi-threaded infrastructure/backend software with C# or Python or similar language
- 3+ years of experience with planning, scheduling and delivery of software.
- Experience working with AI-assisted developer tools
- 5+ years of professional software development experience in data processing systems
- 2+ year(s) of development of data ETL services and cloud services
- 2+ year(s) of software engineering practices, coding and solid foundation in data structures, algorithms with proficient testing, debugging and analytical skills
- Relevant experience running a 24/7 Azure-based services
- Experience working with experimentation systems, telemetry systems and data to drive engineering, AI services and/or model building and product decision making
- Customer focus and a deep commitment to delivering products that create customer value and delightful experiences
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.