Senior Machine Learning Engineer, Model Risk Management

You will independently challenge model owners across lending, fraud, and AML; reproduce their results, set and defend the acceptance thresholds, and own the call on whether a model is sound. Hunt silent errors that make metrics lie, evaluate models under real-world conditions, ship production validation tooling, build agentic validation systems, assess ML systems end to end, connect explainability and fair-lending findings to product decisions, and help define standards for validating production AI.

Responsibilities

  • Independently challenge model owners across lending, fraud, and AML; reproduce results, set acceptance thresholds, and decide whether models are sound.
  • Identify silent errors that mislead metrics and prove them out before production.
  • Design evaluation for rare events, shifting populations, and post-launch drift.
  • Work hands-on in unfamiliar codebases and ship production validation tooling.
  • Build agentic validation tooling that orchestrates parallel agents.
  • Evaluate ML systems end to end across features, training, serving, monitoring, and scale.
  • Connect explainability and fair-lending findings on consumer credit models to model and product decisions.
  • Help define standards for validating production AI systems.

Requirements

  • Quantitative degree or equivalent experience and senior individual-contributor depth building or validating models in credit, fraud, or financial crime.
  • Experience with effective challenge methodology, reproduction, conceptual soundness review, benchmarking, stress testing, and outcomes analysis.
  • Deep applied machine learning and statistics across regression, tree ensembles, and deep learning.
  • Strong experimentation and statistical rigor, including holdout design, uncertainty, calibration, and generalization.
  • Production-quality Python, SQL on large datasets, reproducible code, and testing practices.
  • Fluency building with LLMs and agentic tools, with judgment about trustworthy outputs.
  • Familiarity with model risk management frameworks and fair-lending standards.
  • Strong communication skills and independence operating under ambiguity.

Benefits

  • Remote work
  • Medical insurance
  • Flexible time off
  • Retirement savings plans
  • Modern family planning

See also

要針對這個職缺調整履歷嗎?

目前無法檢查您與這個職缺的符合程度;請先將履歷加入個人檔案,下次即可查看。

A new version of freehire is available