Start with a hiring brief that describes an actual problem, relevant environment, and acceptance tests. Review a case where a model reports strong offline accuracy yet delivers little business value. Ask how the candidate checks leakage, metric choice, calibration, drift, and changes in decision behavior. Strong candidates compare against simple baselines, communicate uncertainty, and know when better data is more important than a more complex algorithm.
Use a combination of professional networks, targeted communities, referrals, specialist recruiting partners, and appropriate portfolio reviews. Evaluate applied judgment through a small practical exercise or discussion of a comparable project. Where the role involves access to sensitive systems or data, require clear security and confidentiality arrangements before giving candidates production access.
Avoid two common screening failures: Starting with algorithms before the decision — A technically strong model can solve the wrong business problem. Reporting a single metric — Without baselines, slices, and error costs, performance claims mislead decision-makers.