Logo of Huzzle

Senior Manager, AI/ML Model Validation

image

TD Bank

Jul 30, 2024

  • Job
    Full-time
    Senior (5-8 years)
  • Toronto
  • Quick Apply

AI generated summary

  • You need extensive experience in AI/ML model validation, strong analytical skills, proficiency in programming and statistics, and the ability to communicate complex concepts clearly.
  • You will validate AI/ML models, ensure compliance with regulations, analyze model performance, collaborate with teams, and communicate findings to stakeholders to enhance decision-making processes.

Requirements

  • Advanced quantitative and AI / ML skills with post-secondary degree in one or more of the following areas: Machine Learning, AI, finance, engineering, software engineering, statistics, economics / econometrics, mathematics
  • 4+ years of experience in either developing or validating Fraud / Cyber Security models; and 2+ years of experience in leading a small team of data scientists
  • In-depth knowledge of fraud risk management and detection of different types of fraud attacks
  • In-depth knowledge of AI / Machine Learning techniques, concepts and theory; Statistical/probability theory and applications. Understanding of weaknesses and limitation of popular ML modeling approaches
  • Deep knowledge of popular tabular ML algorithms such as XGBoost/LightGBM, Random Forest, and etc
  • In-depth knowledge of AI/ML Explainability/Interpretability concepts, tools and techniques
  • Ability to research and implement Machine Learning algorithms from academic research papers is a plus
  • Proficient in relevant programming languages such as Python, PySpark, SQL. Experience with Microsoft Azure cloud infrastructure, Databricks is an asset
  • Object Oriented Programming, GIT, MLOps / Dev.Ops; Experience maintaining an ML library is a plus
  • Excellent verbal and written communication skills; and stakeholder management abilities (position requires writing and reviewing reports of technical nature)
  • Strong critical and analytic thinking skills
  • Excellent time / project management and multitasking skills with minimal supervision
  • Stay up to date with the latest advancements in fraud risk management, data science, machine learning, and AI

Responsibilities

  • Lead a team of Machine Learning and Data Scientists to perform validation of all Fraud and Cyber Security models deemed in-scope by the bank-wide Model Risk Policy.
  • Recommend the approval of models or other corrective actions based on the independent validation.
  • Lead and support a team of model validators.
  • Ensure performance objectives are set for all staff and that performance feedback is provided on a regular basis.
  • Communicate group objectives and strategies and align group activities in support of business objectives.
  • Support employee development activities, coach and support direct reports in meeting their personal development objectives.
  • Assume a leadership role in developing standards and procedures for vetting and validation Fraud and Cyber Security models that are compliant with the Bank’s internal Model Risk Policy, adhere with industry and academic best practices, and meet regulatory requirements.
  • Respond to requests from both Canadian and U.S. regulators, internal and external audit in their review/audit of models and vetting/validation process and procedures. Provide information and assistance as required.
  • Work effectively with internal Model Development groups, Audit, and other internal partners to ensure models meet required Bank standards for use.
  • Play a key role in ensuring the appropriate use of Fraud and Cyber Security models. Identify the need to implement new models/techniques as industry standards evolve and regulatory requirements change.
  • Maintain full professional knowledge of techniques and developments in the field of AI and Machine Learning, and share knowledge with business partners and senior management. Provide subject matter expertise to business units on AI/ML Fraud and Cyber Security modeling and validation.

FAQs

What is the work location for the Senior Manager, AI/ML Model Validation position?**

The work location for this position is Canada. **Question: What are the working hours for this role?** **Answer:** The working hours for this role are 37.5 hours per week. **Question: What is the main responsibility of the Senior Manager in the AI/ML Model Validation group?** **Answer:** The main responsibility is to lead a team of Machine Learning and Data Scientists to perform validation of all Fraud and Cyber Security models in accordance with the bank-wide Model Risk Policy. **Question: What qualifications are required for this position?** **Answer:** Candidates should have an advanced quantitative and AI/ML skill set with a post-secondary degree in areas such as Machine Learning, AI, finance, engineering, software engineering, statistics, economics/econometrics, or mathematics. **Question: How many years of experience are required for this job?** **Answer:** A minimum of 4+ years of experience in developing or validating Fraud/Cyber Security models, as well as 2+ years of experience in leading a small team of data scientists, is required. **Question: What types of knowledge are important for this role?** **Answer:** In-depth knowledge of fraud risk management, AI/Machine Learning techniques, statistical/probability theory, and popular ML algorithms is essential, along with knowledge of AI/ML Explainability concepts. **Question: Are there any programming skills required for the position?** **Answer:** Yes, proficiency in programming languages such as Python, PySpark, and SQL is required, along with experience using Microsoft Azure cloud infrastructure and Databricks being an asset. **Question: What kind of leadership responsibilities will the Senior Manager have?** **Answer:** The Senior Manager will be responsible for leading and supporting a team of model validators, setting performance objectives, providing feedback, and ensuring alignment with group and business objectives. **Question: What is the company's commitment to colleagues' development?** **Answer:** TD is committed to providing support through regular development conversations, training programs, and opportunities for mentorship to help colleagues thrive and realize their potential. **Question: Is there a language requirement for this position?** **Answer:** Yes, proficiency in a language other than French is required to support or interact with employees who need services and support in that language. **Question: How does the interview process work for this position?** **Answer:** The interview process involves reaching out to candidates of interest to schedule interviews, and the company aims to communicate outcomes to all applicants via email or phone call. **Question: What benefits does TD offer to its employees?** **Answer:** TD offers a Total Rewards package that includes base salary, variable compensation, health and well-being benefits, retirement programs, paid time off, career development opportunities, and reward recognition programs. **Question: What is the vision of TD as an organization?** **Answer:** TD's vision is to Be the Better Bank, with a purpose to enrich the lives of customers, communities, and colleagues while delivering legendary customer experiences.

Finance
Industry
10,001+
Employees

Mission & Purpose

Headquartered in Toronto, Canada, the Toronto-Dominion Bank and its subsidiaries are collectively known as TD Bank Group (TD). TD had CDN$1.9 trillion in assets on July 31, 2023. TD also ranks among the world’s leading online financial services firms, with more than 16 million active online and mobile customers. TD offers a full range of financial products and services to over 27.5 million customers worldwide through four key business lines: - Canadian Personal and Commercial Banking including TD Canada Trust, Business Banking, and MBNA - U.S. Retail including TD Bank, America’s Most Convenient Bank, TD Auto Finance (U.S.), TD Wealth (U.S.) and TD’s investment in Schwab - Wealth Management & Insurance including TD Wealth (Canada), TD Direct Investing, and TD Insurance - Wholesale Banking including TD Securities and TD Cowen