AI / ML Product Engineer

Work Location:

Toronto, Ontario, Canada

Hours:

37.5

Line of Business:

Analytics, Insights, & Artificial Intelligence

Pay Details:

$154,000 - $199,500 CAD

This role is temporarily eligible for a pay premium above the posted salary range that is reassessed annually. You are encouraged to have an open dialogue with your recruiter who can provide more specific pay details for this role.

TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.

As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Job Description:

We are looking for an AI Platform Product Engineer who can lead AI initiatives from idea to production, and who can teach our engineers to build with AI. This person is technical enough to prototype agents and RAG solutions. They spend most of their time setting direction, running the backlog and getting results through others. 

The role sits between our platform engineering teams and the business. It owns a portfolio of AI initiatives: it defines them precisely, prioritizes the work, removes blockers and proves value with measurable results. It also builds our engineers' AI skills through hands-on training, live demos and reusable learning materials. 

We care less about AI credentials and more about demonstrated skill. The strongest candidates can show us a clear task specification, an evaluation they designed, and a failure they caught before it reached production. 

AI Program Leadership 

• Passionate about Generative AI and Machine Learning 

• AIOps/MLOps mindset enabling services and developing pipelines for managing training models and production models.   

• Own the vision, objectives and key results for a portfolio of AI initiatives 

• Build and continuously prioritize the AI product backlog, writing backlog items with clear acceptance criteria so engineers can commit with confidence. 

• Turn vague business requests into precise AI use cases with defined scope, constraints, success metrics and a clear definition of done. 

• Run AI work in short iterations: plan, review, accept or reject increments 

• Act as the main liaison between business stakeholders, engineering, security, risk and compliance, and keep senior leaders informed. 

• Identify and track cross-pod dependencies and risks, and keep a prioritized risk backlog. 

• Build business cases that show ROI, including the full cost of running AI in production (model usage, tokens, infrastructure and support). 

• A critical thinker with strong research and analytics skills 

• Self-motivated with a positive attitude and an ability to work independently and in a team 

AI Enablement for Engineers 

• Design and run a training program that teaches platform engineers and developers to build agents, multi-agent workflows and RAG solutions. 

• Create demos, slide decks, hands-on labs, sample code and reference architectures that engineers can reuse. 

• Run regular demo sessions, workshops and office hours that show new AI techniques applied to our own platforms. 

• Teach engineers how to structure context for AI, evaluate AI output, recognize common failure patterns and keep costs under control. 

• Build a community of practice: share lessons learned, publish internal guides and grow AI champions in each team. 

• Measure the impact of training through skills assessments and adoption, and update the curriculum as the technology changes. 

AI Platform Engineering 

• Build proofs of concept and prototypes for agents, RAG pipelines and multi-agent workflows to test ideas before teams commit. 

• Design evaluation suites (test sets, automated evals, regression checks and metrics) for AI features before and after release. 

• Work with engineers on LLMOps practices: CI/CD for AI, monitoring, versioning and observability. 

• Apply AI security and guardrails, including prompt injection defenses, content filtering, access controls and human approval for high-risk actions. 

• Make sure all AI solutions meet internal security, privacy, regulatory and responsible AI standards for financial services 

EDUCATION & EXPERIENCE:

 

• 5+ years in cloud, platform engineering, technical product ownership or technical program management. 

• 2+ years of hands-on work with generative AI, including building or shipping LLM applications, agents or RAG solutions. 

• Working knowledge of at least one major cloud (Azure, AWS or GCP) and its AI services. 

• Practical Python skills and experience with at least one LLM framework (such as LangChain, LlamaIndex or Semantic Kernel) or agent framework. 

• Understanding of RAG components: chunking, embeddings, vector databases, retrieval and optimization. 

• Experience designing evaluations for AI systems, with an understanding of common failure modes. 

• Knowledge of AI security risks, including prompt injection and data leakage, and how to mitigate them. 

• Demonstrated backlog management in Agile teams, using tools such as Jira and Confluence. 

• Proven ability to influence senior stakeholders across a matrixed organization. 

• Experience teaching technical topics, through workshops, demos, internal talks, documentation or mentoring. 

• Strong communication skills, with the ability to build clear presentations and explain complex AI ideas simply. 

Who We Are:

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to foster deeper relationships, ensure disciplined execution, and build a simpler, faster banking experience. TD is deeply committed to being a leader in client experience, that is why we believe that all colleagues, no matter where they work, are client facing. Together, we are reimagining what banking can be for our clients, colleagues and communities.

Our Total Rewards Package
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more

Additional Information:
We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.

Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.

Colleague Development

If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.

If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact.  

We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.

Training & Onboarding
We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.

Interview Process 
We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation
Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.

We look forward to hearing from you!

Language Requirement (Quebec only):

Sans Objet