Senior AI Engineer for Observability
BMO — Toronto, ON, CAN
Posted 2026-10-21
Application Deadline: 11/29/2026 Address: 33 Dundas Street West Job Family Group: Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM calls, monitor token usage, detect drift, set up automated evaluations, and govern autonomous agent behaviors in production. Designs and develops machine learning (ML) and deep learning systems. Runs machine learning tests and experiments. Trains and retrain systems to prevent drift and optimize results. Solves complex problems with multi-layered data sets, extends existing ML frameworks and optimizes existing machine learning libraries. Develops Machine Learning apps, implements algorithms, and builds tools to apply ML frameworks. Turns unstructured data into useful information by auto-tagging images and text-to-speech conversions. Develops ML algorithms to analyze huge volumes of historical data to make predictions. Runs tests, performs statistical analysis, and interprets test results. Focus is primarily on business/group within BMO; may have broader, enterprise-wide focus. Provides specialized consulting, analytical and technical s