Model Monitoring Analyst

Artificial Intelligence (AI) Risk & Performance Evaluation Employee

Apply

Overview

As a Model Monitoring Analyst in the Department of National Defence, you will play a critical role in ensuring that artificial intelligence systems operate safely, effectively, and in accordance with DND standards and Canadian values. You will be responsible for continuously monitoring AI models deployed across defence operations, identifying performance issues, risks, and areas for improvement. This role bridges the gap between technical AI development and operational security, making it essential to the Department's commitment to responsible AI use. Your day-to-day responsibilities will include tracking model performance metrics, analyzing system outputs for bias and drift, conducting risk assessments, and preparing detailed reports for senior decision-makers. You will work with cross-functional teams including data scientists, security specialists, and operational commanders to understand how AI systems are performing in real-world conditions. You will also recommend corrective actions when models underperform or when unexpected risks emerge. This is analytical work that demands attention to detail, problem-solving skills, and the ability to communicate complex technical findings to non-technical audiences. You will work in a modern, collaborative environment within DND's AI governance and risk management structures. Depending on your posting, you may work at National Defence Headquarters in Ottawa, at regional commands, or in specialized AI centres across Canada. The role offers exposure to cutting-edge defence technology while contributing directly to national security.

Key Responsibilities

Contribute to artificial intelligence (ai) risk & performance evaluation projects and initiatives, Develop, test, and deploy AI/ML models and solutions, Analyze data to support evidence-based decision-making, Document technical approaches and ensure responsible AI practices

Required Skills

Python/R programming, Machine learning frameworks, Data analysis, Statistical modelling, Critical thinking, Technical proficiency, Attention to detail, Collaboration, Continuous learning

Typical Education

Post-secondary education or equivalent experience relevant to the position

Training

To succeed in this role, you should hold a bachelor's degree in computer science, data science, statistics, engineering, mathematics, or a related field. Experience with machine learning concepts, data analysis, and performance evaluation is highly valued. Many successful candidates have completed coursework in AI, machine learning operations (MLOps), or risk management. Professional certifications that strengthen your candidacy include those in data analysis, cloud platforms (AWS, Azure, Google Cloud), or AI governance frameworks. The Government of Canada offers continuous learning opportunities, including training in federal AI ethics guidelines, Treasury Board policies on AI, and specialized technical certifications. DND also supports employees pursuing relevant graduate credentials or professional designations through tuition assistance programs. Once hired, you will receive comprehensive onboarding covering DND security protocols, the Canadian Armed Forces context, and specific monitoring tools and platforms used by the Department. Ongoing professional development is encouraged and may include workshops on emerging AI risks, advanced analytics techniques, and leadership skills for career progression.

Entry Plans

There are several pathways to enter the Model Monitoring Analyst role within the federal Public Service. The most common route is through open staffing competitions advertised on the Government of Canada Jobs website (jobs.gc.ca). These competitions are open to Canadian citizens and permanent residents and typically require you to demonstrate relevant education and experience through an application and interview process. If you are already working in the federal Public Service, you may be able to move into this role through internal lateral transfers or competitions restricted to current employees. The Department of National Defence also participates in student recruitment programs, including the Federal Student Work Experience Program (FSWEP) and Co-op programs, which can lead to permanent positions after graduation. For those with relevant AI or data analysis experience from the private sector, DND periodically conducts targeted recruitment campaigns and maintains talent pools for specialized technical roles. Keep checking the DND Careers portal and jobs.gc.ca for postings. Some candidates also enter this field by first securing related positions in data analysis, IT security, or business intelligence, then transitioning into dedicated AI monitoring roles as the Department expands its AI workforce.

Part-Time Options

Model Monitoring Analyst positions in DND are typically full-time permanent or term positions. However, the Government of Canada is committed to flexible work arrangements, and many teams within DND support hybrid work models that combine office time with remote work from home. Remote work options vary depending on your posting location and the specific duties of your position. Roles at National Defence Headquarters and major command centres tend to offer the most flexibility for remote work, particularly for analytical and reporting tasks that don't require hands-on access to classified networks or specialized equipment. You would typically be expected to be in the office 2-3 days per week, with the remainder working remotely. Part-time or job-sharing arrangements may be available but are less common for this specialized technical role. If you require part-time work or have specific scheduling needs, these can be discussed during the recruitment process and may be accommodated depending on operational requirements and team capacity. The Department prioritizes work-life balance and will work with you to find sustainable arrangements that support both your needs and operational effectiveness.