As an AI Testing and Evaluation Specialist with the Department of National Defence, you will play a critical role in assessing the performance, reliability, and safety of artificial intelligence systems used across defence operations. You will design and execute comprehensive testing protocols, analyze results, and provide evidence-based recommendations to ensure AI applications meet rigorous performance standards and align with Canadian defence objectives.
Your responsibilities will include developing test plans and evaluation frameworks, conducting performance assessments, documenting findings, and collaborating with AI development teams and subject matter experts. You will work to identify potential risks, validate system outputs, and ensure compliance with established guidelines and ethical standards. This role requires strong analytical skills, attention to detail, and the ability to communicate technical findings to both technical and non-technical stakeholders.
You will work in a dynamic environment that spans offices, laboratories, and operational settings. Your work will directly contribute to the safe and effective deployment of AI technologies within the Canadian Armed Forces and the Department of National Defence, supporting mission-critical operations and decision-making processes.
Key Responsibilities
Contribute to artificial intelligence (ai) risk & performance evaluation projects and initiatives, Develop, test, and deploy AI/ML models and solutions, Analyze data to support evidence-based decision-making, Document technical approaches and ensure responsible AI practices
Required Skills
Python/R programming, Machine learning frameworks, Data analysis, Statistical modelling, Critical thinking, Technical proficiency, Attention to detail, Collaboration, Continuous learning
Typical Education
Post-secondary education or equivalent experience relevant to the position
Training
Successful candidates typically hold a bachelor's degree in computer science, software engineering, data science, mathematics, or a related discipline. Relevant experience in software testing, quality assurance, systems evaluation, or AI/machine learning is highly valued. Many positions require familiarity with testing tools, programming languages, and data analysis methodologies.
Professional development opportunities within DND include specialized training in AI systems evaluation, advanced statistical analysis, cybersecurity assessment, and defence-specific applications. The Government of Canada supports ongoing learning through certifications in software testing (ISTQB), data science, and emerging AI evaluation frameworks. Access to professional development funds and tuition support programs helps you stay current with rapid advances in AI technology and evaluation practices.
Entry Plans
Entry into this career is typically through federal Public Service competitions advertised on the Government of Canada Job Bank and the DND Civilian Workforce website. Positions are available at various levels, from junior specialist roles (AS-01/AS-02) through to senior positions, allowing for career progression based on experience and qualifications.
You may enter through several pathways: direct external competitions for specific positions, participation in talent pools for emerging recruitment needs, or lateral moves within the Public Service if you possess transferable skills in software testing, quality assurance, or systems analysis. Recent graduates can explore the Federal Student Work Experience Program (FSWEP) or post-graduation recruitment initiatives. DND also considers candidates from the private sector, academia, and other government departments with relevant expertise in AI testing and evaluation. Preference may be given to Canadian citizens, though permanent residents are also eligible for consideration.
Part-Time Options
Part-time and flexible work arrangements are available for many AI Testing and Evaluation Specialist positions, depending on operational requirements and the specific role. Some positions within DND allow for compressed work weeks, flexible schedules, or job sharing arrangements to support work-life balance.
Remote work options have expanded across the federal Public Service, and many testing and evaluation activities can be performed remotely when appropriate. However, some duties may require on-site presence for hands-on testing, collaboration with development teams, or security-related work in controlled environments. The extent of remote work flexibility varies by position and project needs. During recruitment, specific details about part-time availability, flexibility, and remote work arrangements for each position will be clearly outlined in the competition notice. Interested candidates are encouraged to inquire about these arrangements when applying or speaking with recruiters.
Related Careers
No related military careers on file for this position.
