As a Data Pipeline Developer with the Department of National Defence, you will design, build, and maintain automated data pipelines that enable artificial intelligence and machine learning applications across the organization. You'll work with large datasets, cloud infrastructure, and modern development tools to ensure data flows efficiently from source systems to analytical and operational platforms. Your work directly supports decision-making and operational effectiveness across DND, making you a critical part of our digital transformation.
In this role, you'll collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and translate them into robust pipeline solutions. You'll be responsible for data quality, security, and performance optimization, ensuring that sensitive defence information is handled appropriately throughout the pipeline lifecycle. Your day-to-day work involves coding, testing, monitoring systems, and troubleshooting issues that arise in production environments.
You'll work in a modern, technology-focused environment within DND's AI and digital innovation teams. This role offers exposure to cutting-edge tools, cloud platforms, and AI applications that support national defence objectives. You'll be part of a collaborative team that values innovation, continuous learning, and technical excellence.
Key Responsibilities
Contribute to artificial intelligence (ai) engineering & deployment projects and initiatives, Develop, test, and deploy AI/ML models and solutions, Analyze data to support evidence-based decision-making, Document technical approaches and ensure responsible AI practices
Required Skills
Python/R programming, Machine learning frameworks, Data analysis, Statistical modelling, Critical thinking, Technical proficiency, Attention to detail, Collaboration, Continuous learning
Typical Education
Post-secondary education or equivalent experience relevant to the position
Training
You should have a bachelor's degree in computer science, software engineering, data science, or a related field. Equivalent professional experience may be considered. Strong programming skills in languages such as Python, Java, or Scala are essential, along with experience working with big data technologies like Apache Spark, Hadoop, or similar frameworks.
Experience with cloud platforms (AWS, Azure, or Google Cloud) and data pipeline tools (Apache Airflow, Jenkins, or equivalent) is highly valued. Knowledge of SQL, data warehousing concepts, and ETL processes will strengthen your application. Security clearance eligibility is required for this role.
DND supports ongoing professional development through training programs, certifications in cloud platforms and data technologies, and conference attendance. You'll have opportunities to pursue certifications such as AWS Certified Data Analytics or Azure Data Engineer Associate. Mentorship programs and internal learning initiatives help you stay current with evolving AI and data engineering practices.
Entry Plans
You can enter this career through several pathways in the federal Public Service. Most positions are filled through competitive job competitions advertised on the Government of Canada Jobs website (jobs.gc.ca). You may also enter through designated pools or priority hiring initiatives for veterans or Indigenous peoples.
If you're a recent graduate, the Federal Student Work Experience Program (FSWEP) or the Post-Secondary Recruitment Campaign (PSRC) can provide pathways into DND. Lateral moves from other federal departments with similar AI, data, or IT roles are also possible if you meet the qualifications.
Security clearance processing is required for DND positions and typically takes several months. Early in your application, you should begin gathering the necessary documentation for security screening. Networking with current DND employees and attending recruitment events can help you learn about upcoming opportunities.
Part-Time Options
Data Pipeline Developer positions are typically full-time roles; however, DND is increasingly accommodating flexible work arrangements. Many positions in this field offer telework or hybrid options, allowing you to work from home for a portion of your week while maintaining collaboration with your team.
Part-time opportunities in this role are limited but may be available depending on operational needs and team structure. Your manager will work with you to establish arrangements that meet both organizational requirements and your personal circumstances. Remote work eligibility depends on security considerations and the nature of your projects, but technical roles like this often have greater flexibility than traditional office-based positions.
Flexible hours and compressed work weeks may be negotiable with your manager, subject to operational demands. DND's commitment to work-life balance means discussing your needs early in your employment relationship. Additional unpaid leave options and other flexible benefits are available through the federal Public Service.
Related Careers
No related military careers on file for this position.