Job Description

  1. Senior Programmer/Analyst
    1. Technical Expertise and Oversight: Provide guidance to support the effective development, deployment, and functional evaluation of a computer adaptive cognitive assessment, based on the organization’s IT platform, the psychometric requirements of the assessment, and available programming options.
    2. Development: Develop, modify, or evaluate a computer adaptive assessment of cognitive ability, and/or support the development of other types of cognitive assessments (e.g. gamification of an existing assessment, working memory).
  • Testing and Evaluation: Conduct rigorous testing and validation of the developed assessment for quality assurance, compliance with psychometric best practices, and/or alignment with modern human resources practices.
  1. Collaboration and Reporting: Work closely with the Technical Authority and internal stakeholders to ensure alignment with the CAF’s modernization initiatives. Prepare or oversee preparation of technical documentation, as required.

M1

Language Capacity

The Bidder’s proposed resource(s) must demonstrate the capability to draft documentation and to clearly articulate concepts in English both in writing and orally with minimal error, and without assistance.

This will be evaluated using the quality of the Curriculum Vitae (CV).

M2

Education

Page Limit: one (1) page  

The Bidder’s proposed resource must hold one (1) of the following from a recognized Canadian university, or an equivalent credential from an accredited foreign institution:

Option 1:

A Doctor of Philosophy (PhD) in one of the following disciplines:

· Psychology with a specialization in Psychometrics or Quantitative Psychology; or

· Education with a specialization in Measurement, Evaluation, or Research Methodology.

Option 2:

A master’s degree in psychology in one of the following disciplines:

· Psychology with a specialization in Psychometrics or Quantitative Psychology; or

· Education with a specialization in Measurement, Evaluation, or Research Methodology.

AND a minimum of five (5) years of experience in developing and evaluating standardized assessments or psychometric tools.

The Bidder must identify the experience using the following format: 

  • Name of Employer: 
  • Position Title:  
  • Dates of Employment:  
  • Employer Representative: 
  • Employer Contact Information:  
  • Key responsibilities: 

A copy of the resource’s diploma(s) and a complete curriculum vitae (CV) must be included with the proposal.

M3

Experience - Test Development & Evaluation Knowledge

Page Limit: one (1) page  

The Bidder’s proposed resource must have at least ten (10) years of experience and have worked on at least three (3) of the five (5) following aspects of test development and evaluation, with a focus on their role and the impact of their work.

· Computer Adaptive Testing (CAT) / Item Response Theory (IRT)

· Psychometric Evaluation of Tests (test and item level)

· Test Design and Assembly

· Item Banking

· Test Equating

The Bidder must identify the experience using the following format: 

· Name of Employer: 

· Position Title:  

· Dates of Employment:  

· Employer Representative: 

· Employer Contact Information:  

· Key responsibilities: 

The Bidder must include a complete curriculum vitae (CV) for the proposed resource.

M4

Experience – Statistical Programming

Page Limit: one (1) page  

The Bidder’s proposed resource must have at least ten (10) years of experience leading or programming a test or an assessment system using statistical programming languages such as R, Python, or other similar languages (e.g., SAS, Matlab, SQL).

The Bidder must identify at least two (2) relevant projects where their proposed resource(s) either programmed directly or responsible for the oversight of programming.

The Bidder must identify the experience using the following format: 

· Name of Employer: 

· Position Title:  

· Dates of Employment:  

· Employer Representative: 

· Employer Contact Information:  

· Key responsibilities: specify whether the proposed resource was responsible for programming directly or overseeing a programming team. List the programming language(s) used in the project.

· Description of the Project: brief summary of the scope and objectives.

The Bidder must include a complete curriculum vitae (CV) for the proposed resource.


Details

Employee Type
Contract Full-Time
Location
ON - Ottawa
Language Requirement
English
Date Posted
3/11/2025

Position Id
EB-9110897139