Program Development Specialist B

Position Details

https://www.gov.nl.ca/education

Reporting to the Director of Evaluation and Research, the Program Development Specialist B, will serve as the Department’s expert in analyzing large-scale assessments and examinations. Their work will ensure our provincial assessments are reliable, valid, and fair, supporting accurate interpretations of student learning across Newfoundland and Labrador. This position will play a central role in shaping the statistical foundations of our assessments—providing the analytical structure that ensures sound decision-making based on test results. The incumbent will implement statistical methodologies that underpin provincial assessments, conduct comprehensive data analysis for field tests and operational assessments, ensure assessments and exams meet high standards of reliability, validity, and fairness and contribute psychometric expertise to test development, scoring, scaling, equating and reporting. They will also provide guidance and interpretation of results to inform educational decision-making.

Key Responsibilities

• Collaborate with the assessment design team and management to assist with planning for provincial level student assessments.
• Conduct statistical modeling & large-scale data analysis. This would include; analyzing, calibrating, and scoring provincial standardized student assessments, conducting test equating, standard setting panels, as well as cleaning, transforming, and merging large datasets.
• Advise on field testing methodologies, process field test data, and produce field test reports to inform future assessment design.
• Advise on assessment design that supports reliability, validity, fairness, and bias mitigation.
• Exercise a high degree of discretion when handling highly sensitive and secure provincial student data.
• Conduct jurisdictional scans and research to support implementation of modern best practices in large-scale assessment development and analysis.
• Prepare and present clear and concise research reports, including data visualizations, to support decision-making.
• Provide support and guidance on divisional research.

 Perform other related duties as required

Screening Criteria

1. Completion of an advanced degree in quantitative research (e.g. Master of Psychometrics, Master of Statistics, Master of Applied Psychological Science - equivalencies will be considered).
2. Experience in statistical data collection, analysis, and reporting using very large data sets.
3. Experience using statistical analysis software (e.g., SPSS, R, Iteman, Parscale, or equivalent).
4. Experience writing and presenting highly complex statistical reports.
5. Experience in using psychometric data analysis techniques used in large-scale student assessments.

Assessment Criteria

1. Knowledge of and experience with psychometric data analysis techniques used in large-scale student assessments.
2. Knowledge of and experience in advising assessment design that supports reliability, validity, fairness, and bias mitigation.
3. Knowledge of and experience with statistical analysis software.
4. Knowledge of and experience with managing data in very large data sets.
5. Ability to effectively exchange information.
6. Ability to work independently or as part of a team.
7. Ability to manage time and tasks.

Information for Applicants

For more information about this opportunity please contact, Doug Pippy, Director of Evaluation & Research, DougPippy@gov.nl.ca

• The Government of Newfoundland and Labrador values inclusion, diversity, equity and accessibility, and a workplace culture that benefits from varying ideas and lived experiences.
• Accommodations and alternate assessment formats are available upon request at any stage of the recruitment process by contacting recruitment@gov.nl.ca, 709-729-0130 or toll free at 1-888-729-7690. Video Relay Service (VRS) calls are welcomed.
• We are committed to providing an inclusive recruitment process with a focus on removing barriers. For common potential accommodations and adjustments during the recruitment process, click here. Accommodation information will be kept confidential.
• Preference will be given to applicants who are a Canadian citizen or permanent resident of Canada or those who are legally entitled to work in Canada.
• Applications must be received by the closing date stated in the job posting.
• It is the responsibility of applicants to submit a resume that clearly demonstrates the required screening criteria outlined in the job description.
• Applications must contain current contact information, including phone number, mailing and, e-mail addresses.
• Application information must be factual, complete and current, to date of submission.
• This competition may be used to fill future similar vacancies with the Government of Newfoundland and Labrador.