Scope of Work:
The purpose of this engagement is to create assessment items aligned with the Armed Services Vocational Aptitude Battery (ASVAB) standards across eight components. We need SMEs across subject areas such Math, ELA, Science, and Technical.
The SME will generate assessment items and review content alignment (for any one or more of the subject areas) to ensure the quality and accuracy of the assessment items.
Assessments
- Create high-quality multiple-choice items for ASVAB subtests (you could have expertise in any one or more of the following components) :
- Math
- Arithmetic Reasoning
- Mathematics Knowledge
- ELA
- Word Knowledge
- Paragraph Comprehension
- Science
- General Science
- Technical
- Auto Information/Shop Information
- Mechanical Comprehension
- Electronics Information
The project involves AI-generated and SME-authored assessment items. The course will have only single-choice MCQs. These can be generated by AI or SMEs.
SME Responsibilities
The subject matter expert (SME) will collaborate with the Learning Design team to generate and review the AI-generated multiple-choice questions developed for each component. The SME will evaluate the questions for accuracy, pedagogical relevance, and rigor, and alignment to standards and/or Unpacked Standards Measurable Objectives (USMOs). The SME will review each question for:
- content accuracy and clarity, identifying any errors, ambiguities, or language or phrasing that is not grade-appropriate;
- pedagogical relevance, identifying and ensuring that the question assesses the intended skill in the most effective and clear way for the specific standard;
- rigor of assessment that aligns with testing best practices, ensuring that the question aligns accurately with the DOK level needed, has clear answers and distractors that are plausible, and is grade-appropriate in complexity, vocabulary, and cognitive requirement; and
- adherence to the client writing guidelines for assessment items; and SME will collaborate closely with the Learning Design team to ensure that any feedback provided is accurately applied to the generated questions, validating the items and providing sign-off on the content's accuracy, relevance, rigor, and adherence to standards or objective alignment.
Qualifications
Required
- Proven expertise as a Subject Matter Expert in one or more subject areas listed above.
- Demonstrated experience in authoring high-quality, rigorous assessment items for state or standardized testing.
- Strong understanding of Depth of Knowledge (DOK) levels and experience authoring questions at DOK Level 2 and DOK Level 3.
- High accuracy and turnaround time, as this is a very short project.
Preferred
- Experience in developing assessment items on the selected components
- Familiarity with accessibility standards as they relate to U.S. assessments.
- Prior experience in remote or project-based assessment development roles.
Inputs
To successfully complete the work, the SME will be provided with the following:
- Alignment documents
- Links to sample test items
- Access to LMs KADAL AI in case you would like to leverage the same for generating content
- Access to the relevant client guidelines
Critical Tasks
- Interact with all project stakeholders and communicate with senior project leadership for any clarification.
- Maintain confidentiality of content and strictly adhere to the NDA.
