SOP & Checklist
Use this page as your repeatable guide for the dual-AI Regents-style assessment workflow. The SOP spells out each phase; the checklist gives you a concrete list to follow so you don't skip steps.
Standard operating procedure
Follow these phases in order. Each phase has a clear input and output so you can hand off or revisit work consistently.
Phase 1: Regents (or exam) analysis
Input: Released Regents exams or other target high-stakes assessments (PDFs or text).
Actions: Use AI to summarize question types, command verbs, stimulus use, and scoring patterns. Capture the output as a short style guide (bullets or a one-page reference).
Output: A written style reference you will use to prompt and validate later questions.
Phase 2: Curriculum analysis
Input: Your unit or course materials: objectives, key concepts, scope-and-sequence, or standards alignment for the unit being assessed.
Actions: Use AI to extract a concise summary of content and skills in scope. Keep it grounded in your actual documents—no invented topics.
Output: A written curriculum summary (or checklist) that defines what is in scope for this assessment.
Phase 3: Draft generation and cross-validation
Input: Your style reference (Phase 1) and curriculum summary (Phase 2).
Actions: Prompt AI to generate draft questions using both references. For each draft, check: (a) Does it match the exam style and command language? (b) Does it align to the curriculum summary and avoid out-of-scope content? Revise or discard items that don't pass.
Output: A set of draft questions that have been validated against both sources.
Phase 4: Visual stimuli (if applicable)
Input: Any maps, graphs, images, or passages that will serve as stimuli.
Actions: Source or create stimuli yourself. Use AI only to generate or refine questions that refer to those stimuli. Do not rely on AI to generate the visuals.
Output: Stimulus materials plus aligned questions, with stimuli under your control.
Phase 5: Final review and approval
Input: All draft questions and stimuli from Phases 3–4.
Actions: Read every item. Confirm alignment to curriculum and style, adjust wording or difficulty, and approve or reject. Make the final call on what goes on the assessment.
Output: Approved assessment ready for use.
Keep it source-grounded
At every phase, tie outputs to your actual documents (exam materials, curriculum). When in doubt, refer back to the source rather than accepting an AI summary at face value.Practical checklist
Use this list when running the workflow. Check off each item as you complete it. Optional items are marked so you can adapt to your context.
Before you start
- Gather released Regents (or target exam) materials
- Gather unit/course materials (objectives, concepts, scope)
- Decide which unit or standard set this assessment will cover
Phase 1: Regents analysis
- Run AI analysis on exam structure and style
- Document question types and command verbs
- Note how stimuli are used (maps, graphs, passages)
- Save a short style reference for later use
Phase 2: Curriculum analysis
- Run AI analysis on your curriculum materials
- Extract in-scope content and skills only
- Review summary for accuracy against your sources
- Save curriculum summary for this assessment
Phase 3: Draft generation and cross-validation
- Prompt AI with style reference + curriculum summary
- Generate draft questions
- Check each draft against style reference
- Check each draft against curriculum summary (no out-of-scope content)
- Revise or discard items that don't align
Phase 4: Visual stimuli (if needed)
- Source or create all maps, graphs, images, or passages
- Generate or refine questions that reference those stimuli
- Verify each question matches the stimulus (no hallucinated details)
Phase 5: Final review
- Read every question end to end
- Confirm alignment to curriculum and style
- Edit wording or difficulty as needed
- Approve final set and prepare for administration
For more context on each phase, see the Workflow Overview.