Kryterion is thrilled to add an innovative, AI-supported item-writing capability to its Webassessor™ platform. This cutting-edge feature will help item content developers generate multiple-choice and multiple-select questions more efficiently than ever. Webassessor now offers a seamless blend of manual and AI-assisted item creation, streamlining test question development and advancing quality.
Our new AI-powered tool is a standard feature, available to all Webassessor users.
Simplified Prompt Engineering: A Smarter Approach
Creating effective prompts is challenging for many. Happily, Kryterion’s AI item-writing tool makes it easy. We’ve simplified the process with a field-based prompt template that guides item writers step-by-step. No need to struggle with phrasing or format—simply complete the fields, and let the AI do the work.
The template includes fields for specifying key details, such as the item topic, type, and number of answer choices. Optional fields allow further customization, letting users set the desired number of correct answers, candidate background (such as profession, experience level, and education), relevant knowledge areas, and cognitive level based on Bloom’s Taxonomy.
We’ve also included an option for inclusive language settings, allowing users to select gendered or non-gendered pronouns, ensuring that content aligns with your organization’s standards.
Figure 1: Standard AI item writing prompt template
Flexible Integration with Leading Language Models
Kryterion’s AI item writer is currently powered by ChatGPT and is accessible through Kryterion’s own service account. However, since Webassessor’s design allows for flexibility, clients preferring to use their own ChatGPT account can easily integrate it by adding their unique API token. Webassessor can also support other large language models (LLMs), such as Gemini or Claude, offering organizations complete control over their item-writing process.
Enhanced Learning with Autogenerated Feedback
Our AI tool goes beyond item generation with an automatic feedback field, providing insights on each answer choice—why it’s correct or incorrect. This feature adds educational value and ensures item clarity, aligning each rationale with test objectives. Subject matter experts (SMEs) can edit this feedback to refine explanations, tailoring items to better meet specific requirements.
Rapid Refinement for Optimal Results
Figure 2: Full AI item writing prompt template
To achieve the desired item, writers can modify their inputs and regenerate content as often as needed, making item refinement a quick, iterative process. This dynamic approach reduces manual steps and accelerates test content development, helping organizations create high-quality items faster.
Human-AI Collaboration Ensures Quality and Fairness
While AI simplifies and accelerates item creation, SMEs remain essential in reviewing and validating the output to ensure accuracy, fairness, and objectivity. This “human-in-the-loop” approach is especially crucial for high-stakes exams where bias-free, reliable assessment is critical.
Kryterion’s flexible AI-powered item-writing tool on the Webassessor platform supports organizations in creating effective, accurate, and custom assessments. This innovative technology helps clients meet the highest standards with speed and precision, empowering credentialing bodies and test developers to deliver better assessments, faster.
A Trusted Partnership in Test Development
With over 20 years of leadership in testing and development, Kryterion is a name clients trust. Our 96% candidate satisfaction rate and 98% client retention rate reflect our commitment to a seamless, secure testing experience.
Interested in learning more about Kryterion’s AI-powered item writing, AI Proctor Assist, or other secure testing solutions? Schedule a call with our experts and request a demo.
Kryterion’s team lives its purpose: Improving lives, one test at a time.
About Kryterion Inc.
Kryterion Inc. is a global leader in innovative testing and credentialing solutions, helping organizations across various sectors develop and manage their assessments with our advanced test development platform and multi-modal delivery solutions. Established in 2001, Kryterion offers secure, integrated services and extensive support, empowering candidates to demonstrate skills and achieve success in world-class careers.
