Source check
- Each answer shows its sources with links
- Source title and last checked date are shown
- Source belongs to this college and is in approved status
Guides
Test answers before you publish an assistant
Test in the test panel, check sources on each answer, check the not-known path, and fix what needs work. Test conversations are labeled as test and do not count in usage or satisfaction reports.
Who can do this
A builder or college administrator tests the assistant. An approver reads the test results with the assistant submission. Test as a prospective student, a current student, and staff where the assistant serves more than one group.
Step 1: Open the assistant test panel
Open Assistants, open the draft assistant, and choose the test panel. Confirm the assistant name, college, and draft status. Draft changes do not affect the live assistant until you publish. Start over in the test panel when you change sources or wording.
Step 2: Ask a question the source can answer and open its source link
Type the question in plain words. Read the answer. Open each source link under the answer. Confirm the source title, link, and last checked date match an approved source for this college. Confirm the answer lists at least one source. An answer with no source is a failure. Do not publish it.
Step 3: Ask a question the source cannot answer and check the handoff
Ask a question outside the approved sources. Confirm the screen says plainly that it does not know, names the handoff office with phone, email, and hours, and offers a way to hand off. Confirm it does not guess and does not ask for student record details in a public chat.
Step 4: Mark each result pass or needs work with a note
Mark the first result pass only if the answer and source links are correct. Mark the second result pass only if the not-known message and handoff are correct. For any result that needs work, add a note that names the issue, such as source out of date, answer did not cite a source, or wording unclear. The test record shows who tested it and when.
Step 5: Fix the source or wording and test again before approval
Fix the source page or file, re-approve the source if its content changed, or fix the assistant wording. Start over in the test panel and test again. Submit the assistant for approval only when test results show pass for both paths. Keep the test notes with the approval record.
Checks a reviewer will read
An approver reads sources, wording, and test results together. Make the record easy to read.
Not-known check
- Plain statement that approved sources do not cover it
- Named office with contact details and hours
- No answer without a source
Draft check
- Writing and translation drafts are labeled as drafts
- Drafts never send without a person editing and saving them
- Staff replies draw only from approved sources and show sources to staff
Test by keyboard and phone
Tab through the ask screen and widget, confirm labels on every field, visible focus, and large tap targets. Test on a phone and a desktop browser. Record any barrier and fix it before wider rollout. The access commitment is WCAG 2.1 AA, with an audit in the pilot. A VPAT for the college configuration will be completed during evaluation.
Next guide
Publish the widget after your assistant is approved.