Study guides / AI Instructions & Evaluation / Beginner

Specify useful behavior

A good instruction defines the task, the permitted evidence, and what the system should do when it cannot answer.

Usevra Learn · learn.usevra.com/guides/evaluation-beginner

Describe the output contract

State the audience, goal, constraints, and required fields. Add a small representative example when it clarifies an ambiguous format. Avoid contradictory instructions and do not bury mandatory rules in a long block of background material.

Define uncertainty behavior

Tell the system when to ask for missing information, cite a source, or abstain. A requirement to always produce an answer encourages unsupported guesses. Distinguish instructions from quoted material that the system is supposed to analyze.

Check against a rubric

Define correctness, completeness, source support, and format compliance separately. A response can be beautifully written but factually wrong. Use representative cases and explicit expected properties instead of judging only whether the result sounds good.

A worked example

You need a support reply based on a supplied returns policy.

Require the response to use the supplied policy, identify missing purchase details, and avoid promises not supported by that policy. Score policy accuracy separately from tone.

The point: Style and correctness are separate dimensions.

Check your understanding

These are learning exercises, separate from the scored exams. Choose an answer, then check the explanation.

1. Which instruction improves handling of missing evidence?
2. A response is polite but contradicts the policy. How should it score?

Before you take the exam

Explain these concepts in your own words, work through a different example, and describe why the tempting alternatives fail. Use the references to go deeper.

Beginner assessment: 25 questions · 35 minutes · 80% pass mark. Check the assessment page for current rules.
View the assessment ↗

Reading progress stays on this browser. It is not an exam result.