Today's AI Tip
← All posts

Give AI permission to say I don't know. Then compare.

· View on Instagram · View on Facebook

Give AI permission to say I don't know. Then compare.
Five questions, three answers. Most of us paste a contract and ask questions. Here the fictional contract answers three of the five. It's silent on cancellation notice and on price changes.

Five questions, three answers

Most of us paste a contract and ask questions. Here the fictional contract answers three of the five. It's silent on cancellation notice and on price changes.

The plain prompt. This is the plain version. We pasted a fictional supply contract under it and ran it once in GPT-5.5.

The plain prompt

Answer these questions about our supplier contract. 1. When do we have to pay invoices? 2. What happens if a delivery is late? 3. Who pays for shipping? 4. How much notice do we need to give to cancel the contract? 5. Can the supplier raise prices during the year?

Tested in GPT-5.5 (OpenAI API), Oct 2026

This is the plain version. We pasted a fictional supply contract under it and ran it once in GPT-5.5.

It answered all five. In this run, GPT-5.5 answered every question. Question 4 was handled right. On question 5, it turned the contract's silence into “not expressly permitted.”

It answered all five

Real output · GPT-5.5 (OpenAI API) · Oct 2026

… The contract **does not specify** any notice period for cancelling the agreement. … 5. **Can the supplier raise prices during the year?** The contract says prices are as shown in the attached price list, but it **does not include a clause allowing the Supplier to raise prices during the year**. So based on this wording, price increases are not expressly permitted unless agreed separately.

In this run, GPT-5.5 answered every question. Question 4 was handled right. On question 5, it turned the contract's silence into “not expressly permitted.”

Where the guess slipped in. Question 5 started right, then drew a conclusion the contract doesn't support. Silence isn't a no. In this run, 3 answers came from the contract, 1 was correctly flagged as unspecified, and 1 was an inference.

Where the guess slipped in

Question 5 started right, then drew a conclusion the contract doesn't support. Silence isn't a no. In this run, 3 answers came from the contract, 1 was correctly flagged as unspecified, and 1 was an inference.

Add one permission line. Anthropic's guide recommends giving the AI explicit permission to admit uncertainty. This line does that. We ran it in GPT-5.5 only, not Claude.

Add one permission line

Answer these questions about our supplier contract. Use only the contract. If the contract doesn’t answer a question, write “The contract doesn’t say” instead of guessing. 1. When do we have to pay invoices? 2. What happens if a delivery is late? 3. Who pays for shipping? 4. How much notice do we need to give to cancel the contract? 5. Can the supplier raise prices during the year?

Tested in GPT-5.5 (OpenAI API), Oct 2026

Anthropic's guide recommends giving the AI explicit permission to admit uncertainty. This line does that. We ran it in GPT-5.5 only, not Claude.

Source: Anthropic, Reduce hallucinations, checked Oct 2026

Same questions, one extra line. In our GPT-5.5 test, questions 1 to 3 were answered from the contract. Questions 4 and 5 now read “The contract doesn’t say.”

Same questions, one extra line

Real output · GPT-5.5 (OpenAI API) · Oct 2026

1. Invoices are due within 30 days of the invoice date. 2. If a delivery arrives more than two business days late, the Buyer may cancel that order at no charge. 3. Delivery is free on orders over $300. For orders of $300 or less, the Buyer pays a $25 delivery fee. 4. The contract doesn’t say. 5. The contract doesn’t say.

In our GPT-5.5 test, questions 1 to 3 were answered from the contract. Questions 4 and 5 now read “The contract doesn’t say.”

What it still missed. Neither run noticed that clause 7 points to a price list that was never pasted, so “doesn't say” means “not in what you pasted.” Anthropic says these techniques reduce errors, not eliminate them.

What it still missed

Neither run noticed that clause 7 points to a price list that was never pasted, so “doesn't say” means “not in what you pasted.” Anthropic says these techniques reduce errors, not eliminate them.

Try it: Check each “doesn't say” against the original, including anything it points to.

Source: Anthropic, Reduce hallucinations, checked Oct 2026

Sources and assumptions

Assumptions:

The short version

Follow @todaysaitipSave this post on Instagram

More posts