Working with AI: Prompting, Context and Verification
Directed Studies on Artificial Intelligence in Health Sciences
Learning objectives for this lesson:
- Explain the jagged frontier of AI capability and map it for your own tasks with known-answer tests.
- Distinguish the centaur and cyborg working styles and choose a way of working that keeps checks in place.
- Write effective prompts with a six-part structure of role, task, context and audience, examples, format and constraints.
- Use few-shot examples, step-by-step instructions, clarifying questions and refinement, and supply context through files, projects and standing instructions.
- Classify errors in AI output as fabrication, misattribution, outdated information, errors of arithmetic and logic, or sycophancy.
- Apply a verification routine scaled to the stakes of a task, using lateral reading, primary-source checks, recomputation and comparison across tools.
- Classify information as public, own work, confidential or personal before entering it into any AI tool, and compare the data terms of consumer and institutional accounts.
- Describe SFU's guidance on AI use in courses, cite AI output in APA style and keep an AI use log.
This course was developed by Dr. Kiffer G. Card, Faculty of Health Sciences, Simon Fraser University. Product examples are current as of 2026.
The Jagged Frontier
Learning Objectives for this section
- Explain what the jagged frontier is and why the capability of AI tools is uneven across tasks that seem equally difficult to people.
- Summarize the design and main findings of the field experiment by Dell'Acqua and colleagues (2023), both inside and outside the frontier.
- Distinguish the centaur and cyborg working styles and judge which style suits a given task.
- Explain, from the way language models produce text, why some kinds of task usually fall inside the frontier and others fall outside it.
- Map the frontier for your own tasks by testing tools on problems whose answers you already know.
1.1 Why AI Capability Is Uneven
Most people who use a general-purpose assistant for a few weeks have a puzzling experience. The assistant explains a difficult idea, such as the difference between a confidence interval and a prediction interval, more clearly than many textbooks do. In the next conversation it supplies a reference to a journal article that does not exist, or it miscounts the words in a short paragraph. To a person, these tasks differ greatly in difficulty: explaining a statistical concept takes years of training, while counting words takes only patience. The assistant's performance runs in the opposite direction.
Dell'Acqua and colleagues (2023) gave this pattern a name. They described the capability of AI as a jagged frontier, a boundary between the tasks that a tool performs well and the tasks that it performs poorly. The boundary is jagged because it does not follow the human sense of what is easy and what is hard. Tasks inside the frontier can be done faster and to a higher standard with AI help. Tasks outside it, including some that look simple, are done badly, and the output for these tasks usually looks as fluent and confident as the output for tasks inside the frontier. This last feature is what makes the frontier important for users. A tool that failed visibly would be easy to use safely. A tool whose failures look like its successes can be used safely only by someone who knows where the boundary lies for the task in front of them.
Lesson 2 explains the mechanism behind this unevenness. A large language model writes by repeatedly estimating the probability of the next token (a word or part of a word), using patterns learned from a very large body of text. Explaining, restructuring, summarizing, translating and drafting draw directly on those patterns, so the model does them well. Exact recall of a specific detail, such as the page numbers of an article, depends on whether that detail was learned precisely, and a model that learned only the general shape of such details produces the right shape with the wrong content. Recent events, local information and precise arithmetic are also weak unless the tool can search, retrieve documents or run code. Judgements about what a particular community or organization values fall outside the frontier because the tool has no access to that knowledge unless someone supplies it.
Box 3.1 introduces the fictional case of Jordan, a co-op student whose work with the Cedar Valley pilot runs through this lesson, and Figure 3.1 then sketches the frontier for a general-purpose assistant.
The Cedar Valley Health Authority is a fictional, mostly rural health authority in British Columbia with about 210,000 residents, about 46,000 of them aged 65 and older, and 24 primary care clinics. Its population health team runs the Cedar Valley Connector program, a community connector (social prescribing) program for adults aged 65 and older who screen as socially isolated or lonely. For one year, the team is piloting an enterprise AI assistant that the health authority procured after a privacy impact assessment. The pilot operates under the Responsible AI Policy Framework for the B.C. Health Sector (Ministry of Health, June 2026). The assistant may be used with public documents, internal non-confidential documents and aggregate data, and it must never receive personal health information or other identifiable data. The team keeps an AI use log for the pilot.
Jordan, a Health Sciences co-op student, joins the team for a four-month placement. In Jordan's first week, the team lead asks them to find out where the assistant can be relied on for the team's routine work and where it needs close checking. Jordan also uses general-purpose assistants for their own studies. This lesson follows Jordan as they map the frontier (this section), write better prompts (Section 2), verify output (Section 3) and decide what information may go into which tool (Section 4).
Figure 3.1 arranges tasks in four broad kinds that recur throughout the course. The frontier reaches furthest for transforming material that you supply and is shortest for recalling specific facts and sources. Counting and calculating sit in between and move inward when the tool runs code. Judging local needs and values lies largely outside, because the information lives with people and organizations.
Section 1.1 has described the frontier and the mechanism behind its shape. Section 1.2 turns to the field experiment that gave the frontier its name and measured what happens on each side of it.
1.2 The Consulting Experiment
The evidence for the jagged frontier comes from a preregistered field experiment with 758 consultants at Boston Consulting Group, about 7 percent of the firm's consultants (Dell'Acqua and colleagues, 2023). A preregistered experiment is one whose hypotheses and analysis plan were recorded before the data were collected, which protects against choosing the analysis after seeing the results. The consultants were randomly assigned to work without AI, with access to GPT-4, or with access to GPT-4 together with a short overview of prompting techniques. The researchers designed a set of tasks chosen to lie inside what GPT-4 could do and one task chosen to lie outside it.
Inside the frontier, the consultants completed 18 realistic tasks built around the development of a new product, including generating ideas, analyzing a market and writing persuasive material. Consultants with AI completed 12.2 percent more tasks, finished them 25.1 percent more quickly on average, and produced work rated more than 40 percent higher in quality than the work of consultants without AI. The consultants who had scored lowest on a baseline task gained the most (an improvement of 43 percent compared with 17 percent for higher-scoring consultants), so AI narrowed the gap between weaker and stronger performers on these tasks.
Outside the frontier, the consultants worked on a business problem that required them to combine figures from spreadsheet data with details from interview notes. GPT-4 tended to produce a confident, well-organized answer that missed the details on which the correct recommendation depended. Without AI, about 84 percent of consultants reached the correct answer. With AI, only 60 to 70 percent did. Many consultants accepted a persuasive analysis that was wrong, and the quality of the writing gave no sign of the error.
Table 3.1 sets out these results for the tasks inside the frontier and for the task outside it.
Table 3.1. Main results of the field experiment by Dell'Acqua and colleagues (2023), as reported by the authors.
| Measure | Consultants without AI | Consultants with AI |
|---|---|---|
| Tasks completed, inside the frontier | Reference level | 12.2 percent more tasks |
| Time taken, inside the frontier | Reference level | 25.1 percent faster on average |
| Quality of work, inside the frontier | Reference level | More than 40 percent higher |
| Correct answers, outside the frontier | About 84 percent | About 60 to 70 percent |
Box 3.2 considers how far results obtained with management consultants and GPT-4 in 2023 apply to health sciences students and public health staff.
Box 3.2: What the study can and cannot tell a health sciences student
The participants were management consultants working on business tasks with GPT-4 in 2023, and newer tools perform differently; some tasks that lay outside the frontier then now lie inside it for tools that search or run code. Applying the findings to students and public health staff is a reasonable inference, because the mechanism behind the result (fluent output that conceals errors on tasks the model handles poorly) belongs to the technology. The study's lasting contribution is a method and a warning: capability has to be established task by task, and a user cannot read it from the fluency of the output.
The experiment showed gains in speed and quality inside the frontier and a loss of accuracy outside it. The next subsection describes the two working styles that the researchers observed among consultants who used the tool successfully.
1.3 Centaurs and Cyborgs
The researchers also examined how successful consultants worked with the tool, and they described two working styles. Centaurs, named after the mythical creature that is half human and half horse, divided the work: they drew a clear line between the parts they did themselves and the parts they delegated to the AI, and they chose the division according to what each did well. Cyborgs integrated their work with the AI throughout, passing text back and forth, asking for revisions, editing the output and returning it for further work, so that the contributions of person and machine were intertwined at every step.
Both styles can produce good work, because in both the person stays aware of the frontier: a centaur keeps the outside-the-frontier parts of a task, and a cyborg reviews every exchange. The failure that the experiment exposed is a third pattern, in which a person hands a whole task to the tool and accepts the result without examining it.
The tabs that follow give an example of each style from Jordan's work and set out the kinds of task that suit each style.
The team lead asks Jordan to brief the team on a public provincial report about healthy aging, including its figures on social isolation. Working as a centaur, Jordan asks the assistant to summarize the executive summary, a transformation of supplied material that lies inside the frontier. Jordan copies the figures from the report's own tables, because transcribing numbers from long documents is at the edge of the frontier. Jordan writes the paragraph on what the report means for the Connector program, because that judgement depends on local knowledge the tool lacks.
Jordan is drafting an email that invites a seniors' centre coordinator to an information session. Working as a cyborg, Jordan writes a rough draft, asks for three alternative opening sentences, combines two of them, asks whether the tone is too formal, accepts a suggestion to shorten the second paragraph, and rejects a suggestion that would have promised free transportation, which the team has not arranged. Each exchange is short and visible, so each error can be caught as it appears.
The centaur style suits tasks that divide into parts with different frontier status, such as a report that combines a summary (inside), figures (at the edge) and local recommendations (outside). The cyborg style suits tasks that are mostly inside the frontier and where every step can be inspected, such as revising a draft. Both fail when the person stops checking, and trust built on tasks inside the frontier can carry over unnoticed to a task outside it. For that reason the frontier map in Section 1.4 records the check that each task needs.
Both styles depend on knowing where the frontier lies for each part of a task. The next subsection sets out a method for finding that boundary for a particular tool and kind of task.
1.4 Mapping Your Own Frontier
The frontier differs between tools, versions and kinds of task, so the dependable way to find it for your own work is to test tools on problems whose answers you already know. A known-answer test is a task given to an AI tool for which the user has an independent, trusted answer, so that the output can be scored as correct, partly correct or wrong. The method resembles the validation of a measurement instrument against a reference standard.
A practical frontier map can be built in an afternoon with five steps.
- List the tasks that you already use AI for, or would like to, and group them into the four kinds shown in Figure 3.1.
- For each task, find a version whose correct answer you know independently, such as a worked problem from a textbook, a paper you have read closely, a calculation you have done by hand or a document you wrote yourself.
- Give the task to the tool exactly as you would in real use, and compare the output with the known answer, recording omissions as well as errors.
- Repeat each test two or three times, because the same prompt can return different answers (Lesson 2), and test each tool that you use.
- Record each task as inside, at the edge or outside the frontier, together with the check that it needs, and repeat the tests when you change tools or when a tool is updated.
Jordan builds a first map for the tasks the team expects to give the pilot assistant and for a few tasks from their own studies. Table 3.2 shows the result. The results are illustrative, prepared for this lesson to show the method, and they are typical of the patterns that the studies cited in this lesson describe.
Table 3.2. Jordan's first frontier map (illustrative results prepared for this lesson).
| Task | Known answer used | What happened | Placement and check |
|---|---|---|---|
| Explain incidence and prevalence for a first-year student | Definitions in a course textbook | Clear and correct on three runs | Inside; compare with the course text |
| Summarize the abstract of a paper Jordan had read closely | Jordan's own notes on the paper | Accurate, although one run left out the main limitation | Inside; read the summary against the abstract |
| Turn Jordan's meeting notes into a table of actions | The notes themselves | Correct on every run | Inside; skim against the notes |
| Give three Canadian studies on social prescribing with full references, with web search turned off | A list prepared by a librarian | One reference correct, one with the wrong year and journal, one that could not be found | Outside; check every reference at its source |
| Calculate a rate per 100,000 from two counts | Jordan's hand calculation | Correct on two runs and wrong on one, then correct on every run once the tool ran code | Edge; recompute every number |
| State the number of primary care clinics in the health authority | The team's records (24 clinics) | A confident, wrong number | Outside; use local sources |
| Suggest community groups that older adults in one town might join | The knowledge of a community connector | A plausible list that included groups the town does not have | Outside; ask people who know the community |
Maps of this kind support several rules of thumb for general-purpose assistants in 2026. Transformation of supplied material is usually inside the frontier, and the check is to read the output against the material. Recall of specific facts, figures, references or recent events is outside unless the tool retrieves sources you can open. Counting and arithmetic are at the edge and move inward when the tool runs code, although numbers that matter are still recomputed. Judgement about a particular community or decision lies outside, and the tool's suggestions there are a starting point for conversation with the people concerned.
Interactive 3.1 asks you to place eight tasks before reading the lesson's assessment of each, which describes a general-purpose assistant used without special setup in 2026.
Interactive 3.1. Frontier sorter: eight tasks to place inside, at the edge of or outside the frontier, each followed by the lesson's assessment.
Box 3.3 applies the known-answer method to a task from a later methods course, and the model answer in the accordion that follows describes one suitable test.
A student wants to know whether an assistant can be trusted to explain the output of a logistic regression, which they will need to read in a later methods course. Describe a known-answer test that would tell them, including the source of the known answer, how many times to run the test and what to record. Write your answer before opening the model answer below.
The student takes a logistic regression output whose correct interpretation is available independently, such as a worked example in a methods textbook. They paste the output (which contains no personal information) into the assistant with their usual prompt and compare the explanation with the textbook's, checking that odds ratios are interpreted as ratios of odds, that the reference category is identified correctly and that the confidence intervals are read correctly. They run the test three times in new conversations and in each tool they use, and record each run as correct, partly correct or wrong, with every error noted. Consistently correct results place the task inside the frontier for that tool; recurring errors place it at the edge, where every explanation needs checking.
A frontier map records, for each task and tool, whether the task lies inside, at the edge of or outside the frontier, together with the check it needs. The final subsection of this section shows how that placement organizes the rest of the lesson.
1.5 From the Frontier to Prompting and Verification
The frontier map divides the rest of this lesson. For tasks inside the frontier, the quality of the output depends mainly on the quality of the request, which Section 2 teaches. For tasks at the edge or outside, it depends on verification, which Section 3 teaches as a routine scaled to the stakes of the task. Section 4 adds a question that precedes both: what information may be given to which tool at all.
The frontier also moves as tools gain the ability to search, read documents and run code. Known-answer tests, well-structured prompts and verification apply to any tool, so they remain useful as that happens. Lesson 7 returns to the frontier for AI as a thinking partner, and Lesson 8 tests it for writing and checking R code.
Box 3.4 condenses the section into a working rule for deciding how far to rely on a tool for each kind of task.
Box 3.4: A working rule for the frontier
Before relying on an AI tool for a kind of task, test it on a version of the task whose answer you know. Treat transformation of material you supply as usually inside the frontier, recall of specific facts and sources as outside it unless sources are retrieved and opened, arithmetic as at the edge, and local judgement as work that belongs to people with local knowledge. Record the check that each kind of task needs, and repeat the tests when your tools change.
This section has established that AI capability is uneven across tasks, that known-answer tests locate the frontier for a given tool, and that the place of a task relative to the frontier decides whether the quality of the request or the checking of the output matters most. The summary, reflection and knowledge check that follow review these ideas before Section 2 turns to writing effective requests.
Reflection
The jagged frontier is the boundary between the tasks an AI tool performs well and the tasks it performs poorly. It is jagged because it does not follow how difficult the tasks seem to people. A known-answer test is a test of the tool on a version of a task whose correct answer you already know, repeated two or three times.
A health sciences student plans to use a general-purpose assistant, with web search turned off, for four tasks: (1) explaining statistical concepts from lecture notes that the student pastes in; (2) producing a list of ten journal references, with authors, years and DOIs, on physical activity in older adults; (3) calculating rates per 100,000 from counts that the student supplies; and (4) choosing which community organizations in the student's home town would make the best partners for a health fair. Place each task inside the frontier, at its edge or outside it, explain each placement in a sentence, and describe a known-answer test for the task you are least sure about.
Task 1 lies inside the frontier. Explaining material that the student supplies draws on the patterns a language model handles best, and the check is a comparison with the lecture notes. Task 2 lies outside the frontier. Exact reference details are recalled imperfectly, so some references will have wrong years or journals and some may not exist; every reference has to be found in a database and opened. Task 3 lies at the edge. Simple rates are usually right, but slips in arithmetic and rounding occur unless the tool runs code, so every figure that matters is recomputed. Task 4 lies outside the frontier, because the tool has no knowledge of which organizations in a particular town are active, trusted or interested; its suggestions are a starting point for asking people who know the community.
The task I am least sure about is task 3. For a known-answer test, I would take three sets of counts for which I have already calculated the rates by hand, give them to the assistant with the prompt I would normally use, and compare its answers with mine. I would run each set three times in new conversations, with and without asking the tool to run code, and record each run as correct or wrong. If all runs with code are correct, I would treat the task as inside the frontier when code is used, while still recomputing any figure that others will rely on.
Minimum 20 characters required.
Question 1: In the experiment by Dell'Acqua and colleagues (2023), what happened on the task chosen to lie outside the frontier?
Question 2: Why is the frontier of AI capability described as jagged?
Question 3: A student wants to know whether an assistant can be trusted to turn lecture notes into a glossary. Which approach is a known-answer test?
Question 4: Jordan asks an assistant to summarize a public report, copies the report's figures from its tables personally, and writes the local recommendations without AI. Which working style is this?
Prompting and Context
Learning Objectives for this section
- Identify the six parts of an effective request (role, task, context and audience, examples, format and constraints) and explain what each contributes.
- Write complete prompts for common health sciences tasks with a reusable prompt structure.
- Use few-shot examples, step-by-step instructions and clarifying questions to improve output.
- Refine a prompt over several versions and explain how each change alters the output.
- Supply context through pasted material, uploaded files, projects and standing instructions, and judge how much context a task needs.
- Start a prompt library and record each tested prompt with its purpose, known problems and required checks.
2.1 What a Prompt Does
A prompt is the text that a person gives an AI tool to tell it what to do. Lesson 2 explains that a language model produces its answer from everything in its context window, the span of text the model can take into account at once, which includes the provider's system prompt, any standing instructions, uploaded files, the conversation so far and the latest message. When a prompt leaves something unstated, the model fills the gap with the most typical choice in its training: a typical audience, length, country and version of the facts. For health sciences work in British Columbia, the typical choice is often the wrong one, so most of what is called prompting is the supply of information that the model cannot otherwise know.
Prompting is a learnable skill that transfers across tools, because the parts of a good request reflect what any capable helper needs to know before starting a task. The Government of Canada's guide on the use of generative AI recognizes this in its "Educated" principle, which asks public servants to learn the strengths and limitations of the tools and how to write effective prompts.
Prompting, on this account, is mainly the supply of information that the model cannot otherwise know. Section 2.2 sets out the six parts of a request that supply it.
2.2 Six Parts of an Effective Request
An effective request has up to six parts: the role the assistant should take, the task, the context and audience, examples of the desired output, the format and the constraints. Figure 3.2 shows each part with an example phrase, and Table 3.3 shows what each part contributes.
Table 3.3. The usual result of leaving out each part of a request.
| Part | What usually happens when it is missing |
|---|---|
| Role | The assistant writes as a general helper for a general reader. |
| Task | The assistant guesses the deliverable and may answer a different question. |
| Context and audience | The assistant supplies typical facts and a typical audience, often invented or foreign to the setting. |
| Examples | The assistant uses its default style instead of the conventions the reader expects. |
| Format | The output is longer than needed and structured for a general reader. |
| Constraints | The assistant fills gaps from memory without saying so. |
The parts combine into a reusable structure that can be adapted to almost any task. The square brackets mark the places to fill in.
Box 3.5 sets out the structure, with a line for each of the six parts followed by two closing requests to the assistant.
Box 3.5: A reusable prompt structure
Role: You are [the kind of expert or helper needed], helping [who you are] with [the general purpose].
Task: [One clear sentence stating what you want produced.]
Context and audience: [The background the assistant cannot know: the setting, the facts and the material to work from.] The readers are [the audience], who already know [what they know] and need [what they need].
Examples: Here is an example of the style or structure I want: [one to three examples].
Format: [Length, structure, headings, table or bullets, reading level, language and spelling.]
Constraints: [What to use and what to avoid.] If you need information that I have not given, ask me before you start. Mark any statement that you are unsure of.
A quick request to reformat a list needs only a task and a format, while a document that others will read usually needs all six parts. Labels such as "Task:" and "Material:" help the assistant tell the instructions apart from the text it is to work on.
The six parts and the reusable structure can be adapted to almost any task. Section 2.3 shows them at work in complete prompts for four common health sciences tasks.
2.3 Example Prompts for Health Sciences Tasks
The tabs below give four fully written prompts for common health sciences tasks. None asks the assistant to recall facts from memory, which keeps each task inside the frontier described in Section 1.
The four prompts appear as Box 3.6 (explaining a method), Box 3.7 (summarizing a public report), Box 3.8 (drafting a message) and Box 3.9 (critiquing a draft), each followed by a note on how it is built and the later lesson that develops the task.
Box 3.6: Prompt
You are a patient tutor in epidemiology. I am a third-year health sciences student who has taken one introductory statistics course. Explain the difference between a cohort study and a case-control study. Start with a two-sentence summary. Then explain how each design selects participants, which measure of association each usually reports, and one strength and one weakness of each. Use a single example about physical activity and heart disease for both designs, so that I can compare them directly. Keep the explanation under 400 words and use Canadian spelling. End by asking me two questions that would test whether I understood the difference, and wait for my answers before you tell me whether they are right.
The prompt sets the reader's level, divides the explanation into parts and ends with retrieval practice. Lesson 4 develops tutoring prompts of this kind.
Box 3.7: Prompt
You are an analyst on a public health team. Below is the executive summary of a publicly available provincial report on healthy aging. Task: write a 150-word summary for my team lead, who has not read the report and needs to decide whether the full report is relevant to a program for socially isolated older adults. Then list up to three findings that bear on social isolation, giving the section or page where each appears. Use only the text below. If the text does not address social isolation, say so plainly.
Material: [paste the executive summary here]
The prompt grounds the assistant in supplied text, states the decision the summary serves and asks for locations so that each finding can be checked. Lesson 5 develops summarizing and extraction.
Box 3.8: Prompt
You are helping a community program coordinator write to partner organizations. Draft an email of no more than 170 words inviting the coordinator of a seniors' centre to a one-hour information session about a community connector program for adults aged 65 and older who are socially isolated. The tone should be warm, plain and respectful, with no jargon. Include placeholders for the date and location, one sentence explaining what a community connector does, and a request to reply by a date that I will add. Write two versions, one formal and one conversational, so that I can choose.
Two versions make the choice of tone explicit, and the placeholders keep the assistant from inventing details. Lesson 6 develops professional writing.
Box 3.9: Prompt
Act as a critical reviewer for a public health journal. Below is a paragraph arguing that social prescribing should be expanded to every clinic in a rural health authority. Identify the three strongest objections that a skeptical reader would raise, explain what evidence would answer each objection, and point out any sentence where the claim goes beyond the evidence cited. Do not rewrite the paragraph and do not comment on grammar. Paragraph: [paste the paragraph]
Presenting the paragraph without saying who wrote it reduces the assistant's tendency to praise the user's work (sycophancy, described in Section 3). Lesson 7 develops this use.
Each of the four prompts states the task and supplies the information that the assistant cannot otherwise know. Section 2.4 adds five techniques that improve the output of most requests.
2.4 Techniques That Improve Output
Five further techniques improve the output of most requests.
A few-shot prompt includes a few worked examples of the task, where a zero-shot prompt includes none. Brown and colleagues (2020), introducing GPT-3, showed that a large language model could perform new tasks from a few examples in the prompt without any change to its weights, an ability called in-context learning. One to three labelled examples are usually enough, and they should vary in content so that the assistant copies their structure without copying their subject matter.
A complex task is easier to carry out and to check when the prompt divides it into numbered steps ("First list the outcomes measured; then give the result for each; then summarize"). Asking the assistant to reason step by step before answering, called chain-of-thought prompting (Wei and colleagues, 2022), can also improve reasoning; Lesson 2 explains it together with the reasoning models that now do much of this work internally. Numbered steps remain useful with any model because they make each stage of the output checkable.
Ending a prompt with "Before you start, ask me any questions you need answered" turns a single guess into a short conversation. The questions reveal what the assistant would otherwise have assumed. Section 2.6 shows this technique in use, together with one of its risks: an answer to a clarifying question can lead the assistant to add details from its own memory.
The first output is a draft, and specific feedback ("Shorten the second paragraph to 60 words and remove the American statistics") improves it more than general feedback ("make it better"). When a conversation keeps repeating an error, it is usually faster to start a new conversation with an improved prompt.
A request such as "Mark any statement you are unsure of" sometimes produces useful flags. Language models judge their own accuracy poorly (Lesson 2), so a flag directs attention to a claim without confirming or clearing it, and an unflagged claim can still be wrong.
These techniques shape how a request is made and refined. Section 2.5 turns to the material that a request can draw on and the ways of supplying it as context.
2.5 Supplying Context
Context can reach an assistant in four ways. The first two are pasting material into the prompt under a clear label and uploading files, such as a report or a spreadsheet of aggregate figures. Working from supplied material is the most effective single way to move a task inside the frontier, because the assistant draws its facts from the material instead of recalling them, although it can still misread what it was given.
The third way is a project, a workspace in which uploaded files and instructions apply to every conversation on a topic. In 2026, ChatGPT and Claude both offer projects, and Google's Gemini offers Gems, customized versions of the assistant with their own instructions. The fourth way is standing instructions (called custom instructions in ChatGPT), which the assistant applies to every conversation. Some assistants also store details from past conversations as memory, which is worth reviewing because a stored detail shapes later answers. Product names and features change often, and the four categories (pasted material, uploaded files, projects and standing instructions) are more durable than the names.
Box 3.10 gives an example of standing instructions for a health sciences student in British Columbia.
Box 3.10: Example of standing instructions for a health sciences student
I am an upper-division health sciences student in British Columbia, Canada. Use Canadian spelling and, where relevant, Canadian and British Columbian sources and context. When you state a fact that I might cite, tell me where it can be checked. Tell me when you are unsure, or when a question falls outside what you can answer reliably. Keep answers concise unless I ask for detail.
Adding context has limits. Irrelevant material can distract the assistant, and Liu and colleagues (2024) found that language models used information at the beginning or end of a long input more reliably than information in the middle, so it helps to repeat the key instruction after a long document. Every piece of context must also pass the classification in Section 4 before it is pasted or uploaded.
Sections 2.2 to 2.5 have described the parts of a request, the techniques that improve it and the ways of supplying context. Section 2.6 shows what changes of this kind to a prompt do to the output.
2.6 Worked Demonstration: Four Versions of One Prompt
Worked Example 3.1 follows Jordan through four versions of a prompt for the background slide of a presentation to clinic managers. Each version adds parts or techniques described in Sections 2.2 to 2.5, and each is shown with an abridged output and a comment on its strengths and errors.
The Cedar Valley team lead asks Jordan to prepare the background slide for a presentation to the managers of the primary care clinics that will join the second wave of the Connector program. Jordan uses the team's enterprise assistant with public information only. The outputs below are representative examples prepared for this lesson; their strengths and errors are typical of those documented in the studies discussed in Section 3.
Prompt
Write something about loneliness in older people for a presentation.
Output (abridged)
Loneliness Among Seniors: A Growing Crisis. Loneliness has become one of the most pressing issues facing seniors today. As people age, they often lose spouses and friends, retire from work and face mobility problems, all of which can leave them isolated. Research has linked loneliness to heart disease, depression, cognitive decline and early death. There are many ways to help, from regular family calls to seniors' centres and volunteer programs. [The full output ran to about 450 words in six paragraphs and ended with a list of tips for families.]
The assistant guessed the audience, purpose, length, setting and program, and chose the most typical answer to each: an article for the general public. Little of it can be used on a slide for clinic managers, and its health claims have no sources.
Prompt
Write a 150-word background for a slide presentation to the managers of primary care clinics in a rural British Columbia health authority. Explain why loneliness among adults aged 65 and older matters for health, and describe our social prescribing program, the Cedar Valley Connector program.
Output (abridged)
Loneliness is common among older adults and is associated with depression, heart disease, dementia and earlier death. In rural communities, long distances, limited public transit and the closure of local services can deepen isolation. The Cedar Valley Connector program responds by offering weekly group activities led by trained volunteers at community centres across the region. Participants can attend for as long as they wish, and family physicians refer patients by fax using a standard form. [About 160 words.]
The task, audience and length produced text of the right size for the right readers. The description of the program, however, is invented: with no information about the Connector program, the assistant described a typical one (weekly volunteer-led groups, open-ended attendance, referral by fax), none of which is true. When context is missing, the assistant fills the gap with plausible invention that reads as confidently as fact.
Prompt
Role: You are helping a population health team in a British Columbia health authority prepare a presentation for the managers of primary care clinics that will join the second wave of a program.
Task: Write a 150-word background explaining why loneliness among adults aged 65 and older matters for health and what the Cedar Valley Connector program does.
Program facts (use only these for any statement about the program): The Cedar Valley Connector program is a community connector (social prescribing) program for adults aged 65 and older who screen as socially isolated or lonely. Clinics screen patients with the three-item UCLA Loneliness Scale, and a score of 6 or higher triggers referral. A community connector meets each person up to six times over twelve weeks and links them to community groups, volunteer roles, transportation help and services. The first wave runs in 12 of the health authority's 24 primary care clinics.
Constraints: For each general claim about loneliness or social prescribing, name the source so that I can check it. Do not invent statistics. Use Canadian spelling and plain language for busy managers.
Output (abridged)
Loneliness is a recognized public health concern. In 2023, the United States Surgeon General issued an advisory on loneliness and isolation. [Two further claims, attributed to a 2010 meta-analysis and to the World Health Organization, appear in their final form in version 4.] The Cedar Valley Connector program screens adults aged 65 and older in primary care with the three-item UCLA Loneliness Scale and refers those who score 6 or higher to a community connector... Social prescribing has been shown to reduce loneliness by 30 percent (Morrison and Patel, 2021 [FABRICATED REFERENCE: no such article exists; it was invented for this lesson to show a typical fabricated citation]). [About 210 words in one paragraph.]
The program description is now accurate, because the facts were supplied, and each general claim names a source, which makes it checkable. The text is too long and dense for a slide. More seriously, naming a source does not make a claim correct, and the instruction not to invent statistics did not prevent the fabricated reference marked above. The constraints made errors easier to find without removing them.
Prompt
[Everything in version 3, followed by:]
Format: Write the text for one slide. Use the heading "Why loneliness matters" with three bullets on loneliness and health, then the heading "What the Connector program does" with up to three bullets on the program. Each bullet is one plain sentence of no more than 30 words. End with a line headed "Sources" that lists each source by author or organization and year.
Example of the team's style: "The team will share a one-page summary after this meeting." "Questions about the program can go to the population health team at any time."
Before you write the slide, ask me any questions you need answered.
Output (abridged)
Assistant: Before I write the slide, I have two questions. Do the clinic managers already know the UCLA Loneliness Scale, or should the slide explain it briefly? Should the slide mention that the first wave runs in 12 of the 24 clinics?
Jordan: Most managers have not used the scale, so describe briefly how it is scored. Leave out the first-wave detail.
Assistant: Why loneliness matters. [1] In 2023, the United States Surgeon General issued an advisory that described loneliness and isolation as a public health concern. [2] A 2010 meta-analysis of 148 studies found a 50 percent greater likelihood of survival among people with stronger social relationships. [3] The World Health Organization's Commission on Social Connection reported in 2025 that loneliness causes more than 871,000 deaths each year. What the Connector program does. Clinic staff screen adults aged 65 and older with the three-item UCLA Loneliness Scale, [4] which is scored from 3 to 12, and refer those who score 6 or higher. [A second program bullet restates the supplied facts.] [5] Social prescribing has been shown to reduce loneliness by 30 percent. Sources: U.S. Surgeon General (2023); Holt-Lunstad and colleagues (2010); World Health Organization (2025); Morrison and Patel (2021) [FABRICATED REFERENCE: this source does not exist; it was invented for this lesson].
The format and the example produced slide-ready text in the team's style, and the clarifying questions surfaced two decisions Jordan had not thought to make. The answer to the first question had a side effect: asked to describe how the scale is scored, the assistant supplied a score range (claim 4) from memory, because the program facts did not include one. The bracketed numbers mark the five factual claims that did not come from the supplied facts, and Section 3.5 checks them.
Better prompts fixed the audience, the length, the structure and the accuracy of everything that could be supplied as context. They could not guarantee the accuracy of claims the assistant drew from its training, and two of the techniques that improved the output (naming sources and answering clarifying questions) created new places for errors to enter. A well-specified prompt produces markedly better output, and every factual claim in it still needs verification.
The next subsection describes how a prompt developed in this way can be stored, with notes on its performance and the checks it needs, for later reuse.
2.7 Building a Prompt Library
A prompt library is a personal collection of tested prompts, each stored with a note of what it is for, how it performed and what checks its output needs. A good prompt takes time to develop, as the four versions in Worked Example 3.1 show, and a library keeps that work for reuse in a document, a spreadsheet or a project. Table 3.4 shows one entry.
Table 3.4. One entry in a prompt library.
| Field | Entry |
|---|---|
| Name | Slide background from program facts |
| Purpose | A short, sourced background slide for a professional audience |
| Prompt | Version 4 above, with placeholders for the program facts, the audience and the topic |
| Tested with | The team's enterprise assistant and one general-purpose assistant, October 2026 |
| Works well for | Structure, tone and accurate use of the facts supplied |
| Known problems | The assistant adds details from memory, and named sources can be fabricated. |
| Checks required | Every general claim and every source is checked at its primary source (Section 3). |
| Information allowed | Public and internal non-confidential material only (Section 4) |
Lessons 4 to 8 add prompts for tutoring, literature work, writing, testing ideas and coding, and Lesson 10 combines the library with the verification routine and the AI use log into a personal workflow.
Box 3.11 gives practice in repairing a weak prompt with the six-part structure, and a model answer follows in the accordion.
A student types the following prompt into an assistant: "Summarize this article." They then paste the full text of an open-access article on physical activity among adults with arthritis, because they need to decide whether to read it in full for a literature review on exercise programs for older adults. Rewrite the prompt using the six-part structure, then compare your version with the model answer below.
Role: You are a research assistant helping a health sciences student screen articles for a literature review. Task: Summarize the article below so that I can decide whether to read it in full for a review of community-based exercise programs for adults aged 65 and older. Format: Give the study's question, design, population (with age range), intervention, outcomes and main findings, one line each, then two sentences on its relevance to my review. Constraints: Use only the article text, write "not reported" for anything missing, and quote the sentence that states the main finding.
The repaired prompt states the decision the summary serves, asks for a structure that matches it and requests a quotation that makes the main claim easy to check. Lesson 5 develops structured extraction of this kind.
This section has shown that a request with a clear role, task, context, examples, format and constraints produces markedly better output, while every factual claim drawn from the assistant's training still needs verification. The summary, reflection and knowledge check that follow review the six parts and the techniques before Section 3 turns to verification.
Reflection
An effective request has six parts: the role the assistant should take, the task, the context and audience (background facts and who will read the output), examples of the style wanted, the format (length, structure, reading level) and constraints (what to use, what to avoid and what to do when unsure). Useful techniques include few-shot examples, numbered steps, inviting clarifying questions and refinement over several turns.
A public health nurse at a community clinic in British Columbia types: "Make a handout about diabetes." She wants a one-page handout for adults recently diagnosed with type 2 diabetes who attend the clinic. It should be readable at about a grade 7 level, should describe the clinic's own services (a dietitian's drop-in session on Tuesday afternoons and a monthly group class, details she can paste in), and should contain no clinical advice beyond what she supplies. Rewrite her request using all six parts, then name one technique you would add and explain why.
Role: You are a health communication writer helping a community clinic nurse prepare patient materials. Task: Write the text of a one-page handout for adults recently diagnosed with type 2 diabetes. Context and audience: The readers are adults of varied literacy who attend a community clinic in British Columbia. The clinic offers the following services, which are the only clinic details to use: [pasted description of the Tuesday afternoon dietitian drop-in and the monthly group class]. Examples: Here is a paragraph from an earlier clinic handout whose style we want to match: [pasted paragraph]. Format: Use a short title, three headed sections (what the diagnosis means for daily life, services at our clinic, where to ask questions), short sentences and a reading level of about grade 7, in Canadian spelling, within 300 words. Constraints: Do not give medical advice, doses or targets; where a reader might need clinical information, direct them to their care team. If anything is unclear, ask me before you write.
I would add an invitation to ask clarifying questions, which the constraint already contains, because the assistant may need to know whether the handout will be translated or read aloud, and its questions reveal assumptions I have not considered. After the draft, I would refine over a second turn, asking for any sentence above the target reading level to be simplified. Every clinic detail and any health statement would still be checked against the clinic's information before printing.
Minimum 20 characters required.
Question 1: In version 2 of the worked demonstration, the assistant described the Connector program as weekly volunteer-led groups with referral by fax. What was the main cause of this error?
Question 2: Which addition to a prompt is an example of few-shot prompting?
Question 3: A student pastes a 40-page report into an assistant, with the task stated only at the very start. Based on the findings of Liu and colleagues (2024), which simple change is most likely to help?
Question 4: Which statement about projects and standing instructions is accurate?
Verification Habits
Learning Objectives for this section
- Classify the errors that AI tools make as fabrication, misattribution, outdated information, errors of arithmetic and logic, or sycophancy, and recognize each in a realistic output.
- Explain why fluent output can be wrong and why a tool's own confidence cannot serve as a check.
- Apply lateral reading and checking at the primary source to the factual claims in AI output.
- Recompute numerical results and compare answers across tools.
- Scale a verification routine to the stakes of a task.
- Verify the factual claims in a realistic AI output, correct the errors found and record the checks.
3.1 Why Verification Belongs to the User
Lesson 2 explains why a language model can produce fluent, confident text that is wrong. The model generates the most probable continuation of its input, and a plausible statement and a true statement are often the same, though not always. The model has no separate step in which it consults the world to confirm what it has written, unless the tool adds one by searching or retrieving documents, and even then it can misread what it retrieves. The fluency of the output tells the reader about the model's command of language, and very little about the accuracy of any particular claim.
For this reason the responsibility for accuracy stays with the person who uses the output. A student whose work contains a fabricated reference and an analyst whose briefing note contains a wrong figure are each accountable for the error, whatever tool produced it, and institutional policies on AI use state this principle (Section 4).
Box 3.12 describes a court case in which lawyers filed a brief that cited court decisions generated by ChatGPT.
Box 3.12: A cautionary example: Mata v. Avianca (2023)
In 2023, lawyers representing a man who said he had been injured on an Avianca flight filed a brief in the United States District Court for the Southern District of New York that cited six court decisions that did not exist. The decisions, complete with names, citations and quoted passages, had been generated by ChatGPT. When the airline's lawyers and the court could not find the cases, the lawyers continued to stand by them. In June 2023, Judge P. Kevin Castel found that the lawyers had acted in bad faith, imposed a $5,000 penalty on the two lawyers and their firm, and ordered them to send his opinion to their client and to each judge who had been falsely named as the author of one of the invented decisions. The tool produced exactly the kind of plausible, specific detail that lies outside the frontier. The failure began with filing the brief without opening a single cited case, and the sanctions followed from the lawyers' continued defence of the cases after they were questioned.
The same failure can occur in any field that relies on citations and figures, including a reference list in a student paper, a statistic in a briefing note and a claim on a health promotion poster.
Responsibility for accuracy therefore rests with the user. Section 3.2 sorts the errors that verification has to catch into five kinds, each matched to the check that catches it.
3.2 Five Kinds of Error
Errors in AI output fall into five broad kinds. Each has a characteristic appearance and a check that catches it, and naming the kind of error helps a user choose the right check. The cards below describe each kind, and Table 3.5 summarizes them.
Table 3.5. Five kinds of error in AI output and the check that catches each.
| Kind of error | What it looks like | The check that catches it |
|---|---|---|
| Fabrication | A specific, well-formed reference, quotation or figure that cannot be found | Search for it in an independent system and open it |
| Misattribution | A real source cited for a claim it does not make, or a claim stated more strongly than the source states it | Find the claim in the primary source and compare the wording |
| Outdated information | A claim that was once true, or silence about recent changes | Confirm time-sensitive claims against a current official source |
| Arithmetic and logic errors | A wrong total, rate or percentage, or a conclusion that does not follow | Recompute and estimate the expected size of the answer |
| Sycophancy | Agreement with the user, praise for the user's work, or a correct answer abandoned under pushback | Use neutral framing and compare across conversations and tools |
Sycophancy deserves a closer look because it turns the user's own beliefs into a source of error. Sharma and colleagues (2023) found the same pattern in five widely used assistants. The assistants gave more positive feedback on an argument or a poem when the user said they had written it or liked it. When a user challenged a correct answer ("I don't think that's right. Are you sure?"), they often apologized and changed it to an incorrect one. Their answers shifted toward beliefs that users stated, even weakly, and they often repeated mistakes contained in a user's question. Both human raters and the preference models trained on their ratings sometimes preferred convincingly written sycophantic responses to correct ones, which explains how training on human preferences rewards agreement. Lesson 7 returns to sycophancy and to keeping independent judgement when using AI as a thinking partner.
The checks listed in Table 3.5 draw on a small set of methods. Section 3.3 describes the four core checks that catch most errors in AI output.
3.3 Four Core Checks
Four checks catch most errors in AI output. They are lateral reading, checking each claim at its primary source, recomputing numbers and comparing answers across tools.
Lateral reading
Lateral reading is the practice of leaving a source to find out what independent sources say about it, instead of judging it by reading it more closely. Wineburg and McGrew (2019) compared how professional fact checkers, historians and university students evaluated unfamiliar websites. The fact checkers reached sound judgements faster because they left the site quickly and opened new tabs to read about the organization behind it, while the historians and students read the site from top to bottom and were often persuaded by its professional appearance.
AI output always has a professional appearance, so the same principle applies. Asking an assistant whether its own reference is real is reading vertically, and a fabricating or sycophantic tool will often confirm its own error. Reading laterally means leaving the conversation to search for the reference in a library database, Google Scholar or PubMed, or to check a statistic on the website of the agency that produced it. HSCI 241 Lesson 5 teaches the AACODS checklist for judging grey literature, and HSCI 241 Lesson 6 applies a four-step check to sources suggested by AI in a systematic review.
Checking each claim at its primary source
A primary source is the original document in which a finding, figure or statement first appeared, such as the article that reports a study, the agency report that published a statistic, or the text of a guideline or law. News stories, textbooks and AI output are secondary sources that pass a claim along and can alter it. Checking at the primary source means opening the original, finding the passage and comparing four things: the wording (associated or caused, may or will), the figures, the population or setting, and the date. A claim that survives is cited to the primary source; a claim that fails is corrected or removed.
Recomputing numbers
Every number that matters should be recomputed by a second method. The quickest first step is an estimate of the expected size of the answer, since many errors are large enough to fail a rough check. The second step is the calculation itself, by hand, in a spreadsheet or in code, with attention to the denominator and the units. Worked Example 3.2 shows the check catching an arithmetic error and a sycophantic reversal in the same short exchange.
Jordan pastes aggregate figures from the first wave of the Connector program into the team's enterprise assistant, which the pilot permits for aggregate data. The figures are illustrative: across the 12 first-wave clinics, 2,480 adults aged 65 and older were screened, and 620 of them scored 6 or higher on the three-item UCLA Loneliness Scale. Jordan asks for the percentage who screened positive and the average number of positive screens per clinic.
The assistant answers that 25 percent of those screened scored 6 or higher, an average of about 56 per clinic. Jordan, misremembering a figure from a meeting, replies, "I thought it was nearer 30 percent." The assistant apologizes for its error and revises the percentage to about 30 percent.
The recomputation
Percentage screening positive = 620 ÷ 2,480 × 100 = 25.0 percent. A rough estimate confirms it: a quarter of 2,480 is 620.
Average positive screens per clinic = 620 ÷ 12 = 51.7, or about 52 per clinic. The assistant's figure of 56 corresponds to 620 ÷ 11 = 56.4, a wrong denominator.
The recomputation shows that the assistant's first percentage was correct and its per-clinic average was wrong. Under pushback, it abandoned the correct figure and kept the wrong one, which is the pattern Sharma and colleagues (2023) describe. Jordan records the correct figures (25.0 percent and about 52 per clinic), notes in the team's AI use log that the assistant reversed a correct answer when challenged, and adds a line to their prompt library: when checking a figure with an assistant, ask "Show the calculation" instead of offering a competing number.
Comparing across tools
Asking the same question in a new conversation or a second tool quickly finds claims that need checking, because disagreement shows that at least one answer is wrong. Agreement is weaker evidence than it appears, because models are trained on overlapping text and can share errors. Comparison therefore directs attention, and lateral reading and primary-source checks settle the question. A question asked fresh in a new conversation is also a good test for sycophancy, because it carries none of the user's earlier hints.
The four checks differ in the time they take and in what they can settle. Section 3.4 shows how to choose among them according to the stakes of the task.
3.4 A Routine Scaled to the Stakes
Checking every claim in every output at its primary source would remove most of the time that AI saves, and for many uses it would be unnecessary. The effort given to verification should instead rise with the consequences of an error. A practical routine sorts tasks into three levels of stakes, each with its own set of checks, as Figure 3.3 and Table 3.6 show.
Table 3.6. Levels of stakes, with examples and the checks that apply at each.
| Level | Examples | Checks |
|---|---|---|
| Lower stakes | An explanation used while studying, brainstorming, a first draft that only the user will read | Read critically, compare explanations with course materials, and check any fact before relying on it. |
| Moderate stakes | A class presentation, a summary for a supervisor, an internal team document, a background slide | Check every factual claim at its primary source, recompute every number, verify every reference, and note the use of AI. |
| High stakes | A public health message, a policy brief, a manuscript, clinical information, anything that affects identifiable people | Add comparison across tools and review by a person with subject expertise, record every check in the AI use log, and decide which parts of the task should be done without AI. |
Two further considerations shape the routine. A claim that restates material the user supplied needs comparison with that material, while a claim the tool added from its training, such as a statistic or a reference, needs the full check for its level. Verification also takes time and should be budgeted from the start, with the frontier map from Section 1 showing which parts of a task need the most checking.
Box 3.13 asks for three uses of AI to be assigned to a level of stakes, and the answers follow in the accordion.
Assign each use to a level of stakes and name the most important check. (a) A student asks an assistant to explain the difference between sensitivity and specificity while reviewing lecture notes. (b) A co-op student asks an assistant to draft the paragraph of a team memo that reports last quarter's referral numbers. (c) A health promotion officer asks an assistant to draft the text of a poster about vaccine eligibility for display in pharmacies. Decide before opening the answers.
Use (a) has lower stakes, because the explanation supports private study; the key check is comparison with the lecture notes or textbook, and any discrepancy is resolved in favour of the course materials or by asking the instructor. Use (b) has moderate stakes, because colleagues will read and act on the memo; the key check is recomputing every figure from the team's own data and confirming that the paragraph reports them correctly. Use (c) has high stakes, because the poster is public health information on which people will act; every eligibility claim is checked against the current official source, the text is reviewed by a person with subject expertise before release, and the checks are recorded.
The routine matches the checks to the consequences of an error. Section 3.5 applies the moderate-stakes routine to the slide that Jordan developed in Section 2.6.
3.5 Worked Demonstration (continued): Verifying Five Claims
The final version of Jordan's slide in Section 2.6 contained five factual claims that came from the assistant's training. Worked Example 3.3 continues Worked Example 3.1 by checking each claim at its primary source, and Table 3.7, within it, records the check applied, the result and the action taken for each claim.
Jordan's slide from Section 2.6 will be shown to clinic managers, so it is a moderate-stakes task: every factual claim is checked at its primary source and every source is verified. The five claims marked [1] to [5] in the final output came from the assistant's training, and the program facts came from the team's own description. The output being checked is the representative example prepared for this lesson and shown in Section 2.6.
Prompt
Version 4 of the prompt in Section 2.6, with Jordan's answers to the assistant's two clarifying questions.
Output (abridged)
[1] In 2023, the United States Surgeon General issued an advisory that described loneliness and isolation as a public health concern. [2] A 2010 meta-analysis of 148 studies found a 50 percent greater likelihood of survival among people with stronger social relationships. [3] The World Health Organization's Commission on Social Connection reported in 2025 that loneliness causes more than 871,000 deaths each year. [4] The three-item UCLA Loneliness Scale is scored from 3 to 12. [5] Social prescribing has been shown to reduce loneliness by 30 percent (Morrison and Patel, 2021 [FABRICATED REFERENCE: this source does not exist; it was invented for this lesson]).
Table 3.7. The check applied to each of the five claims in Jordan's slide, with its result and the action taken.
| Claim | Check applied | Result | Action |
|---|---|---|---|
| [1] Surgeon General's advisory, 2023 | Lateral reading to the United States Department of Health and Human Services website, then the advisory itself | Accurate. The advisory, Our Epidemic of Loneliness and Isolation, was released in May 2023. | Keep, and give the advisory as the source. |
| [2] Meta-analysis of 148 studies | Search in PubMed, then the abstract of the article in PLoS Medicine | Accurate. Holt-Lunstad, Smith and Layton (2010) pooled 148 studies with about 309,000 participants and reported an odds ratio of 1.50 (95 percent confidence interval 1.42 to 1.59), which they described as a 50 percent increased likelihood of survival for participants with stronger social relationships. | Keep, and add the authors to the source line. |
| [3] World Health Organization estimate | The WHO news release of 30 June 2025 on the Commission's report | Misattributed by overstatement. The WHO states that loneliness is linked to an estimated 100 deaths every hour, more than 871,000 deaths each year. The output turned an association into a cause. | Correct the wording to "is linked to". |
| [4] Score range of the UCLA scale | The original article describing the three-item scale (Hughes and colleagues, 2004) | Wrong. The three items are answered "hardly ever", "some of the time" or "often", scored 1 to 3, so totals range from 3 to 9. Some later adaptations use four response options, which may explain the error, and the Connector program uses the original version. | Correct the range to 3 to 9. |
| [5] Effect of social prescribing | Search for the reference by authors, year and topic in PubMed and Google Scholar, then lateral reading for reviews of social prescribing | Fabricated. No such article exists. A real systematic review (Bickerdike and colleagues, 2017) found 15 evaluations of social prescribing, all at high risk of bias, and concluded that the evidence was insufficient to judge success or value for money. | Remove the claim and the reference. Replace it with an accurate statement of the evidence, or leave the point to the team's evidence scan. |
Commentary: the output did its job well in most respects. Its structure suited the audience, its description of the program matched the facts supplied, and two of its five factual claims were accurate as written. The checks found three problems of three different kinds: an association reported as a cause (claim 3), a wrong figure (claim 4) and a fabricated study with an invented effect size (claim 5). None was visible from the text, and the fabricated claim was the one most likely to persuade the managers, because it offered a precise benefit for the program. The distribution of errors in this example is illustrative and does not estimate how often any tool errs.
The corrected slide says that loneliness "is linked to more than 871,000 deaths each year", gives the score range as 3 to 9, and drops claim 5. In its place Jordan writes, from the review itself, "A systematic review found that early evaluations of social prescribing were small and at high risk of bias, so the program's own evaluation matters (Bickerdike and colleagues, 2017)." Jordan records the prompt, the five checks and the corrections in the team's AI use log.
The checks found three errors of different kinds, none of which was visible from the text of the slide. Section 3.6 considers how checks of this kind become a habit.
3.6 Verification as a Habit
The routine becomes quicker with practice. Experienced users recognize the claims that need checking as they read: specific numbers, named studies, quotations, recent events, legal and policy details, and anything especially convenient for the argument being made. The habit is to read AI output the way a careful editor reads a draft from a capable but unreliable colleague, with interest in what it offers and an eye on every claim that someone else will rely on.
The consultants in the experiment by Dell'Acqua and colleagues (2023) lost accuracy outside the frontier because they accepted fluent output without a check, and health sciences work raises the stakes because its claims inform decisions about people's health. Section 4 turns to the question every user faces before using a tool: what information may be given to it.
Reflection
AI output contains five kinds of error: fabrication (content with no basis in any source), misattribution (a real source credited with a claim it does not make, including overstatement), outdated information, errors of arithmetic and logic, and sycophancy (agreeing with the user). Four checks catch most errors: lateral reading (leaving the output to see what independent sources say), checking each claim at its primary source, recomputing numbers and comparing across tools. Verification effort is scaled to the stakes: lower (private study), moderate (work others will read) and high (public, clinical, policy or published work).
A student asks an assistant to draft a paragraph for a class presentation on physical activity among university students. The draft (a) cites a 2019 study with named authors, journal and DOI that the student has not looked up; (b) says that a national guideline "requires" a level of weekly activity, while the student's lecture notes say the guideline "recommends" it; (c) states that 18 of 240 survey respondents is 12.5 percent; and (d) after the student says "I thought most students meet the guideline", revises a sentence to say that most do, with no new evidence. For each of (a) to (d), name the kind of error it may represent and the check you would apply, then state the level of stakes and explain your choice.
Item (a) may be a fabrication, since a specific, well-formed reference is exactly what a language model can invent. I would search for it by title and author in a database such as PubMed or Google Scholar, resolve the DOI at doi.org, and open the article to confirm that it says what the paragraph claims; if I cannot find it, I would treat it as fabricated and remove it. Item (b) looks like misattribution by overstatement, because "requires" is stronger than "recommends". I would open the guideline itself, the primary source, and use its own wording. Item (c) is an arithmetic error: 18 divided by 240 is 0.075, or 7.5 percent, so I would recompute and correct it. Item (d) shows sycophancy, since the assistant changed its claim to match my stated belief without evidence. I would ask the question again neutrally in a new conversation and, more importantly, check the survey data or the published source for the actual proportion.
The presentation is moderate stakes, because classmates and the instructor will hear and may rely on the claims, although it is not public or clinical. At this level every factual claim is checked at its primary source, every number is recomputed, every reference is verified and the use of AI is noted as the course's rules require.
Minimum 20 characters required.
Question 1: An assistant states that a WHO estimate shows loneliness "causes" more than 871,000 deaths a year, while the WHO says loneliness is "linked to" these deaths. Which kind of error is this?
Question 2: In the study by Sharma and colleagues (2023), what did assistants often do when a user replied "I don't think that's right. Are you sure?" to a correct answer?
Question 3: Which practice is an example of lateral reading?
Question 4: A health promotion officer uses an assistant to draft a public poster on vaccine eligibility. Under the stakes-scaled routine, which set of checks applies?
Data, Privacy and Disclosure
Learning Objectives for this section
- Classify information as public, own work, confidential or personal before entering it into an AI tool.
- Compare the data terms of consumer and institutional AI tools and explain what the differences mean for privacy.
- Decide which tool, if any, suits each class of information, including the rules of the Cedar Valley pilot.
- Describe SFU's guidance on AI use in courses, including the instructor's role and the requirement to cite permitted use.
- Cite AI output in APA style and recognize the elements of a disclosure statement.
- Keep an AI use log that records tools, prompts, checks and disclosures.
4.1 Classify Before You Paste
Whatever is entered into an AI tool leaves the user's control to some degree. Depending on the provider's terms and the type of account, inputs may be stored, reviewed, used to train future models or processed in another country, and a message cannot be recalled once it has been sent. Several sets of rules govern what may be shared. Public bodies in British Columbia, including universities and health authorities, are subject to the Freedom of Information and Protection of Privacy Act (FIPPA). Research with human participants is governed by the Tri-Council Policy Statement (TCPS 2), by the ethics approval for each study and by the consent that participants gave, which HSCI 207 Lesson 5 explains. Confidentiality agreements, data-sharing agreements, copyright and library licences add further conditions.
The simplest protection against all of these risks is a habit: classify the information before it goes into any tool. Classification takes a few seconds and prevents the one error in AI use that cannot be corrected afterward. Prompting can be refined and output can be verified, while personal information that has been sent to the wrong service cannot be taken back.
The habit depends on a scheme of classes that is simple enough to apply in a few seconds. Section 4.2 sets out four classes that cover most of the information handled in health sciences study and practice.
4.2 Four Classes of Information
A four-class scheme covers most of the information that health sciences students and public health staff handle. Public information has been published or made openly available by its owner. Own work is material that the user created, such as notes, drafts, code and ideas. Confidential information belongs to another person or to an organization and has not been made public. Personal information is information about an identifiable individual, including health records and research participant data. Table 3.8 gives examples of each class and the tools that suit it.
Table 3.8. Four classes of information, with examples and the tools that suit each class.
| Class | Examples from study | Examples from practice | Where it may go |
|---|---|---|---|
| Public | Published articles and abstracts, textbooks, government reports, open datasets | Public program descriptions, published statistics, legislation and guidelines | Any tool, subject to copyright and library licences for full texts |
| Own work | Your notes, drafts, code and ideas | Your own drafts and analysis plans, where your employer's rules allow | Tools whose data terms you accept, within the rules of each course or employer |
| Confidential | A classmate's draft, a manuscript you are reviewing, unpublished work shared with you | Internal documents, draft policies, grant applications, unpublished reports | Only with the owner's permission, and only in a tool the owner has approved |
| Personal | Interview transcripts and survey responses from research participants, information about classmates or family | Health records, referral lists, case notes, small counts that could identify people | Only where a specific approval covers that use; never in a consumer tool |
Four rules make the scheme work in practice. First, a document that mixes classes takes the most protected class it contains, so meeting notes that mention a named client are personal information, even if the rest of the notes are routine. Second, when the class is uncertain, the user treats the information as belonging to the more protected class until someone with authority says otherwise. Third, removing names does not make information anonymous. Details such as age, postal code, dates and rare conditions can identify a person when combined, especially in small communities and small counts, which is why HSCI 207 Lesson 5 treats re-identification as a real risk in research data. Fourth, an organization's own classification scheme takes precedence where one exists. The Cedar Valley pilot, for example, permits its enterprise assistant to receive public documents, internal non-confidential documents and aggregate data, and it never permits personal health information or other identifiable data.
Figure 3.4 sets out the classification as a sequence of questions, asked in order so that the most protected class is identified first.
Interactive 3.2 gives eight items to classify. Each answer explains the class and what the class allows.
Interactive 3.2. Classification exercise: eight items to assign to the public, own work, confidential or personal class, each with an explanation of the class and what it allows.
When information cannot go into a tool, the task can often still be done with AI help. A user can describe the structure of the data instead of uploading it, as Lesson 8 shows with a data dictionary. A user can replace real details with a fictional example of the same form, ask a general question that contains none of the confidential content, use an institutional tool that has been approved for the information, or do the task without AI. Each of these keeps the benefit of the tool while keeping the information where it belongs.
Which classes may go into a particular tool depends on the terms under which the tool is provided. Section 4.3 compares the terms of consumer and institutional accounts.
4.3 Consumer and Institutional Tools
The same assistant can come with different data terms depending on the account. A consumer account is one that an individual opens by accepting the provider's standard terms, whether free or paid. An institutional account (often called an enterprise, business or education account) is provided through an organization under a contract that the organization has negotiated and reviewed. The terms that matter most for privacy are whether inputs are used to train future models, how long they are kept and who decided the terms.
Two major providers illustrate the difference as of 2026. OpenAI states that it may use content from the Free, Plus and Pro versions of ChatGPT to train its models unless the user turns off a setting called "Improve the model for everyone", and that temporary chats are not used for training. It states that content from ChatGPT Business, Enterprise and Edu, and from its programming interface, is not used for training by default. Anthropic changed its consumer terms in August 2025 so that users of the Free, Pro and Max plans of Claude choose whether their chats may be used for training; for users who allow it, data are retained for five years, and for those who do not, the existing 30-day retention period applies. That change did not apply to Anthropic's commercial services, including Claude for Education. Providers revise these terms often, so the current terms of any tool should be checked before use.
SFU offers an example of an institutional tool. Students, faculty and staff can use Microsoft Copilot Chat by signing in with their SFU account. SFU describes this version as appropriate for work, study and research at the university, states that conversations are encrypted, are not retained at the end of the session and are not used to train the underlying model, and advises that the public version of Copilot is not appropriate for the same purposes. Table 3.9 summarizes the general differences between the two kinds of account.
Table 3.9. General differences between consumer and institutional accounts. The terms of a particular tool should always be checked.
| Feature | Consumer account | Institutional account |
|---|---|---|
| Use of inputs for training | Often permitted by default or by the user's choice, with an opt-out that varies by provider | Excluded by default under the contract |
| Retention of inputs | Set by the provider's consumer terms | Set by the contract and the institution's settings |
| Who agreed to the terms | The individual user | The institution, after legal, security and privacy review |
| Suitable classes of information | Public information and own work that the user is content to share | The classes the institution has approved, which may include confidential material; personal information only where a specific approval covers it |
An institutional account widens what may be entered without removing the need to classify. Approval for a tool is approval for particular uses: a tool approved for general study and work has not thereby been approved for research participant data or personal health information, which remain governed by ethics approvals, consent, data-sharing agreements and the privacy impact assessment for the specific use. A privacy impact assessment is a structured review of how a system collects, uses, stores and discloses personal information, carried out before the system is used. The Cedar Valley health authority procured its assistant after such an assessment, and the assessment's conclusions are the reason that the pilot permits aggregate data and excludes identifiable data.
Data terms and approvals govern what a tool may receive. Universities also set rules on how AI may be used in study, and Section 4.4 describes those at SFU.
4.4 SFU's Guidance on AI and Academic Integrity
Universities set rules for AI use in study, and students carry the responsibility for knowing them. This subsection describes SFU's guidance as information about academic integrity at the university; HSCI 207 Lesson 5 and Lesson 6 of this course address research ethics and authorship in more depth.
At SFU, the instructor decides whether and how generative AI may be used in each course, and usually states the decision in the course outline. SFU's academic integrity guidance for students says that students must not use generative AI for academic work unless the instructor has explicitly permitted it, and that a student who is unsure should not assume that it is allowed. Where use is permitted, it must still be cited, and the guidance advises students to keep a record of the prompts they used. Use where it is not permitted is treated as a breach of academic integrity and can lead to disciplinary action under the university's student academic integrity policy. Because each instructor decides, the same student may be encouraged to use AI in one course and barred from it in another, and the rules for each course are found in that course's outline or obtained from the instructor.
SFU's Learning and Teaching with AI Guidelines (November 2025) set out principles for instructors, students and academic units. The Senate Committee on University Teaching and Learning approved them in October 2025, and they were presented to the university's Senate. For students, the guidelines ask them to follow their instructors' rules on AI and to ask when the rules are unclear, and to "always transparently disclose and accurately cite AI-generated content in your submissions, as directed by your instructor." They ask that data entered into AI tools be limited to what is necessary, with sensitive personal information avoided unless its use is specifically approved, and they ask instructors to use tools that SFU has approved, after a privacy impact assessment. The guidelines also advise instructors not to use AI detectors for grading decisions or academic misconduct investigations, describing the detectors as unreliable; Lesson 6 presents the evidence on detectors.
Where AI use is permitted, SFU's guidance requires that it be cited and disclosed. Section 4.5 describes how to cite AI output in APA style and how to write a disclosure statement.
4.5 Citing AI Output in APA Style
The American Psychological Association (APA) updated its guidance on citing generative AI in September 2025 (McAdoo, Denneny and Lee, 2025). The guidance treats the company that made the tool as the author, because an AI tool cannot take on the responsibilities of authorship. It gives two reference formats: one for a specific chat, cited through the chat's shared link, and one for the tool in general, used when the tool assisted throughout a piece of work (for example in editing). Prompts are not included in the reference; they are described in the text, or placed in an appendix or supplementary material where they matter. Version numbers are no longer required, although the model name may be given. The guidance also recommends keeping the chats themselves, in the way a researcher keeps a dataset.
Box 3.14 gives the two reference formats, each with an example, together with the forms of the in-text citation.
Box 3.14: APA reference formats for generative AI (September 2025 guidance)
A specific chat: Author. (Year, Month Day). Title of chat [Generative AI chat]. Tool name. URL of the shared chat
Example: Anthropic. (2026, October 2). Explaining case-control study designs [Generative AI chat]. Claude. [shared link to the chat]
The tool in general: Author. (Year). Tool name [Large language model]. URL
Example: OpenAI. (2025). ChatGPT [Large language model]. https://chatgpt.com/
In-text citations: (Anthropic, 2026) or Anthropic (2026); (OpenAI, 2025) or OpenAI (2025).
The date in a chat reference is the day the chat took place or concluded, and the title is the chat's own title, which APA suggests editing within the tool to something descriptive before the reference is created. The bracketed placeholder in the first example stands for the real shared link, which each tool generates when a chat is shared. Instructors and journals can specify their own requirements, which take precedence, and SFU's Student Learning Commons provides sample language for acknowledging AI use.
A citation identifies the tool; a disclosure statement describes how it was used. A short statement for a report might read: "I used Claude (Anthropic, 2026) to suggest an outline for this report and to check two paragraphs for clarity. I wrote the text, checked every factual claim against its source, and take responsibility for the content." Such a statement names the tool, the tasks it assisted with and the checks applied, and it confirms that accountability rests with the author. Lesson 6 presents model disclosure statements for academic work, manuscripts and professional reports.
An accurate disclosure statement depends on a record of how each tool was used. The final subsection describes the AI use log that keeps such a record.
4.6 The AI Use Log
An AI use log is a record of each substantive use of an AI tool: the date, the tool and model, the purpose, the class of information entered, the prompt or a link to the chat, what was used from the output, the checks performed with their results, and how the use was disclosed. The log serves four purposes. It makes disclosure accurate, because the statement can be written from the record instead of from memory. It supports reproducibility, because another person can see what was asked and what was checked. It improves practice, because patterns in the log show which prompts work and which tools err on which tasks, and the successful prompts move into the prompt library. It also supports accountability, which is why the Cedar Valley pilot requires one. Table 3.10 shows two entries from Jordan's log.
Table 3.10. Two entries from Jordan's AI use log (fictional).
| Field | Entry 1 | Entry 2 |
|---|---|---|
| Date and tool | 8 October 2026; the team's enterprise assistant | 9 October 2026; the team's enterprise assistant |
| Purpose | Background slide for second-wave clinic managers | Percentage screening positive and average per clinic, first wave |
| Information entered | Public program description (public) | Aggregate screening counts (internal aggregate data, which the pilot permits) |
| Prompt | Version 4 of the slide prompt, stored in the prompt library | Request for the two figures, followed by a challenge to the percentage |
| Checks and results | Five claims checked at primary sources: two accurate, one overstated, one wrong figure, one fabricated reference | Recomputed: 25.0 percent correct, per-clinic average wrong (56 given, 51.7 correct); correct percentage abandoned under pushback |
| What was used | Structure and wording, with three claims corrected or replaced | Neither figure; recomputed values used |
| Disclosure | Noted in the slide deck's speaker notes | None needed; no AI output was used |
A log does not need special software. A table in a document or spreadsheet, with one row per substantive use, serves well, and many users record only uses that produced material that others will see. Lesson 10 combines the log with the prompt library and the verification routine into a personal workflow.
Box 3.15 draws the lesson together. Table 3.11, within it, sets out how AI performs on six kinds of task and the check that applies to each, and the box closes with a short summary of the lesson's main points.
Box 3.15: Strengths and limits: prompting, context and verification
Table 3.11. How AI performs on six kinds of task, with the check that applies to each.
| Task | How AI performs | The check that applies |
|---|---|---|
| Explaining, summarizing and restructuring material you supply | Strong, and markedly better with a clear role, audience, format and context | Read the output against the source material. |
| Drafting for a specific audience | Strong in structure and tone once the audience and an example are given; invents details when context is missing | Supply the facts, and check every detail that you did not supply. |
| Recalling specific facts, figures and references | Weak without retrieval, with fabrication and misattribution common | Read laterally and check each claim at its primary source. |
| Arithmetic and counting | Usually right for simple calculations and error-prone for multi-step ones unless the tool runs code | Recompute every number that matters. |
| Responding to the user's views or pushback | Prone to sycophancy, including abandoning correct answers | Frame questions neutrally and compare across conversations or tools. |
| Protecting the information you enter | Determined by the tool's data terms, which no prompt can change | Classify the information first and use approved institutional tools where required. |
A well-specified prompt with relevant context produces markedly better output, and prompting is a skill that transfers across tools. No prompt removes the need to verify factual claims, and the effort given to verification should rise with the consequences of an error. A useful next step for anyone who uses these tools is to rebuild one frequently used prompt with the six-part structure, test it on a case with a known answer and keep it as the first entry in a prompt library.
This section has set out the steps that surround any use of an AI tool: classifying information before it is entered, choosing a tool whose data terms suit that class, following the rules of the course or workplace, and citing and logging each substantive use. The summary, reflection and knowledge check that follow review these steps.
Reflection
Information can be sorted into four classes before it is entered into an AI tool. Public information has been published or made openly available by its owner. Own work is material you created. Confidential information belongs to another person or organization and has not been made public. Personal information is about an identifiable individual, including research participant data; removing names does not by itself make it anonymous. A document that mixes classes takes the most protected class it contains. Consumer accounts are opened by individuals under the provider's standard terms, which may allow inputs to be used for training; institutional accounts are provided by an organization under a negotiated contract, and are approved only for particular uses.
A research assistant on a university community health study has four items: (1) open-access journal articles on the study topic; (2) her own draft literature summary; (3) the study's interview transcripts with names removed; and (4) the study team's unpublished grant application, written by the principal investigator. She has a free consumer assistant on her personal account and the university's institutional assistant, approved for general study and work. Classify each item, say which tool (if any) suits it, and describe one way she could still get AI help with a task that involves the transcripts.
The open-access articles are public, so either tool is acceptable, although the institutional assistant is a sensible default. Her draft summary is her own work; she may use either tool within the study's and the university's rules, and the institutional assistant avoids her unpublished text being used to train a consumer model. The grant application is confidential, because it belongs to the principal investigator and has not been published. She should ask the principal investigator before entering it into any tool, and if permission is given, use only the institutional assistant. The interview transcripts are personal information, since participants' descriptions of their lives can identify them even without names. Their use is governed by the study's ethics approval and the consent participants gave, and neither tool is appropriate unless that approval specifically covers it; general approval of the institutional assistant for study and work does not extend to participant data.
She could still get help without entering any transcript. For example, she could describe the structure of her coding task and ask the institutional assistant to suggest a format for a codebook, or write a short fictional excerpt of the same form and use it to test a coding prompt. Any analysis of the real transcripts would then be done with tools and procedures that the ethics approval allows.
Minimum 20 characters required.
Question 1: A student wants AI feedback on a draft essay that a classmate emailed to them for comments. How does the four-class scheme classify the draft?
Question 2: Which statement about consumer and institutional accounts reflects the lesson?
Question 3: According to SFU's guidance, who decides whether students may use generative AI in a course?
Question 4: Under APA's September 2025 guidance, who is listed as the author in a reference to a ChatGPT chat?
Final Assessment
Bringing It All Together
This lesson turned an understanding of how AI tools work into four practical habits. The jagged frontier explains why a tool can explain a difficult method well and then invent a reference: capability follows the patterns in the model's training and the information it is given, which differ from human difficulty. Known-answer tests map the frontier for your own tools and tasks, and the centaur and cyborg working styles show how skilled users keep the person engaged on both sides of it.
Inside the frontier, the request determines the result. The six-part structure (role, task, context and audience, examples, format and constraints) and techniques such as few-shot examples and clarifying questions turned a one-line request into a slide-ready draft in the worked demonstration. Outside the frontier, verification determines the result: lateral reading, checks at the primary source, recomputation and comparison across tools, scaled to the stakes, found an overstated claim, a wrong figure and a fabricated reference in that same draft.
Before either habit comes classification. Information that is public or your own work can go into most tools, while confidential and personal information requires permission, approved institutional tools or no AI at all. SFU leaves decisions about AI in each course to the instructor and requires permitted use to be cited, APA names the tool's maker as the author, and an AI use log keeps the record that makes disclosure accurate.
Key Takeaways from this lesson
- AI capability is uneven across tasks in ways that do not follow how difficult the tasks seem to people, and output looks equally fluent on both sides of the frontier.
- In the experiment by Dell'Acqua and colleagues (2023), AI raised the speed and quality of consultants' work inside the frontier and lowered the proportion of correct answers outside it.
- Known-answer tests, repeated and recorded, are the dependable way to map the frontier for your own tools and tasks.
- An effective prompt states the role, task, context and audience, examples, format and constraints, and most prompting is the supply of information the tool cannot otherwise know.
- Supplying facts as context moves tasks inside the frontier, while missing context is filled with plausible invention.
- No prompt removes the need to verify, because claims that the tool draws from its training can still be fabricated, misattributed or wrong.
- Fabrication, misattribution, outdated information, errors of arithmetic and logic, and sycophancy each have a characteristic check.
- Lateral reading, checks at the primary source, recomputation and comparison across tools make up a verification routine whose effort should rise with the stakes.
- Classifying information as public, own work, confidential or personal before entering it into any tool prevents the one error that cannot be undone.
- At SFU, instructors decide whether AI may be used in their courses, permitted use must be cited, and an AI use log supports accurate disclosure.
Core Concepts Reviewed
Section 1: the jagged frontier, the consulting experiment by Dell'Acqua and colleagues (2023), centaur and cyborg working styles, and known-answer tests for mapping the frontier.
Section 2: the prompt and the context window, the six-part prompt structure, few-shot examples, step-by-step instructions, clarifying questions, refinement, projects and standing instructions, and the prompt library.
Section 3: fabrication, misattribution, outdated information, arithmetic and logic errors, sycophancy, lateral reading, primary sources, recomputation, comparison across tools and a verification routine scaled to the stakes.
Section 4: the four classes of information, consumer and institutional accounts, privacy impact assessments, SFU's guidance and Learning and Teaching with AI Guidelines, APA citation of AI, disclosure statements and the AI use log.
The final reflection asks you to apply all four habits from this lesson to a single realistic task.
Reflection
This lesson taught four connected habits: mapping the jagged frontier (the uneven boundary between tasks AI does well and poorly) with known-answer tests; writing prompts with six parts (role, task, context and audience, examples, format, constraints); verifying output with a routine scaled to the stakes (lower, moderate or high), using lateral reading, primary-source checks, recomputation and comparison across tools; and classifying information as public, own work, confidential or personal before entering it into a tool, then citing AI use (APA style names the tool's maker as author) and recording it in an AI use log.
Imagine you have been asked to write a 250-word plain-language summary of a public provincial report on food insecurity for a community newsletter, with help from an AI assistant. Describe, step by step, how you would apply all four habits to this task, from deciding what to give the tool to recording the use.
I would start by classifying the material. The report is public, so I can paste or upload it, and I would add only my own notes on the newsletter's readers; I would not include any comments from community members that could identify them. Because food insecurity figures and program details are specific facts, my frontier map tells me that recalling them is outside the frontier, while summarizing a document I supply is inside it, so I would ask the tool to work only from the report.
My prompt would set the role (a health communication writer), the task (a 250-word summary), the context and audience (newsletter readers with varied literacy in our community, plus the report itself), an example paragraph from a past newsletter, the format (a title, three short paragraphs, grade 7 reading level, Canadian spelling) and constraints (use only the report, quote page numbers for each figure, ask me if anything is unclear). I would refine the draft over a turn or two.
A newsletter is public, so this is high stakes. I would check every figure against the report's own tables, recompute any percentage, confirm that associations are not described as causes, compare one key claim across a second tool, and ask a colleague who knows the topic to read it. Finally, I would cite the tool as the course or publisher directs, add a short disclosure, and record the prompt, checks and corrections in my AI use log.
Minimum 30 characters required.
Final Knowledge Assessment
Question 1: A co-op student finds that an assistant summarizes uploaded reports accurately but states the wrong number of clinics in the region. Which conclusion fits the jagged frontier?
Question 2: Which change to a prompt would most directly prevent the invented program description seen in version 2 of the worked demonstration?
Question 3: An assistant's slide says that the three-item UCLA Loneliness Scale is scored from 3 to 12. In the original scale, each item has three response options scored 1 to 3. What is the correct range, and what kind of error was made?
Question 4: Which pair correctly matches a kind of error with the check that catches it?
Question 5: Across 12 clinics, 2,480 adults were screened and 620 scored 6 or higher. Which results are correct?
Question 6: Which use of AI calls for the highest level of verification?
Question 7: Why is agreement between two assistants weaker evidence of accuracy than it appears?
Question 8: Which item belongs in the personal class of the four-class scheme?
Question 9: Under the Cedar Valley pilot's rules, which item may Jordan enter into the team's enterprise assistant?
Question 10: Which statement about SFU's guidance on AI use is accurate?
Question 11: A student used Claude in a chat on 2 October 2026 titled "Explaining case-control study designs". Which reference follows APA's September 2025 format?
Question 12: What does an AI use log add that a citation alone does not provide?
Question 13: In the worked demonstration, the assistant asked whether the managers knew the UCLA scale, and Jordan asked it to explain the scoring. What does this show about clarifying questions?
Question 14: Which pattern did the consulting experiment show to be the main risk outside the frontier?
Question 15: A student's frontier map shows that an assistant miscalculates multi-step rates but is accurate when it runs code. What is the best practice?
Glossary: Key Terms, People & Frameworks
📚 Reference page, available throughout the lesson
Definitions of the key terms, frameworks and people in this lesson on prompting, context and verification.