Module 2 Knowledge Check (Self‑Check)
This self‑check focuses on supervision, documentation, and verification.
Questions
- Q1. What is the primary purpose of documenting AI use?
- To impress clients
- To create an audit trail for supervision and accountability
- To avoid paying for software
- To replace attorney review
Answer: To create an audit trail for supervision and accountability
Why: Documentation supports supervision, defensibility, and quality control. - Q2. True or False: If a task is low risk, you can skip human review.
- True
- False
Answer: False
Why: Human review is always required; low risk just means lighter verification. - Q3. Which item should be included in a minimum AI audit trail?
- The model’s training data
- The tool used and the purpose
- The vendor’s marketing brochure
- The user’s personal opinions
Answer: The tool used and the purpose
Why: A basic audit trail includes tool, purpose, inputs, outputs, verification, and reviewer. - Q4. When should non‑attorney staff escalate AI output to an attorney?
Answer: When it affects legal strategy, privilege, client communications, filings, or any high‑risk judgment.
Why: Escalation keeps legal judgment with the supervising attorney. - Q5. Which verification technique is most appropriate for citations?
Answer: Open each citation and confirm it supports the stated proposition.
Why: Citation verification must be done against primary sources. - Q6. Name one red flag that suggests hallucination risk.
Answer: A case citation you cannot locate; overly specific facts with no source; confident answers with no references.
Why: Hallucinations often appear as plausible but unverified specifics. - Q7. What does “counterexample testing” do?
Answer: It checks for contrary authority or facts that would change the conclusion.
Why: It reduces one‑sided outputs and helps spot missing context. - Q8. If you cannot verify a key fact, what should you do?
Answer: Do not rely on it; flag it, escalate, and revise the draft based on verified sources.
Why: Unverified claims should not survive into final work product.