Discussion about this post

User's avatar
Ed Perper, MD's avatar

I was hoping to see some specific suggested rules for consideration. Here are 10 that I came up with using Claude and specific prompting by me:

1. No single AI detector score may serve as the sole basis for an academic integrity finding. Require corroboration from drafting history, an oral explanation, or another independent source of evidence.

2. Any grade-determining, high-stakes assessment (final exam, capstone, thesis defense) includes a short structured oral component, not an unstructured one.

3. If a detection tool is purchased, faculty receive mandatory training on its documented false positive rate and its bias against non-native English writers before the tool is authorized for use in any integrity proceeding.

4. Require disclosure of AI use on submitted work, paired with an explicit institutional commitment that disclosure alone never triggers increased scrutiny or suspicion.

5. Set one university-wide default for AI-free contexts, such as proctored in-class exams and licensure-critical assessments, and leave everything outside that default to department-level policy.

6. Require version history or drafting evidence, such as document edit logs, for major written assignments as a lower-cost alternative to a full oral defense.

7. Establish an appeals process specific to AI-related allegations, with a standard of evidence higher than a single detector score.

8. Before restricting AI use on any assessment, require the instructor to document whether the assessment still measures its stated learning objective when AI is available. Redesign before you restrict.

9. Fund faculty release time or stipends for assessment redesign, matching the investment model institutions used for the online-learning transition, rather than issuing redesign expectations unfunded.

10. Review the AI policy on a fixed annual cycle, since detector accuracy and model capability move faster than most governance calendars.

Must-haves: 1, 3, and 2.

Rule 1 is non-negotiable because the accuracy data is not marginal. A tool with a documented 61% false positive rate for a specific student population is not a close call, it is a liability and a fairness problem. Rule 3 follows directly from that same data. No institution should deploy a detection tool without first telling faculty what its actual error profile is, especially the ESL bias. Rule 2 is the one constructive redesign with real evidence behind it. Oral defense is not a theory, it has measured reliability numbers and multiple institutions running it at scale.

Uncle Skully💀's avatar

I appreciate the thoughtful article and proposed framework, but why let administrators off the hook? In the U.S., the cost of higher education is through the roof. Whatever happened to **holding leadership accountable**?

2 more comments...

No posts

Ready for more?