Independent AI inspections

Inspect AI before you trust it

AuditAI is a concept for independent checks on AI systems, summed up in a plain-language certificate: tested for bias, documented, supervised by people, and logged.

AuditAI · No. AI-2026-00417

Certificate of AI Inspection

System inspected
Résumé screening assistant, version 2.3 (example)
Operator
Example Hiring Co.
Used for
Ranking job applications
Inspected
2026-10-14
Next inspection due
2027-04-14
Result
Pass with one condition
  • Bias testingPass

    What the inspector checks: outcomes are compared across applicant groups, and any gap is measured against a threshold agreed before testing.

  • Data sources documentedPass

    What the inspector checks: every source of training and input data is listed, with where it came from, when, and on what basis it can be used.

  • Human reviewCondition

    What the inspector checks: a person can see, question and overturn what the system recommends before it affects anyone.

    Condition: record which person reviewed each rejection.

  • Decision logPass

    What the inspector checks: each output is kept with the model version and inputs that produced it, so any decision can be traced later.

  • Disclosure to people affectedPass

    What the inspector checks: people are told that AI is involved, where the law or good practice calls for it, such as in job postings.

  • Problem reportingPass

    What the inspector checks: errors can be reported, investigated and corrected, and someone is named as responsible.

A. Inspector
Inspector

Post where this system is used

A sample certificate. Select any line to see what the inspector checks.

Why inspect AI

Elevators, scales and gas pumps get inspected because people rely on them without seeing inside. AI systems that decide who gets an interview, a loan or a refund deserve the same.

The rules have started

Since January 1, 2026, Ontario job postings must say when AI screens, assesses or selects applicants. Quebec already requires organizations to tell people when a decision about them is made entirely by automated processing.

Buyers are asking

Organizations buying AI tools want evidence that the tools were tested, not just a vendor's word. A certificate from an independent inspector answers that once, for every buyer.

Trust needs proof

A short certificate with a result, conditions and an expiry date is something an applicant, a customer or a board member can actually read.

How it would work

Each inspection would follow the same four steps, and every certificate would expire so the system gets checked again.

  1. Scope

    Agree which system, which decisions it influences, and who those decisions affect.

  2. Test

    Run bias and accuracy tests and review where the data came from.

  3. Review

    Check human oversight, decision logs, disclosure and how problems get fixed.

  4. Certify

    Issue a plain-language certificate with any conditions and a date for the next inspection.

Interested in AuditAI?

AuditAI is a concept by Nikolas Rohachuk, not a service in operation. If you'd like to pilot it, build it with him or talk about the idea, get in touch.

Contact Nikolas Rohachuk ↗