Guide
Independent bias audit vs. self-serve compliance tools
Updated June 16, 2026 · By Max Langley, Bias Audit USA
NYC Local Law 144 requires your bias audit to be performed by an independent party with no financial interest in the tool or your company. A self-serve compliance dashboard can compute the math, but it is not an independent auditor and cannot give you the sign-off the law requires. Tools are useful for monitoring between audits. They do not replace the audit itself.
What the law actually requires
The statute is specific: the bias audit must be conducted by an independent auditor. Independence means the auditor did not build, sell, or use the tool, is not the employer relying on it, and has no financial stake in the result. That is why a vendor cannot audit its own hiring software and an employer cannot audit itself. The independence is the safeguard, not a formality.
Where compliance tools help, and where they stop
Monitoring software earns its place. It can watch for drift between annual audits, flag a metric slipping toward the 0.80 threshold, and keep your selection data clean and audit-ready. What it cannot do is supply independence. A dashboard you log into and run yourself produces a self-assessment, and a self-assessment is exactly what Local Law 144 says is not enough. Use the tool to stay ready; use an independent auditor to produce the report.
Why "we ran the numbers ourselves" fails
Two failure modes are common. A vendor tells customers its tool is "audited" when it only ran an internal check, and an employer assumes the vendor's word covers them when the obligation actually sits with the employer using the tool for NYC roles. Neither produces an independent report with a named sign-off, so neither satisfies the law. Industry analysis backs this up: only around 45% of hiring-AI vendors use third-party audits, and many organizations claim fairness while few publish the evidence.
How to tell if your audit will hold up
- · The auditor is genuinely independent of the tool and your company.
- · The report shows selection and scoring rates and impact ratios by sex, race, ethnicity, and intersectional categories against the 0.80 four-fifths rule.
- · It carries a named, independent sign-off, not just a software-generated score.
- · You receive the public summary and candidate notice you are required to publish.
Can a compliance tool perform my Local Law 144 bias audit?
Not on its own. NYC Local Law 144 requires the bias audit to be conducted by an independent auditor with no financial interest in the tool or the employer. Software can compute the numbers, but a self-serve dashboard is not an independent party and cannot provide the independent sign-off the law requires.
What does "independent" actually mean here?
It means the auditor did not build, sell, or use the tool, is not the employer relying on it, and has no financial stake in the outcome. A vendor cannot audit its own hiring software, and an employer cannot audit itself. That separation is the entire point of the requirement.
Do compliance tools have any value, then?
Yes. Continuous monitoring tools are useful for catching drift between annual audits and for preparing clean data. They are a complement to an independent audit, not a substitute for it. Use the tool to stay ready; use an independent auditor to produce the report that satisfies the law.
How common are real third-party audits?
Less common than vendor marketing suggests. Industry analysis of hiring-AI vendors found roughly 45% use third-party audits while most still rely only on internal testing, and independent reviews note that many organizations claim fairness but few publish the data to prove it.
How do I know my audit will hold up?
Check that the auditor is genuinely independent, that the report shows selection and scoring rates and impact ratios by sex, race, ethnicity, and intersections against the 0.80 four-fifths rule, that it carries a named sign-off, and that you can publish the required public summary. If any of those are missing, the audit may not satisfy Local Law 144.
Sources
- NYC Department of Consumer and Worker Protection, Automated Employment Decision Tools, nyc.gov.
- Warden AI, State of AI Bias in Talent Acquisition 2025, warden-ai.com.
- Stanford HAI, 2026 AI Index, Responsible AI chapter, hai.stanford.edu.
Need an audit that actually holds up?
We are an independent auditor. We do not build or sell hiring software, so we can audit yours and put a named sign-off on the report.
This guide is general information, not legal advice. Confirm your obligations with qualified counsel.