Conversational Reference Auditor — AI reference checks for recruiters

Phase 2 of the Submittal Orchestrator, evaluated standalone. Same buyer, same channel problem — and a legal exposure the first idea did not have. This is the lowest score in the corpus.

1. The idea

A corporate recruiter posts to r/recruiting in August 2026 about a senior engineer they hired: "Great portfolio, nailed the interviews, references checked out." Two months later they discover he is working six full-time remote jobs, including two at direct competitors. The thread runs to 7,229 upvotes and 654 comments.

The pain is real. The Conversational Reference Auditor proposes to fix it with an adaptive AI that conducts 10-minute asynchronous voice or text interviews with references on their own schedule, cross-checks their answers against claims in the candidate's own interview transcripts, runs a "Sentiment & Friction Radar" for hesitant tone and guarded answers, and emits a branded, auditable verification scorecard PDF for the client.

Three separate things make this a pass, and one of them is not a business judgement — it is that the product as described is very likely a regulated consumer report generated by an automated employment decision tool, proposed by a solo founder with a sub-$1,000 budget, in the year the law tightened around exactly that.

2. Fact strip

3. The numbers

4. Why now

The regulatory environment moved against this product during 2026. This is the only negative timing score in the corpus.

• Illinois' AI Video Interview Act took full effect February 2026 — employers using AI to analyse interviews must notify candidates, explain how the technology works, and obtain consent. Illinois HB 3773 separately amended the Human Rights Act to prohibit AI use in hiring where it produces discriminatory outcomes (2026 summary).
• Colorado's AI Act covers employment AI from 30 June 2026, with a proposed high-risk AI registry requiring employers to report AI hiring tool usage to the state.
• NYC Local Law 144 requires an independent bias audit for automated employment decision tools, prior notice to candidates, and an alternative evaluation on request — $500 first violation, $500–$1,500 per subsequent one (2026).
• A 2026 class action alleges FCRA and California violations for generating algorithmic applicant scores without proper notice or consent (FCRA compliance guidance, 2026).

A "Verification Scorecard" produced by an AI that interviews third parties about a candidate's performance, scores them, and feeds a submit/don't-submit decision sits inside all four of those. The window did not open in 2026. It narrowed.

5. The receipts

"Great portfolio, nailed the interviews, references checked out. Within two months... he's not just overemployed, he's a damn legend of it. Six full-time remote jobs. Six. Including two of our direct competitors." — r/recruiting · Fantastic-Hamster333 · Aug 2026 · 7,229↑, 654 comments · thread

"They also tend to use very similar emails to their own for the references (name.surname123@) not company emails." — r/recruiting · Laura_stocks, on fraudulent candidates · Jun 2026 · 282↑, 223 comments · thread

"Founders keep pitching 'more candidates, faster' and 'AI outreach at scale' like it is a feature, but from where I sit it is the exact opposite of what this space needs." — r/recruiting · a 15-year corporate recruiter · Dec 2025 · 247↑, 187 comments · thread

The first receipt is the most important finding in this report, and it cuts against the product. The references did get checked. They came back clean. The candidate was defrauding six employers simultaneously. A better-conducted reference interview would not have changed that outcome, because the constraint was never interview quality — it was that the references either did not know or would not say.

The second receipt names the failure mode the product cannot survive: candidates supply their own references, and fraudulent candidates supply fraudulent ones. An AI that conducts a warm, adaptive, ten-minute conversation with a fake reference produces a fluent, well-structured, auditable PDF that launders the fraud into documented due diligence. Automation does not just fail to catch this case — it makes it worse, because the artifact looks more rigorous than a phone call.

6. Whitespace

The category is 25 years old, consolidated, and the AI version already ships.

• SkillSurvey — online automated reference checking, acquired by iCIMS.
• Crosschq — "Crosschq 360... validates soft skills, competencies, work history and culture match, and automates reference checks."
• HiPeople — verifies "previous work history, job titles and tenures," and already includes fraud detection features. That is the discrepancy engine.
• Xref — "the most seamless combined reference and background check experience in a single platform."
• Enterprise pricing from $8,000+/yr (2026 comparison).

And the conversational-AI differentiator is a named, shipping product category. "AI Voice Agent Reference Checks" has its own vendor landing pages (example), inside a voice-AI recruiting market that crossed $22 billion in 2026 with HR applications growing at 25.3% CAGR. Voice agents already "conduct dynamic, branching phone calls, adapting their questions based on responses... delivering structured scorecards within minutes."

What is arguably still unclaimed: cross-checking reference answers against the candidate's own interview transcript. Incumbents compare references against a role profile, not against what the candidate personally claimed. That is the same internal-context join that is the genuine insight in Kept and the Client Narrative Engine — and here it is attached to the most legally exposed product in the corpus.

7. Proof & signals

• The pain is expensive and real: a 20%+ placement fee on a $100K role is $20K, and a 90-day guarantee means a bad placement is refunded or replaced at cost.
• A paying category exists at $8,000+/yr, which proves willingness to pay — and simultaneously proves the buyer already has a vendor.
• Fraud is measurably rising — the North Korea/remote-fraud thread (282↑) and the six-jobs thread (7,229↑) are both 2026, both about verification failing.
• The audience is hostile to exactly this pitch. A 247-upvote thread of experienced recruiters is specifically about being fed up with AI recruiting products, and this would be sold into it.

8. Who you're up against

• SkillSurvey (iCIMS) — INCUMBENT. The 25-year default, embedded in ATS workflows.
• Crosschq — well-funded, "Crosschq 360," analytics on top of references.
• HiPeople — work-history verification with fraud detection already shipped; free tier for basic surveys.
• Xref — combined reference + background check in one platform.
• AI voice-agent vendors (enginehire and the broader $22B voice-AI recruiting field) — the conversational layer, already productised.
• Traditional background-check CRAs (Cisive, Sterling, HireRight) — the compliant, insured, FCRA-registered path an agency's counsel will point at.
• A recruiter making two phone calls — free, legally simplest, and still the default at boutiques.

9. The verdict

Reasons to build

• The pain is genuine and expensively documented: a 7,229-upvote thread about references failing to catch a six-job fraud is as vivid a failure case as this corpus contains, and $20K+ fees plus 90-day guarantees make the downside concrete.
• Asynchronous completion is a real improvement on phone tag, and the completion-rate argument against sterile web forms is sound.
• Cross-checking references against the candidate's own claims is a genuine gap — incumbents check against the role, not against what the candidate personally said.
• Fraud is rising and recruiters know it, so the framing lands emotionally.

Reasons to not build

• The product is probably a consumer report, and the founder is probably a CRA. When a third party interviews people about a candidate's performance, discipline or conduct, the output "may qualify as an investigative consumer report," triggering FCRA disclosure, authorisation, dispute-reinvestigation and adverse-action obligations (2026 guidance). Penalties run from $100–$1,000 statutory per violation to multi-million-dollar class settlements. This is a compliance company wearing a SaaS costume, and the budget on file is under $1,000.
• "Sentiment & Friction Radar" is the single most legally exposed feature in this corpus. Inferring unsaid concerns from "hesitant tone" and "guarded answers," then feeding that into a hiring decision, is an automated employment decision tool under NYC LL144 (bias audit required), squarely inside Illinois HB 3773's discrimination prohibition, and inside Colorado's AI Act from June 2026. Vocal hesitancy correlates with disability, accent, non-native fluency and neurodivergence. This is the feature a plaintiff's firm reads first.
• A 2026 class action already targets exactly this shape — algorithmic applicant scores generated without notice and consent. The proposal generates a scorecard.
• The core premise is contradicted by the best receipt. In the flagship fraud case, references checked out. The binding constraint is not interview quality — it is that most employers instruct managers to confirm dates and title only, because saying more invites a defamation claim. A more articulate interviewer does not unlock information the reference is under instruction not to give.
• The product legitimises fraudulent references. Candidates nominate their own referees; fraudulent candidates nominate fake ones (documented in the receipts). A polished AI interview with a fake reference yields an auditable branded PDF asserting verification — worse than no check, because it manufactures documented confidence.
• The category is 25 years old and consolidated, the AI voice layer already ships as a named product, and HiPeople already markets fraud detection. There is no version of this where the founder is early.
• Wrong buyer, no channel. Recruiting agencies are not the marketing and consulting agencies the existing pipeline reaches — the same cold-start problem that sank the Submittal Orchestrator, now with legal exposure attached.

10. Founder fit

The idea demands: distribution 8/10 · domain 8/10 · sales 7/10 · technical 7/10 · capital 9/10

That capital score is the highest assigned in this corpus, and it is not about servers. It is counsel to determine CRA status, FCRA-compliant disclosure and adverse-action workflows, a dispute-reinvestigation process, an independent bias audit for NYC, state-by-state AI-hiring compliance, and errors-and- omissions insurance sized to employment claims — before the first customer.

The Rui check. Against a stated budget of under $1,000 per bet, a capital demand of 9 is disqualifying on its own. The other axes do not rescue it: recruiting agencies are outside the domain the profile actually covers (marketing and consulting agencies), there is no channel to them, and a solo founder with no legal counsel would be personally carrying liability for adverse employment decisions made on his product's scores.

This is the only idea reviewed where the recommendation would be a pass even if the market were empty and the founder had a warm channel, because the downside is not a wasted quarter — it is a lawsuit against a one-person company.

Goal check: irrelevant. The compliance floor exceeds the year-one revenue ceiling by an order of magnitude.

11. Value ladder

Not modelled. A ladder implies a route to market, and the finding is that the route runs through a regulatory regime this founder cannot fund. Presenting tiers here would dress a legal problem as a pricing question.

12. The plan

There is no build plan, and that is the deliverable.

If the underlying interest is real, the salvageable insight is the candidate-claim cross-check — comparing what a person said in their own interview against what a reference independently reports. That primitive is genuinely unclaimed. It is also the one piece that can be built without becoming a CRA, if and only if the agency conducts its own reference calls and the software never contacts the reference, never scores the candidate, and never infers anything from tone. In that shape it is a discrepancy highlighter over two transcripts the agency already owns — a feature, sold to the same cold buyer, and worth a fraction of the proposal.

Everything else — the AI conducting the interview, the sentiment radar, the scorecard — is what converts a document tool into a regulated one.

Before any of that: a one-hour consultation with an employment lawyer on whether the described product makes its operator a consumer reporting agency. That answer determines whether there is a company here at all, and it costs less than a day of building.

13. Napkin math — year one

Weakest assumption: that any of it is reachable before the compliance spend. It is not. This is the only napkin in the corpus where the costs are better evidenced than the revenue.

14. The ceiling

$500K–$2M ARR exists in this category — SkillSurvey and Crosschq demonstrate it. It is unreachable from a sub-$1,000 budget with no legal infrastructure, against incumbents who spent two decades building the compliance apparatus that is the actual moat. In regulated categories the compliance burden is the barrier to entry, and here it is pointed at the founder.

15. Playbook prompts

• Legal first: "Read reports/2026-09-01-reference-auditor.md. Draft the questions to put to an employment lawyer about whether this product makes its operator a consumer reporting agency under FCRA, and what NYC LL144, Illinois HB 3773 and the Colorado AI Act would each require."
• Roast: "Read reports/2026-09-01-reference-auditor.md and roast it as (a) a plaintiff's employment lawyer, (b) Crosschq's head of compliance, (c) the recruiter whose references 'checked out' on a six-job fraud."
• Salvage: "Read reports/2026-09-01-reference-auditor.md. Scope only the candidate-claim cross-check from §12 — no AI contacting references, no scoring, no tone inference — and say whether a product remains."

16. Verdict & next move

PASS · high confidence

The pain is real and the flagship receipt is the most vivid in the corpus. It is also the receipt that undoes the pitch: in that case the references were checked and did come back clean, because the constraint is what referees are permitted and willing to say, not how skilfully they are asked. Most employers restrict managers to dates and title precisely to avoid defamation exposure. A better interviewer does not unlock what someone has been instructed not to disclose — and when the referee is one the candidate invented, a polished AI conversation produces an auditable PDF that certifies the fraud.

Around that sits a 25-year-old consolidated category where AI voice reference checks already ship as a named product and HiPeople already markets fraud detection, sold to a buyer this founder has no route to.

And underneath all of it: a third party conducting recorded interviews about a person's job performance, scoring them, inferring concern from vocal hesitancy, and producing a document that decides whether they are submitted for a role. That is an investigative consumer report generated by an automated employment decision tool, in the year Illinois' AI interview law took effect, Colorado's AI Act reached employment, and a class action began over algorithmic applicant scores issued without consent. The compliance floor is five figures a year before the first sale. The budget is under $1,000.

Next move: none — with one exception worth an hour. If the idea keeps nagging, spend it with an employment lawyer on a single question: does this make me a consumer reporting agency? Every other question is downstream of that one, and it is answerable for less than the cost of a weekend spent building.