This tool is part of the Red Pin Geek Premium series. Read the companion walkthrough on Substack: How I score myself: the Consultant Evaluation Scorecard walkthrough.
Why this tool matters
Run the Trust Signal Check on Any Consultant Before You Engage
A designer emailed me last week with a question I should have had a clean answer for: how do I evaluate an AI visibility consultant before I engage them? She had a quote in hand. The consultant came recommended. Their site loaded fast. She wanted a way to check, before she signed, whether the consultant could actually deliver.
I did not have a structured answer to give her. So I built one.
What I expected to find when I rendered the consultant's site in a plain text browser: structural failures. Broken sitemap. Missing schema. The usual suspects. What I actually saw was a page that read clean. Headings in place. Service modules listed. A confident value proposition. None of it broken.
What it also did not have was anything for a model to stand on. No named clients. No case studies a model could quote. No methodology a model could point to. The page was legible, and it was empty. That was the moment the framework I built for the designer landed in my own head: legible is not the same as recommendable. Listed is not recommended.
The Consultant Evaluation Scorecard is the structured version of the check I now run on every consultant I evaluate, before recommending engagement.
See whether your consultant can deliver what they sell, before you spend on the engagement that finds out for you.
What This Tool Helps You Do
- Score any AI visibility consultant against the same 11-question framework I use in client conversations, in 15 to 20 minutes
- Run both accessibility checks (the 5 from the blog) and guided technical signals (6 more, each one click or one paste with plain-language interpretation)
- Get routed into one of four categories (PASS, REVIEW, DECLINE-THIN, DECLINE-OPAQUE) with a prioritized action sequence and conversation script tailored to your result
- Get the exact language to raise each failed signal with the consultant before you sign (the conversation script designers ask me for the most)
- Save the cost of an engagement that would have left your store as legible-but-thin as the consultant's own site
Here's What It Looks Like
Here is one anonymized result panel. Premium subscribers get all 11 questions, all 4 category routings, the full conversation script per failed signal, and a worked example using my own redpingeek.com self-scoring.
CASE: Consultant with strong brand, generic page, no technical infrastructure
Tier 1
2.6
High
Tier 2
1.3
Low
Combined
1.95
Mid
● DECLINE-THIN
Legible but no technical foundation. The invisible middle.
Tier 1 high (the page reads clean, ChatGPT can summarize it, there are some named clients). Tier 2 low (no llms.txt, missing schema, sitemap returns 404, no AI citations for stated specialty). The consultant does not have the architecture they would need to build for you.
This is one of four possible routings. Premium subscribers get the full audit with all 11 questions, the worked example using my own self-scoring on redpingeek.com, the category-specific action sequences, and the expanded conversation script with language for each failed signal.
What Premium Subscribers Get
- The full 11-question audit in two tiers: 5 accessibility questions (matching the blog's 5-step check) and 6 guided technical signals (each one click or one paste).
- Plain-language interpretation of every technical signal so you never see a validator output or read JSON. The tool translates llms.txt presence, schema validator results, sitemap health, AI citation queries, named-client verification, and methodology depth into score answers a non-technical reader can give in seconds.
- The four-category routing (PASS, REVIEW, DECLINE-THIN, DECLINE-OPAQUE) with the precedence rule that decides which category wins when more than one applies.
- The conversation script per failed signal, the exact language to raise each gap with the consultant before you sign. This is the language designers ask me for the most when they are evaluating someone.
- Print or save-as-PDF so you can keep the result alongside your other engagement-evaluation work.
- A worked example using my own self-scoring on redpingeek.com: I score myself transparently against every one of the 11 questions and show you the routing the tool returned. The trust transfer is documented, not implied.
- The companion Substack walkthrough with the operational truth ("the accessibility tier is load-bearing"), the framework's central reframe ("legible is not the same as recommendable"), and the edge cases (newer consultants, agencies, brand-name shells).
What This Replaces
- Hoping a consultant who came recommended can actually deliver, without a structured way to verify
- Asking the consultant for case studies without a framework for evaluating what the case studies are actually showing
- Spending five figures on an engagement and finding out six months later that the consultant could not build their own technical foundation, let alone yours
- Asking a developer friend to "look at the consultant's site" without giving them anything specific to evaluate
- Walking away from a consultant without ever telling them why, and walking into the same pattern with the next one
Where This Fits in the Premium Tool Series
The Consultant Evaluation Scorecard sits at the trust-transfer layer of the Red Pin Geek Premium tool series, alongside the Migration Decision Checklist. Both are pre-engagement diagnostics: this one helps you evaluate the consultant; the Migration Decision Checklist helps you evaluate the platform decision the consultant is selling.
Content-to-Buyer Tier Audit Worksheet: the tool that scores your own store against the three buyer tiers. The companion piece to this one: this audit evaluates the consultant; that audit evaluates the work that needs doing.
AI Page Visibility Check (free): the free diagnostic for whether a single page is visible to AI. Run it on your own store after the consultant-evaluation work, before the engagement starts.
No more engaging consultants whose own site cannot pass the test they should be running on yours.
No more guessing whether a clean-looking consultant page is hiding the absence of a technical foundation.
No more walking away from a bad fit without the language to say why.

