Is Your SEO Agency Worth It? A 10-Minute Audit

By the Alphaa team — we build an AI agent that checks what ChatGPT, Gemini, Claude and Perplexity say about local businesses. This audit is the sequence we actually use when an owner asks us whether they are getting their money's worth.

Short answer: Your SEO agency is worth it if it can show you work that changed something on your site or your public profiles, tied to a number that moved, in language you understand. It is probably not worth it if the monthly report is a traffic chart with no decisions attached.

It is also a bad sign if nobody can name what shipped last month, or if the answer to "what did we change?" is a list of activities rather than a list of outcomes. Below is a six-check audit that takes about ten minutes and requires no tools you don't already have.

What am I actually judging when I audit my SEO agency?

You are not judging whether your agency works hard. You are judging whether the work is compounding — whether each month leaves behind an asset (a page, a fixed technical issue, a review, a citation, a schema block) that keeps paying after the invoice clears. Retainer SEO goes wrong in a specific, recognizable way: the activity stays constant, the assets stop accumulating, and the reporting shifts from what changed to what was done.

One caveat worth stating up front, because it cuts both ways: SEO is genuinely slow, and a flat month is not evidence of failure. Six flat months with no shipped assets is a different story. Judge the trend and the artifacts, not a single report.

Check 1: Can you name what your agency shipped last month?

You should be able to list three to six concrete artifacts per month, and this check takes two minutes. Open the last three monthly reports side by side. Write down, for each month, the specific things that now exist that did not exist before — a new service page, a fixed redirect chain, twelve review responses, a schema block, a Google Business Profile update.

Good answer: you can list three to six concrete artifacts per month, and you could click to see most of them. Bad answer: the reports describe effort — "ongoing keyword research," "continued optimization," "monitored rankings" — with nothing you can point at. "Optimization" that produces no artifact is the single most common form of retainer busywork.

Check 2: What does my homepage source code reveal about my agency?

Your homepage source shows in two minutes whether schema markup, a descriptive title and a meta description are in place. This is the fastest technical tell in existence. Open your homepage, right-click, choose "View Page Source," and press Ctrl-F (Cmd-F on Mac). Search for these three strings:

• application/ld+json — this is structured data (schema markup): a machine-readable block that tells search and AI engines what your business is, where it is, and what it offers. A local business site under active management should have it. Zero hits after a year of retainers is a real finding.
• <title> — read what comes after it. It should describe what you do and where, in words a customer would use. If it says "Home" or "Welcome to Our Website," that is a two-minute fix nobody made.
• name="description" — same test. Missing or generic is a finding.

Then check yourdomain.com/robots.txt in your browser. If you see Disallow: / on a line by itself, your site is asking crawlers not to index it at all. That is rare, but we have found it on live sites under paid management, and it is catastrophic and invisible from a traffic chart alone.

Check 3: What does an AI engine say about my business?

Ask ChatGPT, Gemini, or Perplexity the question a customer would ask and see whether you are named accurately, absent, or named with wrong details. This is the check almost no agency report covers yet, and it is increasingly the one that predicts customers. Open ChatGPT, Gemini, or Perplexity and ask the question a customer would ask — not your business name, but the need: "who is the best [your service] in [your city]?" Then ask a direct one: "tell me about [your business name] in [your city]."

Three outcomes, each meaning something different:

• You are named, accurately. Good. Note which sources it cites — that tells you where your evidence is actually coming from.
• You are absent, competitors are named. Your public evidence is thinner or less consistent than theirs. This is workable and is the core of answer engine optimization.
• You are named, with wrong details. Old address, closed hours, services you dropped. This is the most urgent version, because the engine is confidently telling customers something false about you.

Why this belongs in an agency audit: roughly two-thirds of Google searches now end without a single click to a website (SparkToro/Similarweb, 2026), and 65% of consumers now use AI tools to research products before buying (Clutch, 2026). An agency reporting only on rankings and sessions is reporting on a shrinking share of how customers actually find you. That is not necessarily incompetence — it is a scope that has not been updated.

Check 4: Does my agency's report recommend any decisions?

A good report recommends decisions, not just charts, and you can check it in two minutes. Take the most recent report and count two things: how many charts it contains, and how many decisions it recommends. A decision looks like "we are cutting the three pages that get no impressions and consolidating them into one, because X." A chart is not a decision.

Good answer: the report tells a short story — here is what we tried, here is what it did, here is what we are doing next and why. Bad answer: a dashboard export with a paragraph of summary that would be equally true for any client. If you could swap in another business name and the report would still read correctly, it was not written about you.

Check 5: Is my agency moving calls, forms and bookings?

Look at calls, form fills and bookings rather than total sessions. Ignore total sessions. Total traffic is the easiest number to make go up and the least connected to revenue. Ask instead: are calls, form fills, or bookings up? If your agency cannot connect its work to any of those, it is optimizing a proxy.

Be fair here, though — attribution is genuinely hard, especially for local businesses where the customer journey ends in a phone call. The failure is not imperfect attribution. The failure is not attempting it, and defaulting to sessions because sessions are easy to chart.

Check 6: Why are my rankings flat but traffic falling?

If your rankings are stable but traffic is falling, and your agency has no explanation, they are missing the most important structural change in search. That pattern usually is not a penalty and usually is not their fault — it is what happens when an answer appears above your link. AI Overviews now appear in up to ~48% of commercial-intent searches (BrightEdge, 2026), which is precisely where buying decisions happen.

What you are testing is whether your agency can explain it. An agency that says "rankings held, so we're fine" is reading a metric that has quietly stopped predicting customers. We unpack that exact pattern in Zero-Click Search.

How do I score my SEO agency audit?

Score it by counting how many of the six checks came back clean: five or six means your agency is doing real work, three or four means the relationship is worth renegotiating rather than ending, and two or fewer means you are paying a retainer for reporting. Count the clean checks:

• 5–6 clean: your agency is doing real work. Push the scope toward AI visibility if it isn't there yet, but don't fire someone who is shipping.
• 3–4 clean: the work is real but the reporting or the scope is stale. This is a conversation, not a cancellation. Bring the specific findings.
• 0–2 clean: you are paying for activity. Get a written answer to the four questions below before your next invoice.

What questions should I send my SEO agency?

Send four questions covering what shipped, what they do about AI answers, which metric matters, and what they would cut.

• What specifically shipped in the last 90 days that still exists on my site or profiles today?
• What are we doing about AI answers — ChatGPT, Gemini, Perplexity, AI Overviews — and how is it measured?
• Which metric are we actually trying to move this quarter, and why that one?
• What would you stop doing if the budget were cut 30%? (This reveals what they consider filler.)

A good agency answers these in a paragraph each, without defensiveness. Evasive or purely reassuring answers are themselves the finding.

What are the limits of this SEO agency audit?

This audit is a diagnostic, not a verdict. A few limits on this audit, stated plainly. It is a diagnostic, not a verdict — six checks cannot capture everything a competent agency does, and some of the most valuable work (cleaning up a messy site migration, killing a toxic backlink profile) leaves little visible trace. SEO also takes months to compound, so recency bias will make a new agency look worse than it is. And a failed check is a conversation starter, not proof of bad faith; plenty of agencies are doing solid classic SEO and simply haven't added AI visibility to their scope yet.

We should also be clear about our own position: alphaa is an alternative to an SEO agency, so we have an obvious interest in you asking these questions. That is exactly why the audit above is built from things you can verify yourself, in your own browser, without taking our word for any of it. If your agency passes, keep them.

What else do owners ask about auditing an SEO agency?

What if my agency refuses to answer these questions?

Treat that as the finding. An agency doing real work can usually describe it in a sentence, so reluctance is more informative than any report.

Is a traffic drop automatically the agency's fault?

No. Clicks are falling across the board as answers move onto the results page, so judge them on what shipped and what moved rather than traffic alone.

Should I expect my agency to work on AI visibility?

It is reasonable to ask. If they cannot say which engines they check or what they changed because of it, that is a scope gap to negotiate rather than a reason to leave.

What is a fair price for this kind of work?

It varies, but what matters is what the retainer buys in shipped changes. Compare the output to the alternative of tooling plus a few hours of your own time.

So is your SEO agency worth it?

Judge your agency on artifacts and decisions, not effort and charts. Ten minutes — three reports, a view source, one AI query, and a hard look at what the reporting actually recommends — will tell you most of what you need to know. The check that surprises people most is the AI one, because it is the newest and the least likely to be in anyone's scope: the engines are already answering questions about your business, whether or not anyone you pay is watching.

The key takeaway is to judge your agency on shipped artifacts and recommended decisions, not effort and charts, and to check whether anyone is watching what AI engines say about your business.

Last updated July 21, 2026.

Run the free AI check →