Every agency pitch deck says "AI-powered" now.
That word tells you almost nothing. It's on the site of a shop running ChatGPT as a Google Doc replacement, and on the site of a team that's rebuilt its entire creative and reporting pipeline around it. And from the outside, the decks look identical.
So the question that actually separates these two categories isn't "do you use AI."
It's a sharper one: where in the decision-making process does AI actually operate, and what evidence shows it produces better outcomes than the agency got before?
That's the version of the question worth asking on every call, and this guide walks through exactly how to ask it — plus the five criteria that hold up once you do.
If you're earlier in this decision: still weighing AI tools against hiring anyone at all, we laid out that comparison, including the cost and revenue thresholds that usually decide it, in AI vs. hiring a marketing agency. This guide picks up from there, for stores that have already decided an agency makes sense and need to know which one is actually worth the retainer.
Why "Do You Use AI" Is the Wrong First Question
Ask any agency if they use AI in 2026 and the answer is yes. T
It's a table-stakes relevance the way "do you have a website" stopped being a real qualifier a decade ago. A meaningful share of marketing teams now have AI in production somewhere in their workflow, which means the yes/no version of the question filters out almost nobody.
The productive question is narrower: which specific parts of the workflow does AI touch, and where does a human step in before anything reaches you?
An agency that can answer that in one sentence, tool by tool, is telling you something real. An agency that answers with "we're AI-first" and nothing more specific is telling you the phrase is doing the work the substance should be doing.
💡 TIP: Ask the agency to literally walk you through their workflow tool by tool, research, drafting, creative production, reporting, and name the exact point where a human reviews the output before it reaches you. Vague answers here are the single most useful signal you'll get on the whole call.
Criteria 1: Tool and Workflow Transparency
A real answer names the actual tools and models in use, separates what's automated from what a person still checks, and can explain how client data is handled inside that pipeline. It should also be able to separate its own strategy fee from pass-through platform or API costs — those are two different line items, and an agency that bundles them together to obscure the actual markup is a pricing problem, not a technology one.
What good looks like
The agency names specific tools (not just "AI"), describes the human-review step by name and by person, and can tell you which parts of a deliverable are AI-drafted versus AI-assisted versus fully human. If they can't answer that breakdown for their own process, they haven't actually thought about where AI creates value versus where it just creates output.
Criteria 2: Verifiable Outcomes Tied to Revenue
This is the criterion that separates agencies selling activity from agencies selling results. Ask for a case study with a named metric, a measured change, and a defined timeframe — something checkable.
"Massive AI-driven gains" is marketing copy. "Contribution margin improved 14% over a 90-day window on this specific account" is a claim you can verify.
The deeper version of this question, especially for eCommerce specifically: does the agency report on business-level metrics like Marketing Efficiency Ratio and contribution margin, or only platform-reported ROAS?
Platform ROAS is the easiest number to inflate and the least connected to what you actually keep. An agency that leads with it instead of MER is optimizing your evaluation of them, not your business.
What good looks like
Dated, specific case studies with numbers you could ask to see backed up. A clear answer on which metric they consider the real scoreboard, and why.
Criteria 3: Named AI-Search Visibility Capability (Not Just Traditional SEO)
This is the newest criterion, and it's the one most agencies still don't have a real answer for. A meaningful and growing share of buyer research now happens inside ChatGPT, Perplexity, and Google's AI Overviews before a shopper ever clicks a paid ad or a traditional search result. Zero-click search behavior has been climbing fast, which means ranking on page one of classic search results matters less on its own than it used to.
The discipline built around this is usually called Answer Engine Optimization or Generative Engine Optimization — structuring content so AI engines actually cite your brand in the answers they generate, rather than just crawling and ranking it the old way. An agency without a real answer here isn't behind on a minor tactic; it's missing an entire discovery channel that's actively growing.
💡 TIP: Before your first call, open ChatGPT or Perplexity and search "best [your product category] brands." If your brand doesn't show up, that's a real gap costing you buyers who never reach your paid ads at all — and it's worth asking every agency on your shortlist directly how they'd close it.
What good looks like
A named service or workflow for AI-search visibility — not a vague mention of "staying current," but an actual method: structured data, direct-answer content blocks, consistent entity presence across authoritative sources. If you want the deeper tool-by-tool version of this — which specific AI marketing tools actually move the needle versus which are just subscription noise — our AI tools for eCommerce breakdown covers that by category.
Criteria 4: Diagnosis Before Prescription
A real agency asks about your current channel mix, margins, AOV, and LTV before recommending anything. If the recommendation arrives before the diagnosis — every prospect gets the same "paid social plus email" pitch regardless of their specific numbers — that's a sign you're being sold a product, not given a strategy.
This matters more with AI in the mix, not less. AI tools make it cheap to generate a plausible-sounding strategy deck fast. That makes the diagnosis step easier to skip and easier to fake, which is exactly why it's worth checking for directly instead of assuming it happened.
What good looks like
The agency asks for your numbers — real ones, not vanity metrics — before proposing a channel mix. They can explain why your specific margin structure or catalog size points toward one strategy over another.
Criteria 5: Category and Vertical Fit
An agency that's scaled dozens of DTC brands in your category will ramp meaningfully faster than a generalist learning your vertical from scratch. This has always mattered, but it matters more now because AI tooling has made execution more commoditized — the differentiator has shifted from "can they run ads" to "do they understand your category's specific economics," things like return-rate-adjusted ROAS for apparel, or replenishment timing for consumables.
What good looks like
Specific, named experience in businesses like yours — not adjacent, actually comparable in catalog size, margin structure, and channel mix.
The Questions to Ask, in Order
Bring the same list to every agency on your shortlist so the answers are actually comparable:
- Walk me through your workflow tool by tool — where does AI touch this, and where does a human review it before I see it?
- Show me a case study with exact numbers and dates, tied to revenue or margin, not just traffic or platform ROAS.
- What's your AI-search visibility capability, and how do you measure it?
- What do you need from me — channel mix, margins, AOV — before you'll recommend a strategy?
- How do you separate your strategy fee from platform and API costs in your pricing?
- What's your experience with businesses at our specific catalog size and margin structure?
Score the specificity of the answers, not just whether they gave one. A few of these questions overlap with the warning signs worth watching for on their own — we broke those out separately in AI marketing agency red flags, since some of them are worth catching before you even get on a call.
Top Growth Marketing
We run AI-assisted research, creative production, and reporting inside every engagement, but the split matters more than the fact of using it. AI handles volume — more creative variants tested per week, faster first drafts, prediction on your own historical order data.
A human strategist owns which channel gets the next dollar, what your margin can actually support, and the judgment calls a model trained on last quarter's patterns can't originate on its own. That's the same split we walked through in more detail in our guide to using AI without losing the strategy layer — worth a read if you're building that evaluation for your own team, not just for a vendor.
"The productive question is never 'do you use AI?' but 'where does AI actually operate, and what evidence shows it produces better outcomes?'" — Ranketize, AI Marketing Agencies: How to Evaluate and Choose One in 2026
The Bottom Line
Choosing an AI marketing agency in 2026 isn't about finding the one with the most confident AI language on its homepage.
It's about finding the one that can answer five specific questions with evidence instead of adjectives: where AI sits in their process, whether outcomes are verifiable and tied to revenue, whether they have a real AI-search capability, whether they diagnose before they prescribe, and whether they actually know your category.
Any agency that answers all five clearly is a genuinely different tier of partner than one that just added "AI-powered" to its tagline. If you want a second opinion on where a specific agency lands against this list, or want to see what an integrated AI-plus-human process actually looks like end to end, book a call and we'll walk through it with you.
0 Comments