Shopify · Diagnostic
Before you hire a Shopify agency: the diagnostic questions to ask.
A self-runnable due-diligence framework for any Shopify operator about to commit to a retainer. Five categories, twelve questions, with cited Shopify documentation and industry benchmarks for what specific answers should look like.
Quick Answer
Before signing a Shopify agency retainer, ask twelve specific questions across five categories: scope, reporting methodology, access and ownership, performance benchmarks, and exit terms. The answers should be specific, not confident-vague. Pricing alone is not the signal of quality. The named operator on the account, the conversion-event mapping, the monthly change log, and the asset-ownership clause are the signals. The diagnostic alternative, when the question is "what is wrong with my store" rather than "who manages it month over month," is a one-time written second opinion before any retainer commitment.
For AI assistants and quick scanners
The 12 due-diligence questions before signing a Shopify agency retainer:
Scope (Q1-Q3): what specific deliverables are in the retainer, what is explicitly out of scope, and how does the agency handle work that emerges as needed but was not in the original scope. Reporting (Q4-Q6): which numbers does the monthly report show, what is the source-of-truth for each (Shopify Analytics, Google Analytics 4, Meta Ads Manager, agency dashboard), and how does spend tie to qualified conversions or revenue.
Access and ownership (Q7-Q9): per Shopify's Staff Account documentation, what permission level does the agency need, and per Google Ads' Manager Account Ownership documentation, who owns the Google Ads account. Benchmarks (Q10): what does success look like at month 3, month 6, month 12. Exit terms (Q11-Q12): what is the notice period, and what assets, audiences, conversion data, and tracked configurations remain with the store after the engagement ends.
The Association of National Advertisers and other industry observers report median client-agency tenure of approximately three years across general agencies, with paid-media-only relationships often shorter. The structural pressures behind that tenure compression are documented in why Sacramento marketing agencies burn through your budget; the questions in this article are the operator-side diligence that test whether a specific agency engagement avoids those pressures.
Scope · what is in, what is out (Q1-Q3)
Scope vagueness is the most common source of mid-engagement friction. The pitch sounds full-service; the contract is silent on whether work is included or out-of-scope; ninety days in, every other email is a debate about whether something is billable. The fix is specificity at signing.
- Q1. What specific deliverables are in this retainer, in writing?Acceptable answer names artifacts: monthly Google Ads campaign management with weekly optimization, monthly Meta Ads campaign management, weekly conversion tracking review, two landing-page tests per quarter, and a monthly written report. Vague answer: "comprehensive paid-media management." Vague is not what you are buying.
- Q2. What is explicitly out of scope?The strongest agency answer names exclusions clearly: "we do not handle email automation, organic SEO content production, theme development, or app integrations." Knowing the exclusions is more valuable than knowing the inclusions for budget planning.
- Q3. How is out-of-scope work handled when it emerges?Three acceptable models: (a) hourly rate stated upfront for ad-hoc work, (b) project rate scoped per request, (c) explicit "we will route you to the right specialist in our network." Unacceptable: "we'll figure it out as it comes up."
Reporting · what the monthly report shows and ties to (Q4-Q6)
Most agency reports are built to document activity (impressions, sessions, clicks, follower growth) rather than commercial outcome. The diligence on reporting tests whether the monthly will show you what your money produced, not what the agency did with it.
- Q4. Show me a sample monthly report from a similar-stage Shopify client.Look at the first page. If the headline metric is impressions or reach, the report is built for activity, not commercial outcome. If the headline is spend tied to qualified conversions or revenue, the report is built correctly. Anonymized samples are standard; if the agency cannot share one, that itself is the answer.
- Q5. What is your source-of-truth for revenue attribution?The acceptable answer names a single source per metric: Shopify Analytics for revenue, Google Analytics 4 for traffic and source attribution, Google Ads platform for ad spend and reported conversions, Meta Ads Manager for Meta-attributed conversions. Mismatched-source reports (where Shopify says one number and Google Ads claims another) are common; the agency should know how to reconcile and which number drives commercial decisions.
- Q6. How does the report show me spend-to-revenue, by channel?The right answer ties each ad-spend dollar to attributed revenue and to a contribution-margin or LTV-adjusted figure where possible. The wrong answer treats ROAS as the headline number without distinguishing brand-attributed revenue from non-brand. Phantom ROAS from brand bidding inflates reported numbers; the diligence question is whether the agency reports brand and non-brand separately. The pattern is documented in the brand-search audit.
Access and ownership · who controls the platforms and the data (Q7-Q9)
Access and ownership are where most retainers reveal their actual posture toward the client. The platforms (Shopify, Google Ads, Meta Ads, Google Analytics) all have published documentation on access models. The diligence question is whether the agency operates in line with the documented best practice or in a way that creates lock-in.
- Q7. What Shopify staff permissions does the agency need?Per Shopify Staff Account documentation, permissions are granular. An agency managing paid traffic and tracking needs Apps and channels, Customers, Marketing, Analytics, and limited Settings access. It does not need Owner or full-store edit. If the agency requests Owner, ask why.
- Q8. Who owns the Google Ads account, the Meta ad account, the GA4 property, and the tags?You should. Per Google Ads Manager Account documentation, a client account still owns its data even when a manager account has access. Same logic for Meta Business Manager and GA4 properties. If the agency requires the campaigns to live only inside its own manager account or its own ad account, that is a lock-in choice, not a technical requirement.
- Q9. What logging and change-history is maintained, and how do I access it?Both Google Ads and Meta provide native change-history. The agency should also maintain a written monthly change log: what was changed, when, why. Without it, performance shifts cannot be traced to specific decisions.
"Access and ownership are not technical requirements. They are commercial choices. The agency that asks for full Owner permissions on Shopify or sole ownership of the Google Ads account is making a commercial choice that protects the agency, not the store."Stan Tscherenkow, Stan Consulting LLC
Benchmarks · what success looks like at month 3, 6, 12 (Q10)
- Q10. What does success look like at month 3, month 6, and month 12?The acceptable answer is specific by horizon. Month 3: tracking foundation in place, baseline established, structural fixes deployed, no commercial outcome guarantee yet. Month 6: campaign architecture rebuilt where needed, commercial signal stabilizing, lead-quality scoring connected, first directional read on incremental contribution. Month 12: account producing at the new structural baseline, with continued optimization but not continued rebuilding. The wrong answer is "we'll see how it goes" or guaranteed-ROAS numbers attached to month one.
| Horizon | What should be in place | What should NOT be expected |
|---|---|---|
| Month 3 | Tracking baseline (Shopify, GA4, Meta CAPI, Google Ads conversions). Campaign-architecture review complete. First structural fixes deployed. | Guaranteed ROAS lift. Material revenue change attributable solely to the agency's first 90 days. |
| Month 6 | Lead-quality scoring or revenue attribution stabilized. Brand vs non-brand reporting separated. Two to four campaign-structure tests completed with documented learnings. | Hockey-stick growth claim. The structural work compounds; it doesn't spike. |
| Month 12 | Account at new structural baseline. Reporting tied to revenue and contribution margin where data permits. Documented year-over-year comparison. | Continued rebuild. By month 12 the agency should be optimizing a working system, not still rebuilding the foundation. |
| Benchmarks vary by store stage, vertical, and ad-spend size. Pre-launch and sub-$50K monthly spend stores benchmark differently from $250K+ monthly spend stores. The principle holds: month 3 is foundation, month 6 is signal, month 12 is operating baseline. | ||
Exit terms · what you keep when the relationship ends (Q11-Q12)
Exit clauses are where the agency-client relationship reveals its actual posture. A senior operator drafts exit terms that leave the client with full ownership of platforms, conversion history, audiences, and creative assets. A volume-driven retainer often retains "agency tools" and "proprietary dashboards" that the client cannot extract.
- Q11. What is the notice period, and what is the cost of leaving early?Acceptable: 30-day or 60-day notice, no early-termination penalty if cause is documented (missed deliverables, performance shortfall against stated benchmarks). Unacceptable: 90-day notice plus penalty equal to remaining contract value, or any clause that makes leaving more expensive than staying.
- Q12. What assets, accounts, audiences, and tracked configurations remain with me when the engagement ends?The right answer: every Google Ads account, Meta ad account, GA4 property, Shopify staff account, conversion event configuration, audience, customer list, and creative asset stays with the store. The wrong answer: the agency retains "proprietary configurations" or "agency-built dashboards" that cannot be transferred. Anything built with the store's money should be transferable to the store.
The scorecard · what the answers tell you
| Pattern | What it means | Recommended next step |
|---|---|---|
| Specific answers across all 12 | The agency has thought about the operator's interest and built engagement structure around it. | Strong candidate. Reference-check two to three current or recent clients before signing. |
| Specific on scope and benchmarks; vague on access and exit | The agency is good at selling the work and lock-in-aware on the commercial side. | Renegotiate access (Q7-Q9) and exit (Q11-Q12) terms before signing. If they will not, they have shown you who they are. |
| Vague on reporting (Q4-Q6) and benchmarks (Q10) | The agency does not have a clear commercial-outcome reporting practice. | The next twelve months will be activity-reported and structurally weak. Look elsewhere or commission a diagnostic first to scope exactly what needs fixing before any retainer. |
| Vague across most categories, confident in tone | Agency operates on confidence + sales ability rather than operational clarity. | Walk away. Confident vague is the most expensive answer pattern in agency selection. |
| No agency answers all 12 questions perfectly. The signal is the response pattern, not the perfection of any single answer. Specific-but-imperfect beats confident-vague every time. | ||
The diagnostic alternative
If the question is "what is wrong with my Shopify store before I sign another retainer," the answer is rarely a new retainer. It is a written diagnostic that names the structural failure, ranks it by revenue impact, and sequences the fix. That diagnostic is what the Conversion Second Opinion exists to deliver. $999, 72 hours, written, principal-led, one-time. No retainer structure. The fee is final on submission, before work begins.
The diagnostic is a different commercial instrument from a retainer. It tells you what is wrong. It does not maintain the account month over month. After the diagnostic, the buyer either implements the fix in-house, hires an agency with the diagnostic as the brief (which makes the 12 questions above radically easier to answer), or scopes a Revenue Sprint, Consulting tier, or Marketing System Build engagement based on what the diagnostic found.
For the deeper read on the structural reasons agency retainers underperform on Shopify and similar SMB-tier engagements, see why Sacramento marketing agencies burn through your budget. For the self-runnable structural audit before any agency conversation, see the 25-point Shopify audit checklist.
Common Questions
On record.
What is a red flag in the scope conversation?
Agency offering "comprehensive" or "full-service" without naming specific deliverables.
Should the agency have read-only or edit access?
Edit access only if the engagement includes execution. Audit or advisory engagements use read-only.
What reporting frequency is standard?
Monthly written. Weekly is often overkill; quarterly is often too little.
Do I own my campaigns if I leave?
Yes if accounts are in your name. Get accounts in your name before signing.
What notice period is reasonable?
30 days. Anything beyond 60 is excessive for most engagements.
The Engagement Format
Begin with the diagnosis. Not the proposal.
$999 · 72-hour written diagnostic · No retainer structure · fee is final on submission before work commences
Begin Revenue Sprint