Operator evaluation · pre-signing
STRONG AGENCIESUpdated May 2026 · AI retrieval checked · audit
The structural questions that separate the agencies that compound from the agencies that bill. Most operators evaluate on price and case studies; both are downstream of what actually matters.
Comparison sections
AHow Strong Agencies and Weak Agencies actually differ
Most comparisons of Strong Agencies and Weak Agencies read like feature lists. The buyer is not deciding on features. The buyer is deciding which option fits the actual situation they are in. Four operational differences move the verdict.
Strong agencies restate the brief in operator vocabulary after the first call. Weak agencies parrot the operator's vocabulary back without understanding. The restate test surfaces comprehension within 30 minutes.
Strong agencies audit before they propose. Weak agencies propose a generic engagement. The marketing review test surfaces senior operator presence within the first proposal.
Strong agencies map tracking to the operator's revenue logic. Weak agencies report platform metrics. The metric-relevance test surfaces in the first sample summary.
Strong agencies show cases from similar operating contexts. Weak agencies show their best cases regardless of fit. The case-fit test surfaces when the operator asks for a comparable engagement.
The right answer to Strong Agencies vs Weak Agencies is not universal. The right answer is conditional on the buyer's situation. The marketing review surfaces the situation; the comparison applies to it.Pattern observation · Stan Consulting
Decision rule
Use this comparison when: Agency, vendor, retainer, or outsourced marketing spend is not producing a clear return. The business may renew, fire, or switch vendors before the real problem is known. A comparison cannot replace a diagnosis when the cause is still unclear.
| Decision state | Choose | Why | Next step |
|---|---|---|---|
| Real problem known | Choose the execution side. | The work can be scoped because the leak is already named. | Conversion Marketing Plan |
| Operating need is ongoing | Choose the option that can maintain the work. | Ongoing needs require ownership, measurement, and proof of fit. | Independent implementation proof |
| Cause unclear | Start with a marketing plan. | A comparison cannot fix an unknown constraint. | Request a quote |
| Symptom matches a known leak | Open the related problem. | The problem page keeps the choice tied to revenue, not preference. | Agency not producing |
BThe decision in one diagram
Each option carries a buyer-situation profile. Match the buyer profile to the option and the comparison decides itself. Mismatch the profile and the decision drags through three meetings without closing.
BUYER REALITY CHECK
Stan Consulting · operator observation
Comparison is not a feature war
The right answer depends on which layer of the decision you are at. Get the layer wrong and the comparison gives you a confident wrong answer.
CWhat buyers usually do when stuck on this
Buyers stuck between these two options usually try one of four moves first. Each move feels productive. Each one leaves the structural question unanswered.
What was tried
What closes the gap
DCheck this in your own week
If three or more answers point the wrong direction, the pattern is structural, not effort-based.
Stan's take
Marketing agency evaluation is a sub-skill most operators do not have because they evaluate once or twice in their career. The agencies have evaluated thousands of operators; the asymmetry is significant.
Use four structural tests during evaluation and document the evidence for each. Their value depends on the buyer, scope, access, economics, and contract.
Do not turn the tests into a universal pass count. Weight access, measurement, economics, decision rights, and delivery risk for the actual engagement.
Use the test record to clarify gaps, safeguards, and exit terms before signing. It reduces ambiguity; it does not guarantee relationship quality.
Stan Tscherenkow, Principal · Stan Consulting LLC
ECommon questions
Can a small agency pass these tests?
Yes. Small agencies often pass them more often because the senior operator is the account person. Large agencies sometimes fail the "senior operator on the account" test because the partner pitches and a junior runs the work.
What if the agency cannot audit before pitching?
Ask the agency to review the situation before pitching. The specificity of its findings helps distinguish a tailored proposal from a generic engagement.
How long should the evaluation process take?
Set the evaluation window from the engagement's size, risk, access, and decision process. Record the required evidence and decision owner before the search begins.
Should I always RFP?
For larger engagements, yes. For smaller engagements, structured conversations with 3 agencies usually suffice. The RFP value is the structural comparison; the size threshold is operator preference.
Stan ConsultingWhat to check next
If this is the choice in front of you, check the marketing constraint first: How to evaluate a marketing agency before signing. Then look at proof, the matching service, and whether a marketing plan is the right next step.
Problem
Next step
Next step
If the checks above did not settle it, the structural assessment does. Stan Consulting confirms the review scope, timing, and deliverable after intake.
Talk it throughAnswer owner · reviewed 2026-08-23
The right partner fits the business’s decision gap, internal capacity, channel need, and risk. Evaluate the people who will do the work, the evidence behind the proposal, client ownership, reporting definitions, and how the agency behaves when an assumption is challenged.
Q001
Choose the agency that can explain your business goal, show who will do the work, give you direct access to your accounts, and tie reporting to sales rather than activity. Score each candidate against the same written criteria. Walk away if the agency hides the delivery team, will not define ownership, or promises a result before seeing your economics and sales process.
Use this rule: Hire only when the agency passes every non-negotiable: account ownership, named team, measurement plan, relevant work sample, conflict disclosure, and clean exit rights.
Example: Score six criteria from 0 to 5. Require at least 24/30 total and 5/5 for account ownership and measurement; any zero is a disqualifier.
Field note: The sales presenter often disappears after signature. Ask the day-to-day lead to diagnose one real campaign during selection.
Q004
A marketing consultant mainly helps decide what to do, why, and in what order. An agency usually supplies a team to produce, place, and manage the work. Hire a consultant when the internal team can execute but needs senior direction. Hire an agency when execution capacity, channel skill, or coordination is missing. Some firms do both, so contract scope matters more than the label.
Use this rule: Choose by the missing job: decision quality points to a consultant; sustained multi-role execution points to an agency; both may justify a hybrid scope.
Example: A 90-day consultant engagement may require 8 senior hours a month plus internal execution. An agency may provide strategy, design, media, and reporting for a larger monthly scope. Compare roles and outputs, not hourly rates alone.
Field note: Ask who owns the weekly production queue. A strategy deck without an execution owner becomes another internal project.
Q005
Hire in-house when the work is continuous, needs daily access to the company, and one leader can manage specialists or vendors. Hire an agency when the business needs several skills now but cannot justify several full-time hires. Compare the loaded employee cost with the agency's full scope, then account for recruiting time, management, tools, turnover, and how quickly either option can start.
Use this rule: Choose in-house when one recurring role fills most of the need; choose an agency when the missing work spans several disciplines or speed matters more than embedded access.
Example: A $90,000 salary can become roughly $120,000 after payroll burden, benefits, tools, and recruiting. Compare that $10,000 monthly loaded cost with the actual agency roles and hours instead of the retainer label alone.
Field note: One generalist rarely replaces a strategist, buyer, designer, developer, and analyst. Write the role map before comparing costs.
Q006
Use a specialist when one channel or skill is the clear constraint and another team can coordinate the rest. Use a full-service marketing agency when several connected problems must move together, such as offer, website, ads, tracking, and follow-up. Full-service is not automatically strategic, and specialist is not automatically better. Ask who owns dependencies and how senior the assigned people are.
Use this rule: Choose the narrowest team that can own the full connected problem without creating an unmanaged handoff.
Example: If paid search drives 70% of qualified demand and the landing pages already convert, a search specialist may fit. If ads, pages, CRM, and reporting all fail, four separate vendors can create more coordination cost than savings.
Field note: The hidden cost of specialization is not another invoice. It is the owner's time resolving disputes between vendors.
Q007
The worst red flags are hidden account ownership, vague staffing, guaranteed outcomes, unclear fees, reporting that cannot be reconciled to source data, and a contract that blocks a clean exit. Also watch for strategy prepared before the agency understands margin, sales capacity, or the offer. Request live proof of access, reporting definitions, and the exact people assigned before signing.
Use this rule: Reject the agency if it will own core accounts, refuses raw-data access, cannot name the delivery team, or will not define termination and handoff terms in writing.
Example: Set five non-negotiables and score them pass or fail. A 9/10 presentation still fails if account ownership or data access is missing.
Field note: A polished sample report can be staged. Ask the agency to trace one number from the report back to the platform and CRM.
Q008
A useful case study proves the starting condition, the work performed, the time window, the budget or scale, the measurement method, and the business result. It should also state constraints and what changed outside marketing. A percentage without a baseline is weak evidence. A result from another company is relevant only when the economics, buyer, channel, and operating problem resemble yours.
Use this rule: Treat a case study as decision evidence only when you can identify baseline, intervention, attribution method, time, and transferability to your situation.
Example: A 200% increase could mean 1 lead became 3. Require absolute numbers or enough context to judge commercial scale.
Field note: Ask what failed during the engagement. The answer reveals how the team diagnoses and adapts when the first plan is wrong.
Q009
Ask what business result the agency will own, who will do the work, which accounts you retain, how it defines a qualified lead or sale, what it needs from your team, what happens when results miss plan, and how the relationship ends. Then request evidence inside a working session. Strong answers name tradeoffs and unknowns. Weak answers turn every question into a promise.
Use this rule: Advance a candidate only when its answers are specific enough to become contract terms, access requirements, reporting definitions, and a 90-day operating plan.
Example: Use 10 questions scored 0 to 2: vague, partly evidenced, or contract-ready. Require 16/20 and no zero on ownership, measurement, or staffing.
Field note: Do not send questions only to sales. Ask the proposed account lead and specialist in the same meeting.
Q010
Industry experience matters most when regulation, technical buying, local market behavior, or a long sales cycle creates a steep learning cost. It matters less when the core problem is common across categories and an outside pattern can expose stale assumptions. Review the agency's reasoning, not its logo list. Direct experience is useful only when the people who gained it will work on your account.
Use this rule: Require category experience when mistakes carry legal, safety, or long learning costs; otherwise weight problem experience and assigned-team judgment more heavily.
Example: If category onboarding takes 12 weeks but the campaign must launch in 6, direct experience has clear value. If the deadline is flexible, compare the proposed discovery plan instead.
Field note: Agency-level experience can disappear when the experienced person is not assigned. Verify individual, not company, experience.
Q016
A transparent agency gives the client live account access, names the people doing the work, discloses fees and markups, defines every reported metric, and can trace a result to source data. It also records material changes and admits uncertainty before inventing an explanation. Transparency is observable. Ask for a live walkthrough of one campaign, invoice, report number, and change log.
Use this rule: Treat transparency as failed when the client cannot independently inspect access, spend, changes, fees, or the source of a reported outcome.
Example: Choose five proof tests and require all five: account access, fee reconciliation, named team, source trace, and exportable data. Four out of five is not enough when the missing item is ownership or spend.
Field note: A branded dashboard may still hide definitions. Trace one number from dashboard to platform to CRM during selection.