Most agency selection processes are run by marketing teams, evaluated on marketing criteria, and presented to the C-suite as a completed recommendation. The chosen agency then operates for two or three years before leadership notices the relationship is not delivering what the business needs, by which point switching costs are high, institutional knowledge has transferred to an external team, and the reasons it went wrong were visible in the pitch process to anyone who knew what to look for.

The pattern is well documented. 48% of clients end agency relationships due to dissatisfaction with delivery, yet agencies rank delivery issues seventh on their own list of reasons clients leave. That perception gap does not emerge at the end of a relationship. It develops across months of operational reality that the pitch process was not designed to surface.

C-suite involvement in agency selection does not mean executives reviewing pitch decks. It means setting the evaluation criteria before agencies are briefed, so that what gets assessed reflects business priorities rather than marketing team familiarity. The agency that wins on marketing criteria and the agency that wins on C-suite criteria are not always the same one. This framework is designed to close that gap.

Why Many Agency Pitches Can Be Designed to Show You the Wrong Things

A pitch is a sales process. The agency controls the narrative, selects the case studies, and answers the questions it prepared for. What it is not designed to reveal is the commercial incentives driving its recommendations, the gap between the senior team presenting and the junior team delivering, or whether its measurement approach will hold up when the business needs to justify marketing investment to a board.

The most consequential information rarely surfaces in a pitch because clients do not know to ask for it. Whether the agency acts as a principal in media buying, purchasing inventory with its own funds and reselling it with a margin, is a structural conflict of interest that changes every recommendation the agency makes about where to spend. Whether AI-driven efficiency gains are being passed through to clients in pricing or retained as margin is a question that becomes more important as AI reduces delivery costs across the industry. Whether the account team presenting is the same team that will manage the campaigns is a question so basic that most clients feel awkward asking it, and agencies know that.

Fee transparency is one of the clearest early signals of how an agency will behave throughout the relationship. According to the 4As 2024 Compensation Methodologies Survey, 87% of marketers say agencies resist transparent fee models, while 72% of agencies still use fixed-fee retainers as their primary commercial structure. A retainer that does not reflect the efficiency gains AI is delivering to agency operations is quietly extracting margin from clients. Asking how the agency's pricing has changed in the past year as a result of AI adoption is a more revealing question than discussing scope.

The in-housing trend reflects exactly the frustration these dynamics create. When brands move media buying and content production in-house, cost efficiency is the most commonly cited driver, but the underlying cause is typically a loss of confidence that the agency relationship is structured around client outcomes. Understanding the commercial mechanics before signing is more effective than discovering them mid-contract.

Relevant Guide: How to Write a Winning RFP and Choose the Right Agency Partner

The Measurement Gap that Agency Relationships Can Easily Miss

The most important and least examined dimension of agency evaluation is how the agency connects what it does to what the business actually earns. This matters more than channel expertise, more than technology stack, and more than case study credentials, because an agency that cannot link its activity to revenue outcomes cannot be managed toward them, and cannot be held accountable when they do not materialize.

An agency whose reporting stays inside platform dashboards is reporting on activity: impressions, clicks, platform ROAS, cost per acquisition. These metrics are useful for campaign management but they do not answer the questions that matter to a CFO or CEO. What did this investment actually contribute to revenue? How did blended customer acquisition cost move over 12 months? Where are we acquiring customers whose lifetime value justifies the cost, and where are we not?

The scale of the measurement credibility problem is significant. 85% of marketers say they are confident they can measure holistic ROI, yet only 32% actually do, according to Nielsen's 2025 Annual Marketing Report. For C-suite leaders, that gap means an agency claiming measurement capability is more likely to mean platform-level reporting than genuine business outcome attribution. Asking an agency to walk through their measurement framework for an existing client, in detail, with actual numbers, is the fastest way to determine which side of that gap they sit on.

The same scrutiny applies to attribution. When platform-reported ROAS and the client's CRM or finance data disagree, which number does the agency defend, and how? An agency that has a clear, practiced answer to this question has encountered it in real client relationships and built a process around it. An agency that has not encountered it, or deflects it, is telling you something about how they handle inconvenient performance data.

The business case for getting this right extends beyond any single campaign. Google and WARC's Effectiveness Equation found that short-term profit ROI averages 1.87 pounds per pound spent, while measured across sustained effects the same investment returns 4.11 pounds. The gap between those two figures represents the value that single-period, platform-level attribution systematically fails to capture. An agency whose measurement approach cannot see that gap cannot help a business capture it.

While measurement framework is crucial, the real test isn't whether an agency has one that suits your standards. It's whether they can walk you through a real client, with real numbers, showing how activity connected to revenue. Anything less is platform reporting dressed up as attribution.

Amy P. Tran, Sr. Director of Growth, Crealytics

Six Criteria for Evaluating a Performance Marketing Agency Before Signing a Retainer

How the agency connects media activity to business revenue

Ask for a specific example of how they moved a client's blended customer acquisition cost over 12 months, and what measurement approach made that visible. If the answer stays inside platform metrics, accountability does too.

Fee structure and AI-driven pricing transparency

Ask how their delivery costs have changed as AI adoption has reduced manual work, and whether that is reflected in client pricing. Ask what triggers a fee renegotiation. Agencies that cannot answer clearly are not structured around client value.

Media buying model and commercial incentives

Ask directly whether they act as a principal in any channels, what the margin structure is, and whether they have preferred vendor relationships that influence spend recommendations. These questions should be answered before scope is agreed, not after.

The team that pitches versus the team that delivers

Ask to meet the account team that will manage campaigns day to day. Ask what happens to account continuity if a key person leaves. The gap between pitch team and delivery team is one of the most consistent sources of agency disappointment.

How the agency handles campaign underperformance when results miss target

Ask for a case study where a campaign did not work, and what the agency did about it. The answer reveals whether they have a process for flagging and diagnosing problems, or whether they optimize reporting when results are inconvenient.

A defined pilot before a long-term commitment

Retainer clients stay an average of 56 months, while project clients stay 24 months, with the first 90 days representing peak churn risk, according to a 2026 churn analysis. Before committing to a long-term retainer, both parties should agree on a defined pilot period with clear KPIs, a transparent fee structure, and an evaluation framework that accounts for external factors including seasonality, economic conditions, and market-specific context. The goal is a timeline long enough to generate real signal, structured fairly enough that the agency can be held to it, and agreed in advance so neither party is interpreting results through a lens that suits them. Agencies confident in their delivery will engage with that conversation constructively.

Key Takeaways

· Most agency relationships fail not because agencies lack capability, but because the selection process evaluates presentation rather than delivery. The right questions have to be asked before the contract is signed.

· The variables that most determine agency value over time, revenue accountability, fee transparency, and media buying model, are almost never raised in a standard pitch. They have to be asked directly.

· A pilot period before any long-term commitment is the most practical protection available. Agencies confident in their delivery will accept it.

---

Planning an incrementality test for your performance marketing campaigns? Reach out to us.

Relevant Insights  

· Talk: Let’s Talk Onboarding: How Do You Lay the Groundwork for Real Performance, Not Just Fast Campaign Launches?

· Article: Q&A: How Does Incrementality Shape Budget Allocation Across Channels?

· Article: What Brand Signals Now Drive Paid Media Efficiency

About Crealytics

Crealytics is an award-winning full-funnel digital marketing agency fueling the profitable growth of over 100 well-known B2C and B2B businesses, including ASOS, The Hut Group, Staples and Urban Outfitters. A global company with an inclusive team of 100+ international employees, we operate from our hubs in Berlin, New York, Chicago, London, and Mumbai.