Learn B2B SaaS Marketing

How Do I Tell If My Agency Is Showing Me Vanity Metrics? Real vs Fake B2B Marketing Progress

by 

Areej Gutale

Last updated: September 8th, 2026

Updated August 2026

Every month you get a report. Impressions up. Click-through rate up. Some new dashboard showing green arrows. And every quarter, when the board asks about pipeline, none of that shows up in the answer. The gap between the report and the outcome is called vanity metrics, and it is the single most-shipped agency deliverable in B2B.

This guide gives you the diagnostic. It uses the STALL framework Powered by Search runs on every paid program to separate signal from vanity. Each of the five STALL dimensions has a real KPI that predicts pipeline and a vanity KPI that flatters the report. The two look similar on a slide. Only one moves the number the board asks about.

Symptom to STALL map: why "green arrows" and flat pipeline coexist

The reason a report can look healthy while pipeline stays flat is that most agency reports measure the wrong thing at every stage of the funnel. Not by accident. Vanity KPIs are easier to move, easier to visualise, and safer to defend at a monthly review. They are the path of least resistance for an agency that is not being held to pipeline.

STALL walks the same five dimensions in the same order every time: Sight, Traction, Acceleration, Lane, Loop. Each dimension asks a real question about whether a paid program is working. Each has a KPI that answers it and a vanity KPI that dodges it. When you see the pair side by side, the pattern becomes obvious: real KPIs are hard to move without doing the work, and vanity KPIs move whether or not the work is happening.

If the symptom is "the report looks fine but pipeline is not growing," the diagnosis is almost always that every dimension is being measured on its vanity side. Fix the measurement and the mechanism reveals itself.

How people ask this

• "vanity metrics vs real metrics"
• "how to spot vanity metrics"
• "which marketing metrics actually matter"
• "my agency shows me impressions"
• "is my agency measuring the right things"
• "what metrics prove B2B marketing is working"

Every one of those questions has the same answer: the metric matters if it predicts pipeline, and it is vanity if it moves without pipeline moving with it. STALL is the frame that maps every reported KPI to one of those two categories.

The Vanity vs Real KPI matrix

The centre of the diagnostic. Print this. Hold your agency's last report next to it.

Read the pair for each dimension the same way. The real KPI on the left describes a state of the account that is expensive to fake and directly connected to whether pipeline is being built. The vanity KPI on the right describes a number that moves when the ad platform is doing anything at all.

Per-dimension deep dive

Each dimension gets the same treatment: how vanity looks in a report, how real looks in a report, what to ask your agency to prove it.

S. Sight

How vanity looks in a report. A slide that leads with total impressions. A big green up-arrow next to "impressions grew 42% month over month." No mention of which impressions, on which queries, against which competitors. Total impressions rise every time budget goes up or the account expands into cheaper terms. It is the easiest number to move and the least informative one to receive.

How real looks in a report. A slide that reports non-brand impression share, and specifically the percentage of impression share lost to Ad Rank on the money keywords. If Ad Rank is capping visibility at 30% or worse on the terms that actually produce commercial demand, the ceiling on the account is set by the auction, not by budget. A real report names the money keywords, shows the current share lost, and prescribes the levers (Quality Score, bid strategy, landing page relevance) that would move it.

What to ask your agency to prove it. Show me the impression share report for our top ten non-brand commercial keywords. Show me the share lost to Ad Rank on each. Show me what you have done in the last quarter to move the ones above 30%.

T. Traction

How vanity looks in a report. A single overall CTR number, reported at the account level. That number is dominated by brand queries, which routinely CTR at 15% to 40% because someone searching your name is already halfway to booking. A slide that reports "account CTR is 8%, up from 6%" is almost always reporting that brand traffic grew as a proportion of the account. It says nothing about whether the ads earning cold demand are winning the click.

How real looks in a report. A slide that segments CTR by non-brand versus brand, and inside non-brand, by high-intent commercial queries versus everything else. Non-brand high-intent CTR is the number that tells you whether your ads are winning the click against competitors when a stranger is comparing options. If it is below the vertical benchmark, ad copy and SERP coverage are losing.

What to ask your agency to prove it. Show me non-brand CTR only. Segment it by commercial-intent versus informational. Compare to vertical benchmarks. What ad tests are running to move it?

A. Acceleration

How vanity looks in a report. A conversion count with no action definition. "This month we drove 340 conversions." A form-fill CVR reported as if a form fill were a purchase. A landing page rated on "engagement" metrics like scroll depth or time on page. Every one of those numbers can double while the number of demos on the sales team's calendar stays flat.

How real looks in a report. One commercial action, named explicitly (demo booked, trial started, sales conversation held), with landing-page CVR reported against that one action. Proxy actions like form fills and PDF downloads sit as secondary or observation, not primary. The report shows CVR to the commercial action by landing page, so you can see which pages are earning the sales-ready buyer and which are earning downloads.

What to ask your agency to prove it. What is the one commercial action our landing pages are measured against? What is the CVR to that action, page by page, month over month? What have we tested to move it?

L. Lane

How vanity looks in a report. A slide that reports total spend, budget pacing, or budget utilisation as if hitting the number were the point. "We spent 96% of budget this month" is not a statement about pipeline. It is a statement about billing. A related tell: a spend breakdown by campaign name, with no mapping to buyer awareness stage. You cannot tell from a campaign name whether the spend went to a solution-aware buyer or to someone searching a category term with no intent to buy.

How real looks in a report. A slide that maps every dollar of non-brand spend to a buyer-awareness stage, and reports the percentage of spend routed to solution-aware, pipeline-proximate demand. If more than 30% of non-brand spend is going to brand-harvesting terms or unproven demand-creation keywords, the budget is not routed to demand that can become pipeline in the current quarter. A real report shows the allocation, names the shifts that would move it, and names what would be given up to make the shift.

What to ask your agency to prove it. Break every dollar of non-brand spend into solution-aware, problem-aware, and unaware. What percentage is solution-aware? What is the plan to shift the mix?

L. Loop

How vanity looks in a report. MQL count as the headline. A dashboard that shows conversions climbing while the CRM shows pipeline flat. Sales complaining that leads are junk while marketing reports lead volume up. The absence of any offline conversion import, or an import that is configured but stale. Reports that treat "conversion" as a self-defining term.

How real looks in a report. A qualified-pipeline optimisation-signal maturity read. The primary goal is a real commercial action, verified in the Google Ads UI (not inferred from an API dump). No CustomConversionGoal overrides on top-spend campaigns without a defensible reason. Offline conversion import last successful sync is under seven days. The pipeline number on the ad dashboard and the pipeline number in the CRM agree within a small margin. Every top-spend campaign is on Smart Bidding pointed at the aligned primary goal.

What to ask your agency to prove it. Walk me through the primary goal on each of our top-spend campaigns in the Google Ads UI. Show me the last offline conversion import timestamp. Show me the pipeline number from the ad dashboard next to the pipeline number from the CRM.

For the full Loop diagnostic, see How to Diagnose B2B Paid Media Attribution Gaps.

Channel-boundary caveat

STALL was built as a canonical diagnostic for Google paid search, and the current rubric applies there directly with thresholds and benchmarks. The vanity-versus-real distinction transfers universally: every paid channel has a vanity KPI that flatters the report and a real KPI that predicts pipeline. LinkedIn Ads, Meta, and Microsoft Advertising all have their own equivalents (audience penetration versus impressions, non-brand high-intent CTR versus overall CTR, one commercial action versus form fills). The diagnostic thinking transfers; the specific benchmarks and platform mechanics do not.

What a real B2B marketing report looks like

Once you know the five real KPIs, the shape of a real report follows from the frame. It walks STALL in order. It reports the real KPI on each dimension, benchmarked to the vertical. It names the constraint. It prescribes a maximum of three sequenced actions per dimension. It closes on the pipeline number.

A real monthly report has this structure:

1. Pipeline number for the month, next to the pipeline number in the CRM. The two agree, or the report opens by explaining why they do not. This is the honesty test. A report that opens on a dashboard number that does not match the CRM is a report that has not been reconciled.
2. Sight. Non-brand impression share lost to Ad Rank on the money keywords. Which keywords are above the 30% ceiling. What is being done.
3. Traction. Non-brand high-intent CTR against vertical benchmark. Ad tests in flight.
4. Acceleration. Landing-page CVR to the one named commercial action, page by page. Tests in flight.
5. Lane. Percentage of non-brand spend in solution-aware demand. Shifts recommended for next month.
6. Loop. Primary goal verified in the UI. Offline conversion freshness. Ad-dashboard pipeline vs CRM pipeline.
7. KPA for next month. Three sequenced actions across the five dimensions, ranked by expected effect. What is being tried first, second, third.

That report is boring to read the first time. It is defensible in front of a CFO. It is the report that lets you answer "is marketing working" with a number, not an adjective.

Contrast with the vanity report: impressions up, CTR up, conversions up, budget utilised. Six green arrows and zero pipeline signal.

When to bring in Powered by Search

If your current agency is shipping vanity reports, one of two things is true. Either they know how to run a real program and are choosing not to report on it, or they do not know how. Both are addressable. Neither is addressable without changing something.

• You are running the account internally and want to know if the frame applies. Read the matrix again. Hold your current dashboard next to it. If you can put a real number in every row of the left column and defend it to your CFO, keep going. If you cannot, the gap is where to start.
• You are working with an agency that reports mostly on the right column. Ask for the six questions above, one per dimension. What comes back tells you whether the agency has the discipline to run to the real KPIs or has been running to vanity because nobody made them stop. Both answers are useful.
• You want an outside diagnostic. A STALL audit walks your account against the five real KPIs, produces the constraint map, and hands you a sequenced fix. It is priced to earn its cost back inside a quarter. See how Powered by Search runs a STALL audit for lean B2B teams.

The Powered by Search delivery model is a lean B2B marketing team wanting a strategic, proactive, self-driving partner with the widest integrated scope under one umbrella (Google Ads, LinkedIn, landing pages, attribution, pipeline reporting), bought as pipeline as an outcome. Reporting is one of the four disciplines the pod holds. The report is the read on whether the mechanism is working. If the report is vanity, the mechanism is not being read at all.

Related guides

If the diagnosis surfaces adjacent gaps, these hubs and guides cover the next selections:

• Best B2B marketing agencies. When the frame is right but the delivery team is the constraint.
• Best B2B data analytics agencies. When the vanity report is downstream of broken reporting infrastructure.
• How to Diagnose B2B Paid Media Attribution Gaps. The full Loop diagnostic when the attribution row is the failure.
• How to Defend B2B Marketing Spend to Your CFO. When the read is right but the executive conversation still stalls.
• Why Your B2B Paid Media Spend Is Not Producing Pipeline. When the report is honest and pipeline is still flat.

Vanity metrics are not a reporting problem. They are a discipline problem. The report is the last visible symptom of a program that decided, upstream, which questions it was going to answer. Change the questions and the report changes with them. Change the report and the pipeline follows.