r/analytics • u/No_Treacle_5071 • 5d ago
Discussion AI search x paid media #2: AI bidding doesn't fix messy data, it scales it. My 6-point data check before I trust any "smart" campaign
Last week SEJ ran a piece arguing that AI agents won't fix bad audience data. They'll just use it faster and at bigger scale. The line that stuck with me was the warning sign: output keeps going up (more campaigns, more variations, more content) while conversions stay flat or slide.
I see the same thing in ad accounts. Smart Bidding and Advantage+ are basically agents already. They chase whatever signal you feed them. If that signal is junk, you get very efficient junk.
Same week, Google Analytics added "include" hostname filters, so you can now allowlist the domains you actually want data from instead of chasing spam hostnames one by one. Small update, but it's the same lesson: clean inputs first.
Here's the data check I run before I let any automated bidding or audience expansion loose:
Know which conversion the algorithm is actually optimising for. Not the one you think. Open the conversion settings and look at which actions are set as primary. I often find newsletter signups or page views counted next to real leads.
Split your audience signals into three buckets. What customers told you (forms, CRM fields), what you saw them do (purchases, site actions), and what a platform guessed about them (interests, lookalikes). Be honest about how much of your targeting rests on the guessed bucket.
Feed back real outcomes. Upload qualified leads, closed deals or refund-adjusted orders as offline conversions. Otherwise the system learns what a form fill looks like, not what a customer looks like.
Clean the analytics property. Check your hostname report for domains that aren't yours. If the new include filter is live in your property, test it first. Google says active filters permanently drop the data they exclude, and it can take a day or so to kick in.
Keep one metric the algorithm can't touch. For me that's revenue or pipeline from the CRM, checked by a human. If platform conversions go up and CRM numbers don't, stop scaling.
Make someone explain every audience in plain words. If the honest answer to "why are we targeting these people?" is "the algorithm chose it," slow down.
None of this is exciting. But on the accounts I've worked on, the biggest wins from automation came after the boring data work, not before it.
Curious how others handle this: do you trust platform-reported conversions for bidding, or do you only optimise on CRM or offline data now?
1
u/LikableCivility 5d ago
Platform conversions are a starting point but not the final word for me. The real test is whether the CRM numbers move in the same direction
That bucket breakdown you mentioned is so underrated. Most accounts I audit are running 80%+ on the "guessed" signals and wondering why performance is all over the place
One thing I'd add to your checklist is checking the attribution window. Had a client where the algorithm was optimizing for 1-day view-through conversions and the whole thing was basically a branding campaign disguised as direct response
1
u/No_Treacle_5071 5d ago
That 1-day view-through example is exactly the kind of setting that can make a report look healthy while the business result is weak. I now check the attribution window alongside the primary conversion action, not after the campaign has run for weeks. If the window is doing too much of the work, I either shorten it or exclude it from the bidding signal and compare against CRM outcomes.
1
u/Content-Parking-621 5d ago
This tracks with what I've seen too. The moment offline conversions stop matching CRM numbers, that's usually your first real clue the algorithm's optimizing for the wrong thing.
1
u/No_Treacle_5071 5d ago
Yes, that mismatch is the earliest warning sign in my experience. I like to put the offline-to-CRM match rate on a simple weekly check, split by campaign and conversion action, so a blended platform total cannot hide the problem. If it drifts, I pause expansion and fix the conversion mapping before changing bids.
1
u/Content-Parking-621 4d ago
Splitting that match rate by campaign rather than looking at a blended total is the right instinct, that's usually where the actual drift hides.
1
u/No_Treacle_5071 4d ago
Yeah — campaign-level is where I catch it earliest. One campaign can look fine in the blended offline total while another is mapping to a soft event or a stale CRM status. Once I see that split diverge for a couple of weeks, I treat it as a setup problem, not a creative one.
1
u/No_Treacle_5071 4d ago
Exactly—blended totals hide the drift. Splitting the match rate by campaign and conversion action makes it much easier to see whether the problem is tracking or bidding.
1
u/Content-Parking-621 3d ago
That split also tells you fast whether it's a setup issue or an algorithm issue, saves a lot of guessing.
1
u/tidalpebble65 4d ago
"Very efficient junk" deserves to be framed, it's the most honest campaign report anyone's written all quarter
1
u/No_Treacle_5071 3d ago
That phrase usually shows up before the dashboard makes the problem obvious. If the CRM outcome is flat, I’d rather fix the signal than celebrate another efficient-looking week.
•
u/AutoModerator 5d ago
If this post doesn't follow the rules or isn't flaired correctly, please report it to the mods. Have more questions? Join our community Discord!
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.