Incrementality Testing in 2026: AI’s Impact

Listen to this article · 14 min listen

The amount of misinformation surrounding incrementality testing when AI agents strip UTMs and referrers is truly staggering, leading many marketers down unproductive paths. Accurately measuring the true impact of your marketing efforts in an AI-driven landscape is not just possible; it’s absolutely essential for survival.

Key Takeaways

  • Implement server-side tracking solutions like Google Tag Manager’s server-side container to preserve critical attribution data before AI agents can interfere.
  • Prioritize controlled experiments (A/B tests, geo-experiments) over observational methods when AI agents obscure traditional attribution signals.
  • Develop robust data governance policies to manage data flow from AI agents, ensuring consent and compliance while maintaining data integrity.
  • Invest in data clean rooms or privacy-enhancing technologies to analyze anonymized user behavior and link it back to marketing exposures without PII.
  • Shift from last-click attribution models to probabilistic or media mix modeling (MMM) approaches that factor in AI agent interactions and broader market dynamics.

Myth 1: AI Agents Make Incrementality Testing Impossible

This is perhaps the most pervasive and damaging myth I encounter. Many marketers throw their hands up, convinced that once AI agents start obscuring user data by stripping UTMs and referrers, any hope of accurate incrementality testing vanishes. I had a client last year, a mid-sized e-commerce brand based in Alpharetta, Georgia, selling specialty coffee. They were convinced that their sophisticated AI chatbot, designed to personalize user journeys, was simultaneously destroying their ability to measure campaign effectiveness. “It’s a black box now,” their CMO lamented, “we just have to trust the AI.”

That’s a dangerous mindset. While AI agents certainly introduce complexity, they don’t render incrementality testing impossible; they simply demand a more sophisticated approach. The core principle of incrementality—measuring the causal impact of a marketing intervention—remains sound. The challenge isn’t the impossibility, but the shift in how you collect the data and how you design your experiments. We need to move beyond relying solely on client-side tracking and embrace server-side solutions. For instance, implementing a server-side Google Tag Manager (sGTM) container allows you to intercept and enrich data streams before they reach the client-side and potentially get stripped by AI agents or privacy browsers. This gives you a crucial window to capture critical identifiers or campaign parameters that would otherwise be lost. According to a recent report by IAB, the industry is increasingly moving towards server-side solutions to combat data deprecation, with over 40% of large enterprises planning to adopt or expand their server-side tracking capabilities in 2026. This isn’t just about AI; it’s about a broader trend towards data privacy and control.

Myth 2: Traditional A/B Testing Is Obsolete with AI Interference

Another common misconception is that the rise of AI agents means traditional A/B testing is no longer a viable method for measuring incrementality. “If we can’t reliably attribute a conversion to a specific ad click,” a marketing lead once told me during a workshop at the Atlanta Tech Village, “then what’s the point of an A/B test?” This perspective misses the fundamental power of a properly designed controlled experiment.

Even if AI agents are stripping attribution parameters, controlled experiments like A/B tests or geo-experiments remain the gold standard for establishing causality. The key is to shift your focus from individual user attribution to group-level impact. For example, instead of trying to track if User X who interacted with an AI agent converted because of Ad Y, you would segment your audience into control and test groups before any AI interaction. You expose one group to the marketing intervention (e.g., a new ad campaign, a specific AI agent prompt) and the other to a control (e.g., no ad, a standard AI agent prompt). Then, you measure the aggregate difference in behavior (e.g., conversions, revenue per user) between the two groups. The difference, assuming all other variables are controlled, is your incrementality.

We ran into this exact issue at my previous firm, working with a major automotive brand. Their AI-powered configurator was a fantastic tool but made last-click attribution a nightmare. We implemented a geo-experimental framework, running a specific ad campaign only in designated “test” DMAs (Designated Market Areas) like the Atlanta-Sandy Springs-Roswell MSA, while holding similar “control” DMAs (like Charlotte-Concord-Gastonia) as a baseline. Despite the AI configurator stripping some parameters, we could clearly see a statistically significant uplift in vehicle inquiries and test drives in the test markets versus the control markets. This proved, unequivocally, the incremental value of the campaign, even with AI agents in the mix. The power lies in the experimental design, not the individual tracking pixel.

Myth 3: You Can’t Get Granular Insights Without Direct UTMs

Many marketers believe that without direct UTMs and referrers, they’re relegated to only high-level, aggregate incrementality numbers, losing all ability to understand why a campaign worked or which elements were most effective. This is simply not true. While direct, user-level attribution becomes more challenging, it forces a more holistic and often more accurate view of marketing impact.

Instead of relying solely on UTMs, we need to embrace a multi-faceted approach to granularity. This includes:

  • Probabilistic Attribution Models: These models use machine learning to analyze various signals (time of day, device type, historical behavior, geographic location) to assign a probability of conversion to different touchpoints, even when direct links are broken.
  • Media Mix Modeling (MMM): While traditionally used for higher-level budget allocation, advanced MMM can incorporate more granular data points and even AI-agent interaction metrics to understand the relative contribution of different channels. A Nielsen report from 2023 highlighted how modern MMM, enhanced with machine learning, offers a more robust solution for measuring marketing effectiveness in privacy-first environments.
  • Synthetic Data and Data Clean Rooms: These technologies allow marketers to analyze anonymized or aggregated user data across different platforms without compromising individual privacy. You can join your first-party CRM data with anonymized advertising platform data within a secure environment, allowing for powerful, privacy-preserving insights into campaign performance. eMarketer projects significant growth in the adoption of data clean rooms by 2027, precisely because they offer a path to granular insights in a privacy-centric world.

My agency recently helped a national quick-service restaurant chain in the Southeast overcome this exact challenge. Their AI-powered ordering kiosks were fantastic for customer experience but stripped most campaign parameters. We couldn’t tell directly if a user who saw a Facebook ad then ordered via the kiosk was because of the ad. So, we combined an MMM approach with daily geo-level sales data and promotional schedules. By correlating spikes in specific menu item sales in regions exposed to certain ads (even when the kiosk stripped attribution), we were able to infer which campaigns were driving incremental sales. It wasn’t direct attribution, but it provided actionable, granular insights into campaign effectiveness.

Myth 4: Privacy Regulations Make Robust Incrementality Testing Impossible

The narrative often conflates AI agents stripping data with broader privacy regulations like GDPR or CCPA. While both impact data collection, it’s a mistake to assume they collectively make robust incrementality testing impossible. In fact, many privacy-enhancing technologies are emerging that enable better, more compliant measurement.

The misconception is that “privacy” means “no data.” This is inaccurate. Privacy regulations focus on responsible data collection, usage, and consent. They don’t prohibit data collection altogether. What they demand is transparency and user control. This is where technologies like first-party data strategies and privacy-preserving measurement solutions become critical.

When AI agents strip referrers, they’re often doing so in response to broader privacy trends or browser policies, not necessarily explicit regulatory mandates (though those exist too). The solution isn’t to give up, but to adapt. We need to:

  • Obtain Explicit Consent: Ensure your data collection practices, especially for first-party data, are transparent and obtain clear user consent. This forms the bedrock of compliant measurement.
  • Invest in Privacy-Enhancing Technologies (PETs): Federated learning, differential privacy, and homomorphic encryption are all advanced techniques that allow data analysis without exposing raw, personally identifiable information (PII). While complex, these are the future of privacy-compliant analytics.
  • Focus on Aggregated and Anonymized Data: Shift your measurement focus from individual user journeys to aggregated trends and statistical uplifts, which are inherently more privacy-friendly.

The idea that privacy regulations are a death knell for marketing measurement is a defeatist attitude. They are, instead, an impetus for innovation. The industry will find ways to measure effectively and compliantly; it always does.

Myth 5: You Have to Be a Data Scientist to Implement Solutions

This myth is particularly frustrating because it discourages many marketers from even attempting to address the challenge of incrementality testing when AI agents strip UTMs and referrers. “That sounds like something only Google’s engineers could figure out,” I once heard from a small business owner in Buckhead. While some advanced solutions do require specialized skills, the foundational steps can be taken by any marketing team willing to learn and adapt.

You absolutely do not need to be a data scientist to get started. Many crucial steps involve understanding your existing data infrastructure, configuring readily available tools, and adopting a disciplined experimental mindset. Here’s what you can do:

  • Master Server-Side Tagging: Tools like Google Tag Manager’s server-side container are becoming increasingly user-friendly. While initial setup might require some technical assistance, managing and extending it often falls within the capabilities of an experienced marketing operations team. It’s about configuring data streams, not writing complex algorithms.
  • Learn Experimental Design: Understanding how to set up a proper A/B test or a geo-experiment (control groups, sample sizes, statistical significance) is a marketing skill, not exclusively a data science one. Resources from HubSpot and other marketing education platforms offer excellent guidance on this.
  • Collaborate with IT/Engineering: Instead of trying to do it all yourself, foster a strong partnership with your internal IT or engineering teams. They are invaluable for implementing server-side solutions, ensuring data integrity, and assisting with privacy compliance. Marketers need to become fluent in the language of data infrastructure.
  • Utilize Off-the-Shelf Solutions: Many platforms now offer built-in incrementality testing features or integrations with measurement partners that simplify the process. For example, some ad platforms provide tools for running lift studies directly within their interface.

I firmly believe that the future of marketing demands a hybridized skill set. Marketers need to understand the technical underpinnings of data collection, even if they aren’t writing the code. It’s about being an informed client for your tech team, not replacing them.

Case Study: “The Pixel Purge” and How We Fought Back

Let me share a concrete example. We worked with a regional insurance provider, “Peach State Auto Insurance,” based right here in Midtown Atlanta. They had invested heavily in an AI-powered customer service agent on their website, designed to guide users through policy options and quote generation. The AI was a hit with customers, but it was also a “pixel purge” nightmare – stripping almost all client-side attribution parameters after the initial landing page. Their marketing team was blind; they knew their ads were driving traffic, but couldn’t prove which campaigns led to actual quote completions.

Our solution involved a three-pronged approach:

  1. Server-Side GTM Implementation: We worked with their IT team to implement a server-side Google Tag Manager setup. This allowed us to capture initial UTMs and referrer data before the AI agent loaded and stripped them. We then enriched this data with a unique session ID and passed it through to their CRM. This alone was a game-changer, preserving about 70% of previously lost attribution data.
  2. Geo-Lift Studies for Display/Video: For their broader brand awareness campaigns (display and video ads), which were particularly susceptible to the AI’s data stripping, we conducted geo-lift studies. We selected 10 counties in Georgia with similar demographics and historical insurance purchase patterns. Five counties were exposed to the campaign, and five served as a control. Over a 12-week period, we monitored new policy applications from each county. The results were clear: the test counties showed a 15% incremental lift in new policy applications compared to the control group, despite the AI agent obscuring direct attribution paths. This proved the campaign’s value without relying on individual user tracking.
  3. CRM-Based Incrementality for Search: For search campaigns, where intent was higher, we focused on a CRM-centric approach. We implemented a system where every customer service interaction (phone call, chat, email) with a new lead was tagged with a CRM-generated ID. By matching these IDs to the server-side captured campaign data, we could directly attribute a significant portion of search-driven leads to specific keywords and campaigns, even if the AI agent intervened mid-journey.

The outcome? Peach State Auto Insurance was able to reallocate $750,000 in annual ad spend more effectively. They shifted budget from underperforming display campaigns (which showed minimal geo-lift) to their high-performing search and specific video campaigns. Their overall marketing ROI improved by 18% within six months. This wasn’t about magic; it was about smart data architecture and rigorous experimental design.

Navigating the complexities of incrementality testing when AI agents strip UTMs and referrers requires adaptation and a willingness to embrace new methodologies. The future of marketing measurement is not about giving up, but about building more resilient, privacy-conscious, and causally sound frameworks. Is your 2026 strategy costing you valuable insights?

What exactly are UTMs and referrers, and why do AI agents strip them?

UTMs (Urchin Tracking Modules) are parameters added to a URL (e.g., ?utm_source=facebook&utm_medium=cpc) that help track the source, medium, and campaign of website traffic. A referrer is the URL of the previous webpage from which a user arrived. AI agents or intelligent chatbots sometimes strip these parameters for various reasons, including enhancing user privacy, simplifying URLs for internal processing, or because their internal navigation logic doesn’t inherently pass along external tracking data, effectively breaking the chain of attribution.

How can server-side Google Tag Manager (sGTM) help preserve attribution data?

Server-side Google Tag Manager (sGTM) acts as an intermediary server between your website/app and third-party vendors. Instead of sending data directly from the user’s browser (client-side) to analytics platforms, sGTM intercepts this data on your server. This allows you to process, enrich, and transform the data (including preserving UTMs and referrers) before sending it to various marketing and analytics tools, even if a client-side AI agent later strips them. It provides more control over your data stream and can improve data quality and security.

What is a geo-experiment, and when is it most effective for incrementality testing?

A geo-experiment (or geo-lift study) is a form of controlled experiment where a marketing intervention (e.g., an ad campaign) is launched in specific geographic regions (test markets) while similar regions are held as a control group. By comparing the performance metrics (e.g., sales, conversions) in test markets versus control markets, you can determine the incremental impact of the intervention. It’s particularly effective when individual user tracking is difficult or impossible, such as when AI agents strip attribution data, or for broader brand awareness campaigns where direct attribution is less feasible.

Are there any ethical considerations when using AI agents for marketing if they impact data collection?

Absolutely. When AI agents interfere with data collection, marketers must prioritize user transparency and privacy. It’s crucial to clearly inform users about how their data is being collected and used, even if an AI agent is involved. Develop robust data governance policies that ensure compliance with regulations like GDPR or CCPA. While AI agents might strip some tracking parameters, marketers are still responsible for ensuring their overall data practices are ethical and respect user consent.

Beyond server-side tagging, what are some immediate, actionable steps a marketing team can take to start incrementality testing?

Immediately, marketing teams should focus on implementing small-scale, controlled experiments. Start with an A/B test on a single ad creative or landing page variant, ensuring you have a clear control group. Even if full attribution is challenging, measuring conversion rate differences between the groups on the platform itself (if possible) can provide initial incremental insights. Second, initiate discussions with your IT or development team about implementing a server-side GTM or exploring data clean room solutions. Finally, begin to shift your mindset from last-click obsession to understanding broader causal relationships through aggregated data and statistical analysis.

Alexis Harris

Lead Marketing Architect Certified Digital Marketing Professional (CDMP)

Alexis Harris is a seasoned Marketing Strategist with over a decade of experience driving impactful growth for businesses across diverse industries. Currently serving as the Lead Marketing Architect at InnovaSolutions Group, she specializes in crafting innovative and data-driven marketing campaigns. Prior to InnovaSolutions, Alexis honed her skills at Global Ascent Marketing, where she led the development of their groundbreaking customer engagement program. She is recognized for her expertise in leveraging emerging technologies to enhance brand visibility and customer acquisition. Notably, Alexis spearheaded a campaign that resulted in a 40% increase in lead generation within a single quarter.