MVT Campaigns analytics

MVT Campaigns analytics provides actionable insights to help you understand and optimize the performance of your multivariate testing (MVT) campaigns.

This analytics tool enables you to filter and explore campaign data across multiple dimensions. You can easily identify which factors drive success or contribute to underperformance, helping you make informed decisions and refine your strategies.

Use MVT Campaigns Analytics to:

• Gain a clear view of campaign performance across variations and dimensions.
• Pinpoint the key drivers of positive results.
• Diagnose underperforming elements to improve future outcomes.

Access MVT Campaigns analytics

To access the analytics, navigate to Analyze > MVT Campaigns.

Available modes

A Mode Selector, located at the top left above the chart area, allows you to switch seamlessly between two analysis modes:

• Routing: View the performance of all MVT Campaign routings—whether or not a test is actively running. This mode enables you to analyze how different routing strategies are impacting key performance metrics such as revenue, conversion rate, and average order value across customer segments and dimensions.

• Tests: Focus specifically on the results of MVT Tests—comparing Control Candidates to Test Candidates within a consistent Test Audience. This mode highlights how different checkout variants perform under controlled testing conditions, allowing you to validate hypotheses and make data-driven optimization decisions.

Routing mode

When the Routing mode is selected, the MVT Campaign Analytics report provides a comprehensive view of how your MVT Campaigns perform under your configured routing rules.

The Routing view consists of two main components:

• An interactive Performance Chart, which can be configured to display either:
  • Top Performing Campaigns over time, based on key performance metrics, or
  • Top Performing Audience Regions over time, enabling geographic trend analysis.
    
    
• A detailed Candidate Performance Breakdown Table, which provides granular performance data for each candidate across your MVT Campaigns. This table supports advanced filtering, column customization, and export to Excel for further analysis.

Together, these components help you understand both broad patterns and deep details of your MVT Campaign performance under live routing conditions.

Performance chart

The Performance chart offers a high-level visual overview of your MVT Campaign performance, helping you quickly spot trends, compare key metrics, and identify areas for further analysis.

The default view displays the Top 5 MVT Campaigns (if available), ranked by total Net Revenue for the selected period, with performance trends visualized over time.

Use this view to quickly identify which MVT Campaigns are driving the most revenue during the selected period.

Performance chart settings

The Performance chart offers flexible options to tailor your analysis and explore MVT Campaign results from different perspectives. You can adjust both the chart representation and the metric used to define top performance, allowing you to focus on the insights most relevant to your business goals.

• Chart Representation: While the default view shows top performing MVT campaigns, you can switch the chart representation to Audience Regions to see which audience regions (as defined in your Audience Settings) have performed the best during the selected period aggregated across all campaigns and candidates.

• Metric Options: Regardless of the chosen representation, date range, and filters applied, you can define the metric used to identify the top-performing campaign or audience region.

• Net Revenue: Customer Sales Revenue Net, after returns and refunds, displayed in the selected currency. You can switch between currencies using the filter panel.
• Conversion Rate: The number of Paid Orders (before refunds) divided by the number of Sessions. Only orders linked to sessions are counted to ensure accuracy in conversion calculation.
• Orders (Paid): The total number of Paid Orders before returns or chargebacks. This metric shows raw order volume generated by campaigns or regions.
• Orders (Returned): The number of orders that resulted in refunds or chargebacks. Useful for monitoring order quality and understanding refund patterns.
• Sessions: The total number of visitor sessions during the selected period. The sessions are counted regardless of whether they resulted in an order.
• Average Order Value (AoV): The average value of an order, calculated as (Net Revenue after refunds and chargebacks) ÷ (Orders after returns). AoV provides insight into the typical order size and helps assess the value of customer transactions.

• Other settings: You can also adjust the data shown in this view using the Date Selection options and Filters as described at the end of this article.

Candidate Performance Breakdown table

The table below the charts provides a detailed performance breakdown of your MVT Campaigns, with results displayed at both the campaign and individual candidate level.

The table includes only candidates that have generated Net Revenue or Sessions during the selected period, helping you focus on meaningful activity. By default, the results are sorted by Net Revenue in descending order, so your top-performing campaigns and candidates appear first.

Candidate Performance Breakdown table settings

You can customize the table to explore your data in the way that best supports your analysis:

• Expand each MVT Campaign row to view the performance of its individual candidates.

• Reorder the table by clicking any column header to sort the data accordingly.

• Customize which columns are displayed by selecting or deselecting columns in the Manage Columns dropdown.

  Default Columns:

  • MVT: Displays the ID and Name of each MVT Campaign and its associated candidates.
  • Candidates: The total number of candidates within each MVT Campaign that are displayed in the table.
  • Net Revenue: Customer Sales Revenue Net, calculated after returns, refunds, and chargebacks.
  • Conversion Rate: The number of Paid Orders (before refunds) divided by the number of Sessions. Only orders linked to sessions are included in this calculation.
  • Average Order Value (AoV): Net Revenue (after refunds and chargebacks) divided by Orders after returns. This metric reflects the average value of an individual order.
  • Sessions: The total number of visitor sessions during the selected period.
  • Orders (Paid): The number of Paid Orders recorded, prior to any returns or chargebacks.
  • Destination URL: The URL of the checkout flow associated with each candidate. Provides a direct reference to the version of the checkout experience customers were routed to.
  • Audience Region: The Audience Region assigned to the candidate, as defined in the MVT Campaign’s Audience Settings.
  • Modified: The date when the MVT Campaign or Candidate was last modified.
    
    

  Additional Available Columns (use "Manage Columns" dropdown to add):

  • Test: Indicates whether the MVT Campaign currently has an active test running. Helps distinguish between routings used purely for segmentation and those being tested.
  • Status: The current status of the MVT Campaign or Candidate (Active or Inactive). Especially useful when including Inactive items in your analysis.
  • MVT URL: The URL associated with the MVT Campaign. Useful for validating campaign routing and testing configurations.
  • Orders (Returned): The number of orders that resulted in refunds or chargebacks. Helps monitor order quality and identify refund trends.
  • Orders (Aggregated): The net number of orders, calculated as Orders (Paid) - Orders (Returned). Provides a quick view of retained order volume after accounting for returns.
  note

  Columns appear in the order they are selected—so if you uncheck a column and then add it back, it will appear at the end of the table.

• Other settings: You can also adjust the data shown in this view using the Date Selection options and Filters, and use other tools such as table export, as described at the end of this article.

Tests Mode

The Tests Mode in MVT Campaign Analytics provides a dedicated view for analyzing the results of controlled MVT Tests. This helps you evaluate how different checkout variants perform when tested against a Control Candidate, so you can make informed decisions about which versions deliver the best outcomes.

tip

In MVT Campaigns, a Test is defined as a routing configuration that includes a Control Candidate and at least one additional Test Candidate (variant).

During the test, customers within the same Test Audience (defined by Audience Region, Browser, Operating System, and Language) are randomly assigned to either the Control or a Test Candidate based on the configured traffic split. Only one Control Candidate can be active within a Test at any given time.

When the Test Mode is selected, the page contains:

• Test Performance for Selected MVT Campaign: A table that displays performance metrics for each Control Candidate and Test Candidate, grouped by Test Audience. This view helps you compare variants side by side and assess their impact on key business outcomes.
• Explore View (Deep Performance Analysis): An interactive tool that allows you to drill down into candidate performance across different dimensions, such as Region, Country, Product, Operating System, and Browser. Use this view to uncover the root causes of performance differences and identify optimization opportunities.
• Candidate Performance Comparison Chart: A visual chart that compares Net Revenue for each candidate across selected dimensions, helping you spot trends and patterns in test results.

Test Performance for Selected MVT Campaign

By default, the table displays the best-performing MVT Campaign with active tests, grouped by Test Audience. Within each audience group, the table shows the Control Candidate (marked as CONTROL) and all corresponding Test Candidates, enabling clear side-by-side comparison of performance metrics.

tip

Metrics highlighted in green indicate that the candidate is outperforming the Control for that metric, while metrics highlighted in red indicate underperformance. Use these visual cues to quickly spot where candidates are winning or falling behind.

Results are initially sorted by Net Revenue (highest to lowest), but you can click any column header to reorder the table based on your preferred metric.

• Sessions: Total number of visitor sessions recorded for each candidate during the reporting period.

• Conversion Rate: The number of Paid Orders (before returns) divided by the number of Sessions. Reflects the percentage of sessions that resulted in a paid order.

• Orders (Paid): The total number of Paid Orders generated, prior to any returns or chargebacks.

• Net Revenue: Total revenue after accounting for refunds and chargebacks.

• Revenue Lift: The percentage difference in Net Revenue compared to the Control Candidate. Indicates how much more or less revenue a test candidate is generating relative to the control.

• RPV (Revenue Per Visitor): Net Revenue divided by the total number of Sessions. Measures the average revenue generated per visitor.

• RPV Lift: The percentage difference in RPV compared to the Control Candidate.

• Average Order Value (AoV): Net Revenue divided by the number of Paid Orders. Represents the average value of an individual order.

• AoV Lift: The percentage difference in AoV compared to the Control Candidate.

• Confidence: The statistical confidence level of the results. Indicates the probability that observed differences between candidates and the control are not due to random chance.

  Confidence ranges:

  • Below 80%: Results may be due to random variation; more data is needed before drawing conclusions.
  • 80–90%: Moderate confidence; emerging trends are visible, but findings are not yet definitive.
  • 90–95%: High confidence; results are likely valid and can be used to guide decisions.
  • Above 95%: Very high confidence; results are statistically significant and highly reliable.

important

Lift calculations always compare against the current ACTIVE Control candidate.
Even when viewing inactive candidates, they will be compared with the active Control.

Test Performance for Selected MVT Campaign table settings

The default view shows only active Control Candidates, active Test Candidates, and only active MVT Campaigns are available for selection. You can use the MVT Campaign Selection dropdown to select a specific campaign.

You can also adjust the data shown in this view using the Date Selection options and Filters, and use other tools such as table export, as described at the end of this article.

Explore view (Deep Performance Analysis)

The Explore view provides advanced tools for deep analysis of candidate performance within a selected test. It helps you understand where and why certain candidates outperform or underperform the control across different dimensions.

To access the view, select the test or campaign you want to analyze in the Test Performance Overview table, then click the Explore button.

tip

You can choose to analyze a whole MVT Campaign (viewing all test candidates in the selected campaign), or a specific candidate within a selected test.

Explore view table: Structure and Behavior

The table displays the performance grouped by dimension.

It includes the dimensions used for grouping (by default, the Region dimension is chosen), name of the candidate, and the performance details (Net Revenue, AoV, etc.).

• When a whole campaign is selected, you will see all candidates listed for the selected dimension.
  
• When a specific candidate is selected, you will see only that candidate’s performance across the selected dimension.
  

tip

The blue gradient background in the performance table provides instant visual cues to support pattern recognition across your metrics:

• Dark Blue: Higher values within the selected metric column.
• Light Blue: Lower values within the selected metric column.

This color-coding acts as a visual heatmap, helping you quickly identify performance patterns and spot differences across dimensions—making it easier to interpret and compare candidate performance at a glance.

While the first column(s) reflect the dimension(s) selected (see Dimensions section) and will change accordingly, the following columns remain consistent across all views:

• Candidate: The candidate being analyzed.
• Net Revenue: Total revenue after refunds and chargebacks.
• Average Order Value (AoV): Net Revenue divided by Orders (Paid). Represents the average value of an individual order.
• Conversion Rate: Paid Orders divided by Sessions. Reflects the percentage of sessions that resulted in a paid order.
• Sessions: Total number of visitor sessions.
• Orders (Paid): Total number of paid orders, before refunds or chargebacks.
• Revenue Per Visitor (RPV): Net Revenue divided by Sessions. Measures the average revenue generated per visitor.

Explore view table settings

The Explore View table allows you to analyze candidate performance across different dimensions. This helps you uncover patterns and variations in how test candidates perform for specific customer segments.

You can adjust the dimension displayed in the first column of the table by using the Choose Dimension dropdown.

You can switch dimensions at any time to explore different aspects of performance. The rest of the table columns remain consistent and update automatically based on your selected dimension.

• Region: The audience region as defined in your Audience Settings.

• Country: The country based on the customer’s session location.

  note

  Session country may differ from Billing Country, which can cause differences in Session and Conversion Rate counts by Region or Country (in some cases Conversion Rate may exceed 100% because of that).

• Product: The product or service included in the order.

• Operating System: The customer’s device operating system.

• Browser: The customer’s browser type.

You can also adjust the data shown in this view using the Date Selection options and Filters, and use other tools such as table export, as described at the end of this article.

Return to the Test Performance page

Use Arrow Back to return to the Test Performance page.

Candidates Performance for Selected Test Audience chart

The Candidates Performance for Selected Test Audience chart helps you visually compare how each test candidate performs across your selected test audience and dimension(s).

It is a bar chart that visualizes the Net Revenue generated by each candidate, broken down by the selected dimension(s). By default the chart displays data for the selected Test Audience (you can choose a specific audience or view all audiences). The x-axis shows values of the selected dimension (by default: Region). The y-axis shows Net Revenue.

Each candidate is represented by a color-coded bar. The candidate legend appears below the chart. The chart also includes a General Audience row, showing overall results across all dimension values.

This chart is particularly useful for spotting performance trends and relative differences between candidates at a glance, complementing the detailed table analysis in Explore View.

Candidate Performance for Selected Test Audience settings

You can adjust the Candidates Performance for Selected Test Audience chart to explore candidate performance across different dimensions and audience groups:

• Choose Dimension: Select the dimension used to break down candidate performance. The selected dimension determines the values shown on the chart’s x-axis.

Available dimensions include:

• Region: Audience region (default).

• Country: Customer session location.

  note

  Session country may differ from Billing Country, which can affect counts.

• Product: Product or service purchased.

• Operating System: Customer device OS.

• Browser: Customer browser type.

• Choose Test Audience: Select the Test Audience you want to analyze.
  By default, the chart displays data for the best performing audience.

  tip

  Comparisons are limited to a single Test Audience, as cross-audience comparisons aren't meaningful. If All is selected, the chart will show aggregated results across all test audiences.

• Other Settings: You can also adjust the data shown in this view using the Date Selection options and Filters, and use other tools such as table export, as described at the end of this article.

Other Settings

MVT Campaigns data can be filtered and adjusted as well as on all other Analytics dashboards.

Filters

Regardless of the selected chart representation or table, you can refine the data displayed using the Filters panel. Applying filters allows you to focus your analysis on specific campaigns, candidates, audiences, or customer segments, making it easier to uncover actionable insights and tailor your reporting to your business needs.

Available filters include:

• Client: Select the Client account to be analyzed (useful if you have access to multiple clients). The logged-in user's Client is selected by default.

• MVT Campaign: Select specific MVT Campaigns to analyze, or choose All to include all available campaigns.

• MVT Campaign Status: Choose whether to include Active, Inactive, or All campaigns.

• Control Status (Available only in the Test mode): Filter by Control status of test candidates.

• Candidate: Focus the analysis on a particular Candidate, or select All to include all Candidates.

• Candidate Status: Choose whether to include Active, Inactive, or All candidates.

• Audience Region: Filter the analysis by regions defined in your Audience Settings.

• Billing Region, Country: Filter performance by the customer’s billing location (Region and Country).

  note

  Session country may differ from Billing Country, which can result in inconsistencies in Session and Conversion Rate counts by Region or Country.

• Product: Filter by specific products or services.

  note

  Single orders can contain multiple products. When viewing Orders by Products, counts represent orders containing each specific product, so totals may exceed overall order counts.

• Payment Type, Subtype: Filter by the payment method used by the customer.

  note

  Payment type data is not always available for sessions. As a result, Conversion Rate by Payment Type may be less reliable due to many "Unknown" entries.

• Operating System: Filter by the customer’s device operating system.

• Browser: Filter by the customer’s browser type.

• Recurrence: Filter by transaction type: Subscription or One-time Purchase.

• Currency: Select the currency in which revenue-related metrics are displayed (For example, EUR or USD). The Main Client’s currency is selected by default.

important

By default, only Active MVT Campaigns and Active Candidates are included in the report chart and table. To include Inactive campaigns or candidates in your analysis, adjust the MVT Campaign Status and Candidate Status filters accordingly.

Other data adjustment tools

The other settings include:

• date adjustments
  

• table export
  

• data drill-down and filtering
  

To learn more about additional filter and tools available on the analytics dashboards see the corresponding document.

Did you find this doc useful?