Target activity types

Activity Type

Details

Manual A/B Test

Compares two or more experiences to see which experience best improves conversions throughout a pre-specified test period.

For more information, see A/B Test.

Auto-Allocate

Identifies a winner among two or more experiences, and then redirects traffic to the winning experience, increasing conversion as the test runs and learns.

For more information, see Auto-Allocate.

Auto-Target

Uses advanced machine learning to personalize content and drive conversions by identifying multiple high-performing, marketer-defined experiences, and then serving the most tailored experience to visitors based on their individual customer profiles and past behaviors of similar visitors.

For more information, see Auto-Target For Personalized Experiences.

Automated Personalization (AP)

Uses advanced machine learning to personalize content and drive conversions by combining specific offers or messages, and then matching different offer variations to visitors, based on their individual customer profiles.

For more information, see Automated Personalization.

Multivariate Test (MVT)

Compares combinations of offers among elements on a page to see which combination of offers performs the best for a specific audience. Also, identifies which element of the page best improves conversions throughout a pre-specified test period.

For more information, see Multivariate Test.

Experience Targeting (XT)

Delivers content to a specific audience based on a set of marketer-defined rules and criteria.

For more information, see Experience Targeting.

Activity Type

Reason

Manual A/B Test

A highly controlled experiment with traffic measurements, split by percentages rather than by a rule, allowing you to analyze the test data, glean insights about your audience, and determine which experience performs the best.

Auto-Allocate

A way to identify a winning experience and adjust traffic allocation to deliver the winning experience to visitors as fast as possible, supporting a faster and higher likelihood of conversion.

Auto-Target

A way to identify the winners among multiple experiences, and then deliver the most appropriate experience to specific visitors. The targeting adapts over time as visitors’ interests change, because the algorithm predicts a visitor’s propensity for conversion on a certain experience at a certain time.

Automated Personalization (AP)

A way to personalize a set of offers (created or pre-defined, in elements on a single page or across multiple pages) and deliver offer combinations that work the best to attract specific visitors.

Multivariate Testing (MVT)

A way to display multiple offers in multiple elements, and then test the resulting unique experiences concurrently against a specific goal, which helps determine which element variation is the most successful. An MVT activity can also reveal which elements have the greatest positive or negative impact on a visitor’s interaction.

Experience Targeting (XT)

A way to target specific content to a specific audience based on a set of defined allocation rules.

Activity Type

The Marketer

Manual A/B Test

Is knowledgeable in stats.

Has the time to wait until end of test period to analyze results.

Auto-Allocate

Has a short time frame.

Must identify the best experience and deliver quickly.

Wants to be able to “peek” at results as test runs.

Auto-Target

Has several eligible experiences.

Wants to match experiences to specific visitors at optimal times based on their dynamic and changing profiles.

Automated Personalization (AP)

Has one or more offers.

Wants to create offers combinations that yield optimal personalized experiences for specific visitors across various unique profiles and behaviors.

Multivariate Testing (MVT)

Is knowledgeable in stats.

Has one or more offers.

Wants to analyze conversion trends relating to page element interactions.

Experience Targeting (XT)

Must deliver a specific experience or piece of content to a specific audience.

Activity Type

Details

Manual A/B Test

The test compares each challenger experience to a control experience and then ranks the performance of all experiences, identifying both a winning experience and a losing experience when compared to the control.

Auto-Allocate

The test produces a statistical guarantee on a true winner right away, and then directs more traffic towards audiences who have a higher likelihood of conversion with that winning experience.

Auto-Target

The optimization mechanism identifies the relevant audience for each experience by showing increases and decreases in lift over time, and before it determines which experience to deliver to which visitor. The optimization mechanism is informed by conversions, segments, parameters, and profile scripts. From there, the mechanism automatically chooses which algorithm to use to generate a higher lift and conversion rate.

Automated Personalization (AP)

The optimization mechanism constantly adjusts which experiences are delivered to which visitors based on new visitor behavior and past behaviors of similar visitors, with an offer’s performance being measured against concurrent control groups.

Multivariate Testing (MVT)

The test helps uncover the relative influence that specific elements have on conversion.

Experience Targeting (XT)

The method defines rules that target either a specific experience or a specific piece of content to a specific audience. Customers can make updates at the experience level.

Activity Type

Benefits

Considerations

Manual A/B Test

A/B resting helps you gain a full understanding of how each experience performs, beyond just which experience performs the best.

In an A/B Test, if you look at the test results before the sample size is reached, you risk relying on inaccurate results (you cannot "peek"earlier!).

Unlike Auto-Allocate, in an A/B test, the traffic distribution remains fixed even after you recognize that some experiences are outperforming others.

For information about best practices for A/B Test activities, see How long should you run an A/B Test and Ten common A/B testing pitfalls and how to avoid them.

Auto-Allocate

Auto-Allocate reduces the cost of a typical A/B test because it has a higher overall conversion rate than a manual A/B test. The conversion rate is higher because Auto-Allocate pushes more traffic to the highest performing experience, meaning you can realize the benefit of that winning experience earlier than the end of the test period (you can peek!).

Auto-Allocate identifies the winner but does not differentiate among the losers. If you must know how each experience performed, A/B testing is preferable.

The Auto-Allocate feature works with only one advanced metric setting, which is “Increment Count and Keep User in Activity.” If you do not want to count repeat conversions, you should use A/B testing instead.

Auto-Target

With Auto-Target, machine learning is applied to any kind of experience, including multi-page experiences. An Auto-Target activity also lets you gain the value of Automated Personalization while using the familiar A/B testing workflow.

With Auto-Target, if you want to change the content of your offers often or frequently, the algorithm needs enough time after each change to exploit what it learns and to deliver that content to the right visitors.

Automated Personalization (AP)

With Automated Personalization, you can collect all of your offers in one place, and the algorithm determines the best combination of offers. You do not need to specify or build individual experiences. Automated Personalization uses the same machine learning algorithms as Auto-Target.

When you combine multiple offers, a combinatorial explosion occurs resulting in the need for a significant amount of traffic. The Automated Personalization algorithm accounts for many factors; therefore, requiring the most amount of traffic.

Automated Personalization cannot consume reports in Analytics for Target (A4T).

Multivariate Testing (MVT)

With Multivariate Testing, you can test multiple elements simultaneously.

A Multivariate Test is time consuming, and due to the multiple variables at play, it does not necessarily produce a winning experience with confidence.

It is often challenging to reach the amount of traffic needed to complete the test. Because all Multivariate Test experiments are fully factorial, too many changing elements at once can quickly add up to many possible combinations that must be tested.

Even a site with fairly high traffic might have trouble completing a test with more than 25 combinations in a feasible amount of time.

Experience Targeting (XT)

With Experience Targeting, you can quickly act on insights deduced from any activity results.

For example, if you ran an A/B test where the challenger did not outperform the control, but the results indicate that a specific segment of visitors converted four times more with the challenger than they did with the control, then you can use Experience Targeting to direct the challenger experience to that particular segment.

Experience Targeting does not allow you to control the percentage split of an experience across multiple audiences.