Auto-Target Summary report
Information about how to interpret the Auto-Target Summary reports in Adobe Target.
To display the Auto-Target Summary reports:
-
From the Activities page, click the desired Auto-Target activity.
If you have many activities, you can filter the list by selecting options from the Type, Status, Property, Reporting Source, Experience Composer, Metrics Type, and Activity Source drop-down lists.
-
Click the Reports tab, then click the desired icon:
- Table View
- Graph View
- Automated Segments
- Important Attributes
Table View
The following illustration shows what a typical summary report looks like in Table View when viewing an Auto-Target activity’s report:
Some tips and considerations as you interpret your Auto-Target reports:
-
The various rows in the table help you understand activity performance.
- The top two rows in the table on the reporting page show the results of an A/B test between the visitors who were assigned to the control (i.e. randomly served experiences) and the visitors who were assigned to the personalization algorithm. This information can be used to measure how the personalization algorithm performed compared to the randomly-served control.
- The remaining rows show experience-level results. For each experience, there is a comparison between the average response of visitors who were shown that experience as a randomly served control, and the average response of visitors who were shown the experience using the personalization algorithm.
-
The green check icon next to each experience in the report indicates that a personalized machine-learning model has been generated for that experience. The clock icon indicates that not enough traffic has been served to build the model.
- Because the model is built per experience, it is possible to see a model for some experiences with a green check and others with a clock icon.
- In this case, to increase the speed of the activity having models built for all experiences, additional traffic is sent to experiences with unbuilt models.
- There must be at least two experiences with built models (green checkmark) in order for personalization to begin.
-
Comparing the conversion rate of experience A with that of experience B is not the right comparison in Auto-Target. The question is whether experience A performs better when served in an intelligent way versus a random way (in other words, versus the control). Marketers should also use caution about interpreting the lifts of individual experiences because the personalization algorithm is attempting to optimize for the success metric over the entire activity, not over each individual experience.
-
Experiences with the highest lift can be understood as having the highest differentiation within the population. That is the algorithm has found a segment that likes that particular experience the most.
-
The various columns in the table show the number of visits, conversion rate, average lift and confidence level, and confidence. For more information, see Statistical calculations in A/B tests.
Graph View
The following illustration shows what a typical summary report looks like in Graph View when viewing an Auto-Target activity’s report:
As shown below, you can use the two drop-down lists to choose the desired metrics, counting methodology, and more. See Report settings overview for more information:
Automated Segments
Click the Automated Segments icon. This report shows how different visitors respond differently to the offers/experiences in your AP/AT activity. This report shows how different automated segments defined by Target’s personalization models responded to the offers/experiences in the activity.
For more information, see Automated Segments report.
Important Attributes
Click the Important Attributes icon. This report shows how, in different activities, different attributes are more (or less) important to how the model decides to personalize. This report shows the top attributes that influenced the model and their relative importance.
For more information, see Important Attributes report.