Monitor dataflows for identities in the UI

Adobe Experience Platform Identity Service provides you with a comprehensive view of your customers and their behavior by bridging identities across devices and systems, allowing you to deliver impactful, personal digital experiences in real time.

The monitoring dashboard provides you with a visual representation of the data’s activity within identities, including the status of your data’s identities. This tutorial provides instructions on how you can use the monitoring dashboard to monitor your data’s identities using the Experience Platform user interface, allowing you to track the status of identity processing.

Getting started getting-started

  • Dataflows: Dataflows are a representation of data jobs that move data across Platform. Dataflows are configured across different services, helping move data from source connectors to target datasets, to Identity and Profile, and to Destinations.
    • Dataflow runs: Dataflow runs are the recurring scheduled jobs based on the frequency configuration of selected dataflows.
  • Identity Service: Gain a better view of individual customers and their behavior by bridging identities across devices and systems.
  • Sandboxes: Experience Platform provides virtual sandboxes which partition a single Platform instance into separate virtual environments to help develop and evolve digital experience applications.

Monitoring identities dashboard identity-metrics

To access the Identities dashboard, select Monitoring in the left navigation. Once on the Monitoring page, select the Identities card.

The Identities card. Information about the number of records received, the number of records ingested, and the success rate is shown.

On the main Identities dashboard, the Identities card shows information about the total number of records received, the number of records ingested, as well as the success rate of record ingestion.

The dashboard itself contains metrics about Identity processing. By default, the dashboard will show Identity processing details for your organization’s sources for the last 24 hours.

The Identities dashboard. Information about the number of the records received per source is displayed.

The Identity processing page contains information on records ingested to Identity Service, including number of identities added, graphs created, and graphs updated.

The following metrics are available for this dashboard view:

Identity metrics
Description
Records received
The number of records received from data lake.
Records failed
The number of records that were not ingested into Platform due to errors in the data.
Records skipped
The number of records that were ingested, but not into Identity Service because there was only one identifier in the record row.
Records ingested
The number of records ingested into Identity Service.
Identities added
The number of net new identifiers added to Identity Service.
Graphs created
The number of net new identity graphs created in Identity Service.
Graphs updated
The number of existing identity graphs updated with new edges.
Total failed dataflows
The number of dataflow runs that failed.

You can select the filter icon Filter icon beside the source name to see Identity processing information for that selected source’s dataflows.

The filter icon is highlighted. Selecting this icon allows you to view the selected source's dataflows.

Alternatively, you can select Dataflows on the toggle to see Identity processing details for your organization’s dataflows for the last 24 hours.

The Identities dashboard. Information about the number of of identities received per dataflow is displayed.

The following metrics are available for this dashboard view:

Metric
Description
Dataflow
The name of the dataflow.
Dataset
The name of the dataset that the dataflow is inserting to.
Source name
The name of the source that the dataflow belongs to.
Records received
The number of records received from data lake.
Records failed
The number of records that were not ingested into Platform due to errors in the data.
Records skipped
The number of records that were ingested, but not into Identity Service because there was only one identifier in the record row.
Records ingested
The number of records ingested into Identity Service.
Total records
The total count of all records, including records failed, records skipped, identities added, and duplicated records.
Identities added
The number of net new identifiers added to Identity Service.
Graphs created
The number of net new identity graphs created in Identity Service.
Graphs updated
The number of existing identity graphs updated with new edges.
Total failed dataflows
The number of dataflow runs that failed.

Select the filter icon filter beside the dataflow run start time to see more information on your Identity dataflow run.

The filter icon is highlighted. Selecting this icon allows you to view details about the selected dataflow.

The Dataflow run details page displays more information on your Identity dataflow run, including its organization ID and dataflow run ID. This page also displays the corresponding error code and error message provided by Identity Service, should any errors occur in the ingestion process.

A dashboard showing detailed information about the selected dataflow is displayed.

The following metrics are available for this dashboard view:

Metric
Description
Records received
The number of records received from data lake.
Records failed
The number of records that were not ingested into Platform due to errors in the data.
Records skipped
The number of records that were ingested, but not into Identity Service because there was only one identifier in the record row.
Records ingested
The number of records ingested into Identity Service.
Identities added
The number of net new identifiers added to Identity Service.
Graphs created
The number of net new identity graphs created in Identity Service.
Graphs updated
The number of existing identity graphs updated with new edges.
Status

Defines the overall status of a dataflow. The possible status values are:

  • Success: Indicates that a dataflow is active and is ingesting data according to the schedule it was provided…
  • Failed: Indicates that the activation process of a dataflow has been disrupted due to errors.
  • Processing: Indicates that the dataflow is not yet active. This status is often encountered immediately after a new dataflow is created.
Dataflow run start
The date and time the dataflow started to run.
Last updated
The date and time the dataflow last updated.
Error summary
If the dataflow run failed, this displays an error code and summary of why the dataflow run failed.
Dataflow run ID
The ID of the dataflow run.
IMS org ID
The organization ID that the dataflow run belongs to.

Additionally, you can select the toggle to view the records failed or the records skipped. The errors section includes details about the error code and number of records failed or excluded.

recommendation-more-help
d4f38c9a-ed8e-4b74-98e7-57b4df1b999f