Data quality in Adobe Experience Platform
Adobe Experience Platform provides well-defined guarantees for completeness, accuracy, and consistency for any data uploaded through either batch or streaming ingestion. The following document provides a summary of the supported checks and validation behaviors for batch and streaming ingestion in Experience Platform.
Supported checks
Supported validation behaviors
Both batch and streaming ingestion prevent failed data from going downstream by moving bad data for retrieval and analysis in Data Lake. Data ingestion provides the following validations for batch and streaming ingestion.
Batch ingestion
The following validations are done for batch ingestion:
"meta:immutableTags": ["union"]
identityField
createdUser
Streaming ingestion
The following validations are done for streaming ingestion:
"meta:immutableTags": ["union"]
identityField
More information about how Platform monitors and validates data can be found in the monitoring data flows documentation.
Identity value validation
The following table outlines existing rules you must follow to ensure a successful validation of your identity value.
- The identity value of an ECID must be exactly 38 characters.
- The identity value of an ECID must consist of numbers only.
- If the identity value of ECID is not exactly 38 characters, then the record is skipped.
- If the identity value of ECID contains non-numerical characters, then the record is skipped.
For more information on Identity Service guardrails, see the Identity Service guardrails overview.