Create a Google Cloud Storage source connection in the UI

This tutorial provides steps for creating a Google Cloud Storage source connection using the Adobe Experience Platform UI.

Getting started

This tutorial requires a working understanding of the following components of Adobe Experience Platform:

If you already have a valid Google Cloud Storage connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow.

Supported file formats

Experience Platform supports the following file formats to be ingested from external storages:

  • Delimiter-separated values (DSV): Any single-character value can be used as a delimiter for DSV-formatted data files.
  • JavaScript Object Notation (JSON): JSON formatted data files must be XDM compliant.
  • Apache Parquet: Parquet formatted data files must be XDM compliant.

Gather required credentials

In order to access your Google Cloud Storage data on Platform, you must provide the following values:

Credential
Description
Access key ID
A 61-character, alphanumeric string used to authenticate your Google Cloud Storage account to Platform.
Secret access key
A 40-character, base-64-encoded string used to authenticate your Google Cloud Storage account to Platform.
Bucket name
The name of your Google Cloud Storage bucket. You must specify a bucket name if you want to provide access to a specific subfolder in your cloud storage.
Folder path
The path to the folder that you want to provide access to.

For more information about these values, see the Google Cloud Storage HMAC keys guide. For steps on how to generate your own access key ID and secret access key, refer to the Google Cloud Storage overview.

Once you have gathered your required credentials, you can follow the steps below to link your Google Cloud Storage account to Platform.

Connect your Google Cloud Storage account

In the Platform UI, select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources with which you can create an account.

You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search option.

Under the Cloud storage category, select Google Cloud Storage and then select Add data.

The Platform UI screen displaying the sources catalog page.

The Connect to Google Cloud Storage page appears. On this page, you can either use new credentials or existing credentials.

Existing account

To connect an existing account, select the Google Cloud Storage account you want to connect with, then select Next to proceed.

The Platform UI screen displaying the existing account page for a Google Cloud Storage source

New account

If you are using new credentials, select New account. On the input form that appears, provide a name, an optional description, and your Google Cloud Storage credentials. During this step, you can also designate the subfolders that your account will have access to by defining the name of the path to the subfolder.

When finished, select Connect to source and then allow some time for the new connection to establish.

The Platform UI screen displaying the new account page for a Google Cloud Storage source.

Next steps

By following this tutorial, you have established a connection to your Google Cloud Storage account. You can now continue on to the next tutorial and configure a dataflow to bring data from your cloud storage into Platform.

recommendation-more-help
337b99bb-92fb-42ae-b6b7-c7042161d089