Link source data

In source data, you define which data is extracted from a source system.

Link source data

Follow these steps:

  1. Open your process data pipeline.

  2. In the Overview tab, click Connection and source data.

    The dialog for selecting a connection type opens.

  3. Select a connector from the following connection types:

    • Enterprise Systems

    • Cloud Storage / Warehouse

    • Database

    • Other

  4. Click Next.

  5. Select an existing source data which is related to the connection and click Link.

    The source data is linked to the process data pipeline.

    Changes to the process data pipeline are applied immediately.

Link multiple source data systems

To run transformations for complex processes, you can extract data from different source systems. To do this, you can link multiple source data systems to your data pipeline.

The table names must be unique across all source data systems that are linked to one process data pipeline.

In case of redundant table names, you need to create aliases before you can link source data to a process data pipeline. Read more in section Create a table name alias.

A complete data pipeline executes for each source data that is linked to a process data pipeline and a separate event log is generated for each pipeline execution.

Follow these steps:

  1. Open your process data pipeline.

  2. In the Overview tab, click Connection and source data.

    The dialog for selecting a source data opens.

  3. Select a connector from the following connection types:

    • Enterprise Systems

    • Cloud Storage / Warehouse

    • Database

    • Other

  4. Click Next.

  5. Select an existing source data and click Link.

    The source data is linked to the process data pipeline.

    Changes to the process data pipeline are applied immediately.

Remove the link to source data

You can remove a linked source data in three places, on the Overview, Connections, and Source data tabs.

Remove source data on the overview tab

Follow these steps:

  1. Open your process data pipeline.

  2. On the Overview tab, click on the connection card then Remove.

  3. To confirm removal, confirm in the dialog and click Remove.

    The connection and source data is removed from the process data pipeline. The source data and the extracted data remains unchanged.

Remove source data on the connections tab

Follow these steps:

  1. Open your process data pipeline.

  2. Select the Connections tab.

  3. Locate the required connection and click , then Remove.

  4. To confirm removal, confirm in the dialog and click Remove.

    The connection and source data is removed from the process data pipeline. The source data and the extracted data remains unchanged.

Remove source data on the source data tab

Follow these steps:

  1. Open your process data pipeline.

  2. Select the source data tab.

  3. Locate the required source data and click , then Remove.

  4. To confirm removal, confirm in the dialog and click Remove.

    The source data and connection is removed from the process data pipeline. The source data and the extracted data remains unchanged.

Next steps

Define the transformation

Monitor pipeline execution