Where is the bulk data migration feature in ToD?

Problem Description:

I would like to transfer a set of tables from one data system to another. Is there an easy way to do this? Can we avoid creating each transfer flow one by one?

Solution:

The bulk data migration feature is located in the “Catalog” tab to the right of the flow creation button. Start by selecting all the tables you want to migrate (multiple selection with control or shift keys).

image1

The following window will then appear:

image2

On the right side, choose the target where the tables will be migrated. Confirm once all parameters are set. The generated sequence can then be launched immediately or scheduled for a later execution.

The bulk migration sequence will appear in the list of flow sequences in the “Flow Execution” section as shown below:

image3

The result of the migration will appear in Parquet format in the target folder:

image4