Beta This is a beta feature, which means we’re still developing it. Some functionality might change.
The output of the bulk trigger step is an array of data. To process the data, use a loop to iterate through each record in the array and perform an appropriate action. The loop is automatically attached to the bulk trigger step when you select it for the first time.
In this example, we use the bulk trigger to transfer records from one table to another:
We create the pipeline using these steps:
- An On New Bulk Event step that receives a large amount of changes at once.
- A Bulk Record Upsert step that specifies the table where we would like to transfer the records to.
- A Loop, which processes each record that is outputted from the On New Bulk Event step. For example, if 1,000 records are sent to the pipeline, any action inside the loop will run 1,000 times.
- Inside the loop, we can perform any modifications to the records that we would like. In this example, we use an Add a Bulk Upsert Row step to prepare the record to be uploaded to the other table.
- Outside of the loop, we use the Commit Upsert step to start the bulk import into the other table.
The loop for the On New Bulk Event bulk trigger processes records in sequence. This means that the order of the records that you received with the trigger are kept as is and are transferred to other tables without any shuffling.