How does the Data Preview in ToD work?

Problem Description:

I noticed that the data preview only shows some lines of my source file. Why?

Solution:

The preview in ToD is performed with a record limit predefined in the “Source Configuration” window, at the line “Record Limit”.

image1

To ensure optimal usability, only 10,000 lines are loaded from the source by default. This value can be configured according to your needs during source configuration.

As for the Data Preview, it only displays a maximum of 2,000 lines.

It is only when the flow is executed that the entirety of the lines is processed.