December 2024

Date

Description

Type

Available from

16/12/24

Various code base improvements.

Improvement

4.2.0201

11/12/24

Improve reliability of preview display in catalog presenter.

Improvement

4.2.0201

11/12/24

In the catalog view show unusable tables in the tree view when selecting a node. Before it would do it only when expanding a node, not selecting it.

Improvement

4.2.0201

11/12/24

MDD scan; limit the number of columns that can be handled to 2500 (arbitrary but reasonable value). This avoids stack-overflow errors when building the execution plan.

Improvement

4.2.0129

11/12/24

Remove extra check on number of columns, to avoid exception when listing sheets.

Improvement

4.2.0201

11/12/24

Speed up column renaming by using Spark 3.4’s withColumnsRenamed (note the plural form of “columns”) instead of an iteration over single renames.

Improvement

4.2.0201

10/12/24

Add indexes to speed up costly MDD job queries (in both the job status view and insertion in comparison tables).

Improvement

4.2.0129

10/12/24

Avoid flooding the logs when opening files with lots of empty cells at the end of rows.

Improvement

4.2.0129

10/12/24

Clean up the “exports” subdirectory in TOD home when the Web app starts up.

Improvement

4.2.0128

10/12/24

Enable Batch run mode to read only the largest or smallest-named file in a folder structure.

New Feature

4.2.0127

10/12/24

Fix mariadb scan job progress reporting to get more accuracy.

Bug

4.2.0129

10/12/24

Handle the “error” cell type without throwing runtime exceptions during MDD scan of excel files.

Bug

4.2.0129

10/12/24

Handle the non-textual formula cell types without throwing runtime exceptions during MDD scan of excel files.

Bug

4.2.0129

10/12/24

Make sure start and end date are properly updated when resuming a paused MDD job.

Improvement

4.2.0129

10/12/24

Network drives in catalog: use try-with-resource to avoid file descriptor leaks on traversed directories.

Bug

4.2.0129

10/12/24

When cleaning phantom jobs, consider ALL started jobs, no matter whether they were previously paused.

Improvement

4.2.0129