Document toolboxDocument toolbox

Sequential File with Concurrent Write Operations

Query name

Sequential File with Concurrent Write Operations

Server Asset Type

Sequential File stage

Analysis Type

Remediation

Description

Describes the Stage, file name and Link names involved in concurrent write operations to the same Sequential File.

Issue

Server jobs operate in a largely sequential manner, and can be designed to ensure that data reaches particular stages in a job in a desired order. This allows designs where a single Sequential File stage may contain multiple input links writing to the same file, and this will behave correctly, predictably and repeatably.

Due to the way Parallel jobs operate, data flows through the job as it becomes available, resulting in a target file where the ordering of rows is not consistent or predictable.

Actions

Parallel jobs that replace Server jobs involving concurrent write operations should be resigned to collect and order the results in a deterministic manner before writing to the Sequential File using a single input Link.


See also

© 2015-2024 Data Migrators Pty Ltd.