Document toolboxDocument toolbox

Folder Stage

Summary

The Folder Stage reads data from or writes data to one or more files in a directory.

IBM documentation

Server Stage: Folder Stage - IBM Documentation

Parallel Stage: Sequential File stage - IBM Documentation

Conversion Notes

For Server Jobs that use a Folder Stage as a target, S2PX will deliberately generate a Parallel Job which will compile but fail to execute successfully. This is due to an outstanding defect in the Parallel Sequential File stage implementation. For more details see the Folder Stage with input links asset query.

Structural changes

Folder stage as a source

The original Server Job using the Folder stage as an input…

is translated in the generated Parallel job to a set of stages within a local container:

This container can varies its design depending upon the options selected in the original Folder stage. The example below represent the most complex output which is for a Folder stage with two output links, sorting enabled, and the Fully qualified paths property set.

 

Folder stage as a target

The original Server Job using the Folder stage as an output…

is translated in the generated Parallel job to a set of stages within a local container:

This container design for the Folder stage as a target always follows the design pattern, regardless of how Folder stage properties are configured. These Sequential Files have the Generate multiple files write method property set and a Filter defined to remove the first column (used to store the filename) which, together, accurately replicates the original Server Job’s functionality.

 

See Parallel Job Structural Differences.

Server features not supported

Feature

Asset Query (?)

Comment

Feature

Asset Query (?)

Comment

Folder Stage not preserving new lines

Folder Stage not preserving new lines

Identify Folder stages using the ‘Preserve CRLF’ property

Folder Stage with input links

Folder Stage with input links

Identify where Folder stages will generate a solution susceptible to a defect in the DataStage Parallel environment

 

© 2015-2024 Data Migrators Pty Ltd.