Folder Stage
Summary
The Folder Stage reads data from or writes data to one or more files in a directory.
IBM documentation
Server Stage: Folder Stage - IBM Documentation
Parallel Stage: Sequential File stage - IBM Documentation
Conversion Notes
For Server Jobs that use a Folder Stage as a target, S2PX will deliberately generate a Parallel Job which will compile but fail to execute successfully. This is due to an outstanding defect in the Parallel Sequential File stage implementation. For more details see the Folder Stage with input links asset query.
Structural changes
Folder stage as a source
The original Server Job using the Folder stage as an input…
is translated in the generated Parallel job to a set of stages within a local container:
This container can varies its design depending upon the options selected in the original Folder stage. The example below represent the most complex output which is for a Folder stage with two output links, sorting enabled, and the Fully qualified paths property set.
Folder stage as a target
The original Server Job using the Folder stage as an output…
is translated in the generated Parallel job to a set of stages within a local container:
This container design for the Folder stage as a target always follows the design pattern, regardless of how Folder stage properties are configured. These Sequential Files have the Generate multiple files write method property set and a Filter defined to remove the first column (used to store the filename) which, together, accurately replicates the original Server Job’s functionality.
See Parallel Job Structural Differences.
Server features not supported
Feature | Asset Query (?) | Comment |
---|---|---|
Folder Stage not preserving new lines | Identify Folder stages using the ‘Preserve CRLF’ property | |
Folder Stage with input links | Identify where Folder stages will generate a solution susceptible to a defect in the DataStage Parallel environment |
© 2015-2024 Data Migrators Pty Ltd.