Document toolboxDocument toolbox

(v4.1 2) Merge Stage escape character

Query name

Merge Stage escape character

Server Asset Type

Merge stage

Analysis Type

Coverage

Description

Template

Issue

The Server Merge Stage has a property to specify an escape character for files it is reading from. This functionality will not be supported in the converted job due to the fact that Parallel Sequential File stages do not support escape characters. This may cause unexpected behaviour in converted jobs when processing data containing escape characters.

Actions

Possible remediations:

  • Replace generated Sequential File stage with an External Source stage which translates the offending character.

  • Investigate the potential use of environment variable APT_IMPORT_FORCE_QUOTE_DELIM which can be used to enforce that closing quotes in the data will only be recognised if followed immediately by the delimiter character.


See also

© 2015-2024 Data Migrators Pty Ltd.