Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The -ignore-test-failures option determines whether any test failure will cause the mettleci compliance test command (docs) to generate a non-zero return code to the shell from which it was invoked. Some build systems, like Azure DevOps, for example, will respond to any non-zero return code as a pipeline failure (which is close to what we want) but will also fail to process any generated JUnit XML test reports, like those generated by the command. In this case, use of the -ignore-test-failures option in an Azure pipeline would allows to allow the pipeline to continue past the point of the test execution, and then configure the step processing the JUnit XML test results to class test failures as Warnings (noteworthy, but acceptable to continue processing), or Errors (critical job failures: abort the pipeline)

...