Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Table of Contents

Topology Components

Jenkins Host: Where the Jenkins controller (providing build/deploy services as part of ALM) is run

...

  1. The MettleCI Workbench application running on your DataStage Engine tier needs to perform a dynamic lookup of Work items when displaying the Git Commit page.

  2. The MettleCI Workbench application running on your DataStage Engine tier needs to commit to your Git platform.

  3. The Jenkins Host and your Git repository need to communicate in order to configure Git commits to automatically trigger Jenkins pipelines. Jenkins then needs access to your Git repository to source the artefacts for build and deployment. The Jenkins pipeline definitions ('Jenkinsfiles') are themselves stored and managed in a Git repository.

  4. The Developer Workstation provides data engineers with access to your ALM tools' user interfaces via a supported web browser.

  5. The Developer Workstation provides data engineers with access to your Jenkins user interfaces via a supported web browser.

  6. The Developer Workstation provides a DataStage client tier with access to the development environment's DataStage Engine and Services tiers.

  7. Your Jenkins pipeline perform their duties via an agent installed on the MettleCI Host.

  8. The MettleCI Host requires regular access to the development environment's DataStage Engine and Services tiers, identical to that of Developer Workstations.

  9. The MettleCI Host requires regular access to the downstream test environments' DataStage Engine and Services tiers, to affect automated deployment.

Using Multiple Engines with Multiple Jenkins Agents

In real-world scenarios it’s possible that security restrictions or network zoning prohibit a single MettleCI Agent Host

Gliffy
imageAttachmentIdatt2241396737
macroIdd44bc347-fa65-443b-9f2c-187d2bb500d2
baseUrlhttps://datamigrators.atlassian.net/wiki
nameComplex Build Topology
diagramAttachmentIdatt2241134598
containerId2241003521
timestamp1656382386006

The diagram above (explained in more detail on this page) describes how you might deploy Jenkins Agents in complex multi-environment DataStage topologies.

This example employs multiple environment-specific MettleCI Agent hosts, each featuring a dedicated Jenkins Agent

This is by no means the only way to support multiple DataStage environments, but is certainly one of the easiest solutions to understand and maintain.