CanESM Pipelines

Writing a CanESM pipeline is equivalent to creating a DAG, albeit often a large one with hundreds or thousands of nodes. Manually creating these can be cumbersome and error prone so a simplified YAML representation is provided that allows for easier composition and extension of DAG elements. This simpler representation is tailored for CanESM processing so is not as general as the DAG format and aims to be a compromise between customizability and simplicity.

• Pipeline Overview
  • setup Stage
  • Resampling Stages
  • Cycle Stages
  • rtd Stage
  • Custom Stages
  • NetCDF4 Encoding
  • Variable Attributes
• Stages
  • Variables
  • Applying Operations
• Example Radiation Pipeline
• Compose Pipelines
• Running a Pipeline
• User functions
  • Install the Package
  • Add to YAML
  • Register the Package
• Command Line Interface
  • cancproc-pipeline
  • Runner Considerations