ExCL User Docs
HomeAbout
  • Introduction
  • Acknowledgment
  • System Overview
    • amundsen
    • apachepass
    • clark
    • cousteau
    • docker
    • emu
    • equinox
    • excl-us
    • explorer
    • faraday
    • Hudson
    • leconte
    • lewis
    • mcmurdo
    • Milan
    • minim1
    • Oswald
    • pcie
    • quad
    • radeon
    • snapdragon
    • thunderx
    • Triple Crown
    • Xavier
    • zenith
  • ExCl Support
    • ExCL Team
    • Frequently Encountered Problems
    • Access to ExCL
    • Contributing
    • Glossary & Acronyms
    • Requesting Access
    • Outages and Maintenance Policy
    • Backup & Storage
  • Quick-Start Guides
    • ExCL Remote Development
    • Apptainer
    • Conda and Spack Installation
    • Devdocs
    • GitHub CI
    • Gitlab CI
    • Groq
    • Julia
    • Jupyter Notebook
    • Marimo
    • Ollama
    • Open WebUI
    • Python
    • Siemens EDA
    • ThinLinc
    • Visual Studio Code
    • Vitis FPGA Development
  • Software
    • Compilers
    • ExCl DevOps: CI/CD
    • Git
    • Modules
    • MPI
  • Devices
    • BlueField-2
  • Contributing via Git
    • Git Basics
      • Git Command Line
      • Git Scenarios
    • Authoring Guide
Powered by GitBook
On this page
  • Register a Runner
  • Group Runner
  • Single Repo Runner (Project Runner)
  • List of ExCL Systems with a runner
  • Using Slurm with Gitlab CI
  • Spack and Conda with Gitlab-CI

Was this helpful?

Edit on GitHub
Export as PDF
  1. Quick-Start Guides

Gitlab CI

Getting started with Gitlab CI runners in code.ornl.gov running on ExCL systems.

PreviousGitHub CINextGroq

Last updated 21 hours ago

Was this helpful?

Register a Runner

Runners can be registered as either a group runner or for a single repository (also know as a project runner). Group runners are made available to all the repositories in a group.

Send the following information to and we will register the runner as a system runner.

  • URL

  • Registration Token

  • Executor (choose shell or docker with image)

  • Project Name (This can be group name or repo name)

  • ExCL System

  • Tag List

The method for obtaining this information differs depending on if you want to register a group runner or a single repository runner. See and sections below.

After the runner is added, you can edit the runner to change the tags and description.

Group Runner

Navigate to the group page. Click on Build → Runners. Then select New group runner and progress until you have created the runner and are provided with a command to run in the command line to register the runner. Since we use system runners instead of user runners, you will need to send this information to to get the runner registered.

Single Repo Runner (Project Runner)

Navigate to the repo page. Click on Settings → CI/CD → Runners. Then select New project runner and progress until you have created the runner and are provided with a command to run in the command line to register the runner. Since we use system runners instead of user runners, you will need to send this information to to get the runner registered.

List of ExCL Systems with a runner

Any system can be requested as a runner. These systems are already being used as a runner. (Updated October 2023)

  • docker.ftpn.ornl.gov

  • explorer.ftpn.ornl.gov

  • intrepid.ftpn.ornl.gov

  • justify.ftpn.ornl.gov

  • leconte.ftpn.ornl.gov

  • lewis.ftpn.ornl.gov

  • milan2.ftpn.ornl.gov

  • milan3.ftpn.ornl.gov

  • oswald00.ftpn.ornl.gov

  • oswald02.ftpn.ornl.gov

  • oswald03.ftpn.ornl.gov

  • pcie.ftpn.ornl.gov

  • zenith.ftpn.ornl.gov

Using Slurm with Gitlab CI

The system slurm-gitlab-runner is setup specifically to run CI jobs that then run the execution using slurm with sbatch --wait.

This template includes two helper scripts, runner_watcher.sh and slurm-tee.py.

runner_watcher.sh watches the CI job and cancels the Slurm job if the CI job is canceled or times out.

slurm-tee.py watches the slurm-out.txt and slurm-err.txt files and prints their content to std-out so that the build log can be watched from the GitLab web interface. Unlike regular less --folow, slurm-tee watches the multiple files for changes and also exits once the slurm job completes.

Spack and Conda with Gitlab-CI

.setup:
  tags: [shell]
  before_script:
    - source /auto/ciscratch/spack/share/spack/setup-env.sh
    - source /auto/ciscratch/conda/etc/profile.d/conda.sh

build:
  extends: [.setup]
  script: 
    - spack env create -d . spack.yaml
    - spack env activate .
    - spack install
    - conda create -p ./envs
    - conda activate ./envs
    - conda install pip

For a complete example and template for how to use the Slurm with GitLab in ExCL see and .

this pipeline
this template
excl-help@ornl.gov
excl-help@ornl.gov
excl-help@ornl.gov
Group Runner
Single Repo Runner (Project Runner))