ExCL User Docs
About
Search
⌃K
Links

Jupyter Notebook

Getting started with Jupyter Notebook.

Accessing a Jupyter Notebook Running on ExCL

A Jupyter notebook server running on ExCL can be accessed via a local web browser through port forwarding the Jupyter notebook's port. By default, this is port 8888 (or the next available port). This port might be in use if someone else is using running a notebook. You can specify the port with the --port flag when launching the Jupyter notebook. To use a different port just replace 8888 with the desired port number. In order to port forward from an internal node, you have to port forward twice, once from your machine to login.excl.ornl.gov and once again from the login node to the internal node (i.e. pcie).

Detailed instructions for Linux/Mac

These instructions go over how to access a Jupyter notebook running on the pcie node in the ExCL Cluster. If you want to access a different system, then replace pcie with the system you want to access.
  1. 1.
    Specify the ports that you want to use. Choose a different number from the default so that you don't conflict with other users.
    export REMOTE_PORT=8888
    export LOCAL_PORT=8888
  2. 2.
    From your local machine connect to pcie using login.excl.ornl.gov as a proxy and local forward the jupyter port.
    ssh -L $LOCAL_PORT:localhost:$REMOTE_PORT -J [email protected] [email protected]
  3. 3.
    (Optional) Load the anaconda module if you don't have jupyter notebook installed locally.
    module load anaconda3
  4. 4.
    Launch the Jupyter server on pcie
    export REMOTE_PORT=8888
    jupyter notebook --port $REMOTE_PORT
  5. 5.
    Connect to the Jupyter notebook using a web browser on your local machine. Use the token shown in the output from running the Jupyter server. Url: http://localhost:<local_port>/?token=<token>. You can also configure jupyter to use a password with jupyter notebook password if you don't want to use the access tokens.
If you ssh client is too old for proxyjump to work, you can always break up the process into anouther step.
  1. 1.
    From your local machine connect to login.excl.ornl.gov and local port forward port 8888.
    $ ssh -L 8888:localhost:8888 <username>@login.excl.ornl.gov
  2. 2.
    From the login node connect to pcie and local port forward port 8888
    $ ssh -L 8888:localhost:8888 pcie
  3. 3.
    Launch the Jupyter server on pcie
    $ jupyter notebook
  4. 4.
    Connect to the Jupyter notebook using a web browser on your local machine. Use the token shown in the output from running the Jupyter server. Url: http://localhost:8888/?token=<token>

Detailed instructions for Windows with MobaXterm

These instructions go over how to access a Jupyter notebook running on the pcie node in the ExCL Cluster.
  1. 1.
    From your local machine connect to login.excl.ornl.gov using MobaXterm.
    MobaXTerm SSH
  2. 2.
    Go to tools and click on MobaSSHTunnel. Use MobaSSHTunnel local forward port 8888.
    Click on MobaSSHTunnel
    Click on MobaSSHTunnel
    Click on New SSH Tunnel
    Click on New SSH Tunnel
    Local port forward 8888
    Local port forward 8888
    Click the play button to start port forwarding
    Click the play button to start port forwarding
  3. 3.
    From the login node connect to pcie and local port forward port 8888
    $ ssh -L 8888:localhost:8888 pcie
  4. 4.
    Launch the Jupyter server on pcie
    $ jupyter notebook
  5. 5.
    Connect to the Jupyter notebook using a web browser on your local machine. Use the token shown in the output from running the Jupyter server. URL: http://localhost:8888/?token=<token>

Detailed instructions for Windows with Visual Studio Code

These instructions go over how to access a Jupyter notebook running on the quad00 node in the ExCL Cluster using Visual Studio Code to handle port forwarding.
  1. 1.
    Open Visual Studio Code
  2. 2.
    Make sure you have the Remote - SSH extension installed.
    SSH Extension VS Code
  3. 3.
    Setup .ssh
    Navigate to the remote explorer settings.
    Navigate to the remote explorer settings.
    Chose the user .ssh config.
    Chose the user .ssh config.
    Add the remote systems to connect to with the proxy command to connect through the login node.
    Add the remote systems to connect to with the proxy command to connect through the login node.
  4. 4.
    Connect to the remote system and open the Jupyter folder.
    Connect step 1
    Open Folder
    Open Folder
  5. 5.
    Run the Jupyter notebook using the built-in terminal.
    Run Jupyter
  6. 6.
    Open the automatically forwarded port.
    Open Port

Using the already installed Anaconda

Anaconda3 is already installed in ExCL as a module and can be used to run Jupyter notebooks. To load the module use module load anaconda3. Now you have access to the jupyter notebook command.

Installing Jupyter Notebook with Anaconda

This section is a quick start to installing an anaconda python environment with Jupyter notebook.
  1. 1.
    Follow Conda and Spack Installation to install Conda.
  2. 2.
    Install Jupyter Notebook.
    $ conda install -c conda-forge notebook

Jupyter with conda environments

Create conda environment and activate it. Then install ipykernel and then install the kernel for use in Jupyter.
conda install ipykernel
ipython kernel install --user --name=<any_name_for_kernel>
Use jupyter kernelspec list to view all the installed Jupyter kernels.
jupyter kernelspec list
To uninstall a Jupyter kernel use uninstall.
jupyter kernelspec uninstall <unwanted-kernel>
Quick-Start Guides - Previous
Conda and Spack Installation
Next - Quick-Start Guides
Vitis FPGA Development
Last modified 5mo ago