Cluster Computing with VS Code

https://d24h-my.sharepoint.com/:b:/g/personal/cklam_d24h_hk1/EZvsCUQP62hMp5geymIhMiQBhtQlkZC_fmcul9SHPpwEfQ?e=cZnWXo

In d24H server

1. submit an interactive job

2. configure the remote ssh to access to the assigned node

3.start a new section in vscode and connect to the compute node

Connect to the jupyter lab

1. open jupyter lab. There are bascially 2 ways to open a jupyter lab

   • Apply for an interactive node and then host your jupyter lab
   • To keep a node in the cluster occupied and avoid queuing for an interactive job, submit a Jupyter Lab job that runs continuously. However, there are also drawbacks to this approach. 1️⃣, it will occupy a node even when you are not executing any command, which wastes computational resources. 2️⃣, if you need to make changes to the Jupyter Lab instance you are currently running, you will need to stop the job and submit a new one.

2. connect to the head server with listen to hn001

   ssh -L 8811:localhost:8811 [email protected] -p 24022
   

3. jump to the compute node with listen to gn002

   ssh -L 8811:localhost:8811 wergillius@hpc-gn002