Differences

This shows you the differences between two versions of the page.

--- documentation:ml:berzelius [2022/03/28 13:16] – robing
+++ documentation:ml:berzelius [2022/09/02 14:04] (current) – external edit 127.0.0.1
@@ Line 52: / Line 52: @@
   - Create and open a recipe file using ''vim Singularity.recipe''
   - Choose an bootstrap agent that will create the base OS you want to use and add the corresponding lines to the recipe file:
-    - Bootstrap: docker
+      * Bootstrap: docker
-    - From: ubuntu:20.04
+      * From: ubuntu:20.04
+  - Create the %post section which will execute commands within the singularity container:
+      * %post
+      * apt -y update
+      * apt -y install python3
+      * apt -y install pip
+      * pip3 install --upgrade pip
+      * pip3 install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu113
+  - Add a %files section if any files are to be used by the singularity container:
+      * %files
+      * main.py /
+      * eval.py /
+      * logs/ /
+  - Specify in the %runscript section the standard script to be run:
+      * %runscript
+      * python3 main.py
+  - Create a .sif file from the recipe by running ''sudo singularity build image.sif Singularity.recipe''
+  - The script in the %runscript section can then be run with ''singularity run image.sif''
+  - Other scripts can be run using ''singularity exec image.sif python3 eval.py''
+Using .sif file on Berzelius:
+  - Upload .sif file to Berzelius using ''scp image.sif <username>@berzelius1.nsc.liu.se:/proj/<project name>/users/<username>''
+  - Also upload all needed files to the same folder on Berzelius.
+  - Log into Berzelius, request computing resources and change directory to ''/proj/<project name>/users/<username>''
+  - Run script using, for example ''singularity exec --nv image.sif python3 main.py''
   * under investigation...