Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
| documentation:ml:berzelius [2022/03/28 13:03] – robing | documentation:ml:berzelius [2022/09/02 14:04] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 11: | Line 11: | ||
| - After every step you will receive an email from supr@supr.snic.se. Read the emails carefully, they will tell you what to do next. | - After every step you will receive an email from supr@supr.snic.se. Read the emails carefully, they will tell you what to do next. | ||
| - At some point you will have to write a small project proposal: https:// | - At some point you will have to write a small project proposal: https:// | ||
| - | - - Go to Rounds page. | + | |
| - | | + | - In the sub-menu, select AI/ML and then select LiU Berzelius. |
| - | | + | - Create the proposal for getting computation time on Berzelius. |
| - You will get a confirmation email from snic.se and NSC Berzelius and later a confirmation email that your project was accepted. | - You will get a confirmation email from snic.se and NSC Berzelius and later a confirmation email that your project was accepted. | ||
| - To access Berzelius a login account is needed: | - To access Berzelius a login account is needed: | ||
| Line 20: | Line 20: | ||
| - Wait for your account to be created. | - Wait for your account to be created. | ||
| - When your account is ready you will receive an email instructing you to choose a password. | - When your account is ready you will receive an email instructing you to choose a password. | ||
| - | - Follow the guidelines in the emails. At some point you will have to accept another user agreement for using Berzelius. Once accepted your account is created. | ||
| - https:// | - https:// | ||
| - Before you can log in you need a 2-Factor Authorization (2FA): https:// | - Before you can log in you need a 2-Factor Authorization (2FA): https:// | ||
| Line 47: | Line 46: | ||
| ==== Working with Singularity ==== | ==== Working with Singularity ==== | ||
| + | |||
| + | Install Singularity by following this guide: https:// | ||
| + | |||
| + | Creating a simple Singularity image using a recipe file: https:// | ||
| + | - Create and open a recipe file using '' | ||
| + | - Choose an bootstrap agent that will create the base OS you want to use and add the corresponding lines to the recipe file: | ||
| + | * Bootstrap: docker | ||
| + | * From: ubuntu: | ||
| + | - Create the %post section which will execute commands within the singularity container: | ||
| + | * %post | ||
| + | * apt -y update | ||
| + | * apt -y install python3 | ||
| + | * apt -y install pip | ||
| + | * pip3 install --upgrade pip | ||
| + | * pip3 install torch torchvision torchaudio --extra-index-url https:// | ||
| + | - Add a %files section if any files are to be used by the singularity container: | ||
| + | * %files | ||
| + | * main.py / | ||
| + | * eval.py / | ||
| + | * logs/ / | ||
| + | - Specify in the %runscript section the standard script to be run: | ||
| + | * %runscript | ||
| + | * python3 main.py | ||
| + | - Create a .sif file from the recipe by running '' | ||
| + | - The script in the %runscript section can then be run with '' | ||
| + | - Other scripts can be run using '' | ||
| + | |||
| + | Using .sif file on Berzelius: | ||
| + | - Upload .sif file to Berzelius using '' | ||
| + | - Also upload all needed files to the same folder on Berzelius. | ||
| + | - Log into Berzelius, request computing resources and change directory to ''/ | ||
| + | - Run script using, for example '' | ||
| * under investigation... | * under investigation... | ||