Difference between revisions of "Main Page"
(→Access) |
m (Removed link to original documentation) |
||
| (6 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
| + | <div style='text-align: center;'>CZ.02.2.69/0.0/0.0/17_044/0008562</div> | ||
| + | <div style='text-align: center;'>Podpora rozvoje studijního prostředí na Univerzitě Karlově - VRR</div> | ||
| + | [[File:OP_VVV_logo.jpg|frameless|center|upright=2.5]] | ||
| + | |||
== Welcome to AIC == | == Welcome to AIC == | ||
| − | AIC (Artificial Intelligence Cluster) is a computational grid with | + | AIC (Artificial Intelligence Cluster) is a computational grid with sufficient computational capacity for research in the field of [https://en.wikipedia.org/wiki/Deep_learning deep learning] using both CPU and GPU. It was built on top of [https://arc.liv.ac.uk/trac/SGE SGE] scheduling system. MFF students of Bc. and Mgr. degrees can use it to run their experiments and learn the proper ways of grid computing in the process. |
=== Access === | === Access === | ||
| Line 8: | Line 12: | ||
=== Basic HOWTO === | === Basic HOWTO === | ||
| − | Following HOWTO is meant to provide only a simplified overview of the cluster usage. It is strongly recommended to read some further documentation before running some serious experiments. | + | Following HOWTO is meant to provide only a simplified overview of the cluster usage. It is strongly recommended to read some further documentation ([[Submitting_CPU_Jobs|CPU]] or [[Submitting_GPU_Jobs|GPU]]) before running some serious experiments. |
| + | More serious experiments tend to take more resources. In order to avoid unexpected failures please make sure your [[Quotas|quota]] is not exceeded. | ||
Suppose we want to run some computations described by a script called <code>job_script.sh</code>: | Suppose we want to run some computations described by a script called <code>job_script.sh</code>: | ||
| Line 18: | Line 23: | ||
| − | We need to ''submit'' the job to the grid which is done by logging on the submit host <code>aic.ufal.mff.cuni.cz</code> and issuing the command <code>qsub -cwd -j y job_script.sh Hello World</code> | + | We need to ''submit'' the job to the grid which is done by logging on the submit host <code>aic.ufal.mff.cuni.cz</code> and issuing the command:<br> |
| + | <code>qsub -cwd -j y job_script.sh Hello World</code> | ||
This will enqueue our ''job'' to the default ''queue'' which is <code>cpu.q@*</code>. The scheduler decides which particular machine in the specified queue has ''resources'' needed to run the job. Typically we will see a message which tells us the ID of our job (82 in this example): | This will enqueue our ''job'' to the default ''queue'' which is <code>cpu.q@*</code>. The scheduler decides which particular machine in the specified queue has ''resources'' needed to run the job. Typically we will see a message which tells us the ID of our job (82 in this example): | ||
Revision as of 12:13, 29 January 2020
Welcome to AIC
AIC (Artificial Intelligence Cluster) is a computational grid with sufficient computational capacity for research in the field of deep learning using both CPU and GPU. It was built on top of SGE scheduling system. MFF students of Bc. and Mgr. degrees can use it to run their experiments and learn the proper ways of grid computing in the process.
Access
AIC is dedicated to UFAL students who will get an account if requested by authorized lector.
Basic HOWTO
Following HOWTO is meant to provide only a simplified overview of the cluster usage. It is strongly recommended to read some further documentation (CPU or GPU) before running some serious experiments. More serious experiments tend to take more resources. In order to avoid unexpected failures please make sure your quota is not exceeded.
Suppose we want to run some computations described by a script called job_script.sh:
#!/bin/bash echo "This is just a test." echo "printing parameter1: $1" echo "prinitng parameter2: $2"
We need to submit the job to the grid which is done by logging on the submit host aic.ufal.mff.cuni.cz and issuing the command:
qsub -cwd -j y job_script.sh Hello World
This will enqueue our job to the default queue which is cpu.q@*. The scheduler decides which particular machine in the specified queue has resources needed to run the job. Typically we will see a message which tells us the ID of our job (82 in this example):
Your job 82 ("job_script.sh") has been submitted
The basic options used in this example are:
-cwd- the script is executed in the current directory (the default is your$HOME)-j y- stdout and stderr outputs are merged and redirected to a file (job_script.sh.o82)
We have specified two parameters Hello and World. The output of the script will be located in your $HOME directory after the script is executed. It will be merged with stderr and it should look like this:
AIC:ubuntu 18.04: SGE 8.1.9 configured... This is just a test. printing parameter1: Hello prinitng parameter2: World ======= EPILOG: Tue Jun 4 12:41:07 CEST 2019 == Limits: == Usage: cpu=00:00:00, mem=0.00000 GB s, io=0.00000 GB, vmem=N/A, maxvmem=N/A == Duration: 00:00:00 (0 s) == Server name: cpu-node13
