Difference between revisions of "2. Your environment"

From IBERS Bioinformatics and HPC Wiki
Jump to: navigation, search
 
(3 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
   #$ -S /bin/sh
 
   #$ -S /bin/sh
 
   #$ -cwd
 
   #$ -cwd
   #$ -l h_rt=3600 h_vmem=16G
+
  #$ -q amd.q,large.q,intel.q
   #$ -q amd.q
+
   #$ -l h_vmem=6G
    
+
   #$ -e RnaSeq_error.e
Then, in the body of the script you should first load the appropriate modules. In the pico environment, several bioinformatics modules are ready be loaded. You need first to load two profiles containing prerequisites for some of the available software, by typing in the script:
+
  #$ -N RNASeq_experiment
module load profile/bio
+
   #$ -o RnaSeq_out.o
module load profile/advanced
+
Then, in the body of the script you should first load the appropriate modules. In the '''SGE''' environment, several bioinformatics modules are ready be loaded.  
After that, you could write Unix commands, calls to installed software, and so on. Alternatively, you can run commands and software from the command line. Unless you log in into pico using an interactive shell, the pico front end has stringent limits to the process that you run from command line. In this tutorial some short processes can be run from command line, while other requiring more resources will be run through the scheduler.
+
After that, you could write Unix commands, calls to installed software, and so on. Alternatively, you can run commands and software from the command line. Unless you log in into '''bert''' using an interactive shell, the '''bert''' front end has stringent limits to the process that you run from command line. In this tutorial some short processes can be run from command line, while other requiring more resources will be run through the scheduler.
Once you log in into the pico front end, you can load the needed profiles by typing the following commands ($ is the shell prompt, press enter after each command):
 
  $ module load profile/bio
 
  $ module load profile/advanced
 
Now all available modules are ready to be loaded.
 

Latest revision as of 15:35, 25 January 2016

In the SGE environment, a scheduler system will queue your jobs and execute them as soon as there are free nodes, based on the resources (threads, memory, etc.) that you specified. The commands for all the processes that you need to run should be written into a shell script file and submitted to the scheduler. You should open a file with a text editor (for example vi, nano or pico), and write at the beginning of the file a header similar to the following:

 #$ -S /bin/sh
 #$ -cwd
 #$ -q amd.q,large.q,intel.q
 #$ -l h_vmem=6G
 #$ -e RnaSeq_error.e
 #$ -N RNASeq_experiment
 #$ -o RnaSeq_out.o

Then, in the body of the script you should first load the appropriate modules. In the SGE environment, several bioinformatics modules are ready be loaded. After that, you could write Unix commands, calls to installed software, and so on. Alternatively, you can run commands and software from the command line. Unless you log in into bert using an interactive shell, the bert front end has stringent limits to the process that you run from command line. In this tutorial some short processes can be run from command line, while other requiring more resources will be run through the scheduler.