Difference between revisions of "Main Page"

From IBERS Bioinformatics and HPC Wiki
Jump to: navigation, search
(Slides and Talks)
(Workarounds)
(42 intermediate revisions by 10 users not shown)
Line 3: Line 3:
  
 
Welcome to the HPC Wiki for the [http://bioinformatics.ibers.aber.ac.uk Bioinformatics] research group at [http://www.aber.ac.uk Aberystwyth University]. The aim of this wiki is to allow researchers in the field of Bioinformatics in IBERS at Aberystwyth to document common tasks using the High Performance Computing cluster.
 
Welcome to the HPC Wiki for the [http://bioinformatics.ibers.aber.ac.uk Bioinformatics] research group at [http://www.aber.ac.uk Aberystwyth University]. The aim of this wiki is to allow researchers in the field of Bioinformatics in IBERS at Aberystwyth to document common tasks using the High Performance Computing cluster.
 +
 +
== Editing this Wiki ==
 +
 +
Please email ibers-cs@aber.ac.uk to ask for access to edit this wiki.
 +
 +
== Troubleshooting ==
 +
 +
Please read these sections if you are having trouble.  There is a chance that you can resolve the problem on your own and ask for help more effectively otherwise.  Some (most) of these ideas are shamelessly taken from the [https://stackoverflow.com/help/ stackoverflow help pages].
 +
 +
[[Asking for Help]]
 +
 +
== Remote Working Resources ==
 +
 +
[[VPN and SSH via central]]
 +
 +
[[Copying files with SCP/WinSCP/Filezilla/Cyberduck]]
 +
 +
[[Video conferencing and collaboration tools]]
 +
 +
[[Running graphical programs remotely]]
 +
 +
== Super Computing Wales Guides ==
 +
 +
[[SCW Introduction]]
 +
 +
[[SCW Training Materials]]
 +
 +
[[SCW Access Procedures]]
 +
  
 
== IBERS HPC Guides ==
 
== IBERS HPC Guides ==
Line 23: Line 52:
  
 
[[Module Environment]]
 
[[Module Environment]]
 +
 +
[[Installing your own modules]]
  
 
[[Submitting your job using SGE]]
 
[[Submitting your job using SGE]]
Line 33: Line 64:
  
 
[[UNIX Graphical interface]]
 
[[UNIX Graphical interface]]
 +
 +
[[Array jobs]]
  
 
[[ABySS]]
 
[[ABySS]]
 +
 +
[[Updated Scheduler]]
 +
 +
[[WinSCP from external]]
 +
 +
== Tools to access the HPC (Windows) ==
 +
 +
[[Putty]]
 +
 +
[[MobaXterm]]
 +
 +
[[Filezilla]]
  
 
== Slides and Talks ==
 
== Slides and Talks ==
  
[[File:Sge queue changes.pdf SGE Scheduler changes ]]
+
[[File:Sge queue changes.pdf]]
 +
 
 +
[[File:Containers.pdf]]
  
 
== Bioinformatics Working Group related ==
 
== Bioinformatics Working Group related ==
Line 53: Line 100:
  
 
[[SPRINT]]
 
[[SPRINT]]
 +
 +
[[Progressive Cactus]]
 +
 +
[[OrthoMCL]]
 +
 +
[[Diamond Blast]]
 +
 +
[[Singularity Containers]]
  
 
== Other Services ==
 
== Other Services ==
Line 63: Line 118:
  
 
[[Use scratch space]]
 
[[Use scratch space]]
 +
 +
== Tutorials ==
 +
 +
[[RNA Seq on HPC]]
 +
 +
[[RNA Seq on HPC (using Trinity)]]
 +
 +
[[Genome Annotation]]
 +
 +
== Tips ==
 +
 +
[[Splitting Multifastas]]
 +
 +
== Workarounds ==
 +
 +
[[Java memory allocation issues]]
 +
 +
[[convert_fasta_to_1l_fasta.sh]]´
 +
 +
[[Your software/script uses threads and works locally, but crashes if run under the SGE's queue]]
 +
 +
[[Intermittent login failures on the HPC and some VMs]]
 +
 +
[[error importing function definition for `BASH_FUNC_module']]

Revision as of 09:50, 4 May 2022

IBERS-logo-Bi.jpg


Welcome to the HPC Wiki for the Bioinformatics research group at Aberystwyth University. The aim of this wiki is to allow researchers in the field of Bioinformatics in IBERS at Aberystwyth to document common tasks using the High Performance Computing cluster.

Editing this Wiki

Please email ibers-cs@aber.ac.uk to ask for access to edit this wiki.

Troubleshooting

Please read these sections if you are having trouble. There is a chance that you can resolve the problem on your own and ask for help more effectively otherwise. Some (most) of these ideas are shamelessly taken from the stackoverflow help pages.

Asking for Help

Remote Working Resources

VPN and SSH via central

Copying files with SCP/WinSCP/Filezilla/Cyberduck

Video conferencing and collaboration tools

Running graphical programs remotely

Super Computing Wales Guides

SCW Introduction

SCW Training Materials

SCW Access Procedures


IBERS HPC Guides

Overview

Bert and Ernie - An Overview

Nodes, Cores, Slots

Scheduling and queuing

Getting an account

Using the HPC

Quick start

Your disk space

Module Environment

Installing your own modules

Submitting your job using SGE

Complex submissions

Monitoring your jobs

Available Software

UNIX Graphical interface

Array jobs

ABySS

Updated Scheduler

WinSCP from external

Tools to access the HPC (Windows)

Putty

MobaXterm

Filezilla

Slides and Talks

File:Sge queue changes.pdf

File:Containers.pdf

Bioinformatics Working Group related

Meeting minutes

Special HPC Workflows

Matlab

Blast

Active Perl

SPRINT

Progressive Cactus

OrthoMCL

Diamond Blast

Singularity Containers

Other Services

Blast2go

Best Practice

Running BLAST optimally

Use scratch space

Tutorials

RNA Seq on HPC

RNA Seq on HPC (using Trinity)

Genome Annotation

Tips

Splitting Multifastas

Workarounds

Java memory allocation issues

convert_fasta_to_1l_fasta.sh´

Your software/script uses threads and works locally, but crashes if run under the SGE's queue

Intermittent login failures on the HPC and some VMs

error importing function definition for `BASH_FUNC_module'