ILRI Research Computing

User Tools

Site Tools

You are here: start » qiime2-software
qiime2-software

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
qiime2-software [2020/11/01 12:14] – aorthqiime2-software [2021/10/05 15:34] (current) – aorth
Line 4: Line 4:
 ===== Information ===== ===== Information =====
  
-  * Version: 2020.8+  * Version: 2021.8
   * Added: May, 2018   * Added: May, 2018
-  * Updated: October, 2020+  * Updated: October, 2021
   * Link: https://qiime2.org/   * Link: https://qiime2.org/
  
Line 16: Line 16:
 Load a particular version into your environment and run it: Load a particular version into your environment and run it:
  
-<code>$ module load qiime2/2020.8+<code>$ module load qiime2/2021.8
 $ qiime --help</code> $ qiime --help</code>
  
Line 24: Line 24:
 <code>$ mkdir -p /var/tmp/chroot/qiime2 <code>$ mkdir -p /var/tmp/chroot/qiime2
 $ rpm --rebuilddb --root=/var/tmp/chroot/qiime2 $ rpm --rebuilddb --root=/var/tmp/chroot/qiime2
-$ wget https://hpc.ilri.cgiar.org/mirror/centos/7/os/x86_64/Packages/centos-release-7-8.2003.0.el7.centos.x86_64.rpm +$ wget https://hpc.ilri.cgiar.org/mirror/centos/7/os/x86_64/Packages/centos-release-7-9.2009.0.el7.centos.x86_64.rpm 
-$ sudo rpm --root=/var/tmp/chroot/qiime2 -i centos-release-7-8.2003.0.el7.centos.x86_64.rpm+$ sudo rpm --root=/var/tmp/chroot/qiime2 -i centos-release-7-9.2009.0.el7.centos.x86_64.rpm
 $ sudo yum --installroot=/var/tmp/chroot/qiime2 install -y rpm-build yum wget vim $ sudo yum --installroot=/var/tmp/chroot/qiime2 install -y rpm-build yum wget vim
 $ sudo cp /etc/resolv.conf /var/tmp/chroot/qiime2/etc $ sudo cp /etc/resolv.conf /var/tmp/chroot/qiime2/etc
Line 36: Line 36:
 # eval "$(/export/apps/qiime2/conda/bin/conda shell.bash hook)" # eval "$(/export/apps/qiime2/conda/bin/conda shell.bash hook)"
 # conda update -n base conda # conda update -n base conda
-# wget https://data.qiime2.org/distro/core/qiime2-2020.8-py36-linux-conda.yml +# wget https://data.qiime2.org/distro/core/qiime2-2021.8-py38-linux-conda.yml 
-# conda env create -p /export/apps/qiime2/2020.8 --file qiime2-2020.8-py36-linux-conda.yml +# conda env create -p /export/apps/qiime2/2021.8 --file qiime2-2021.8-py38-linux-conda.yml 
-# conda activate /export/apps/qiime2/2020.8 +# conda activate /export/apps/qiime2/2021.8 
-# env > conda-qiime2-2020.8+# env > conda-qiime2-2021.8
 # exit # exit
-$ sudo mkdir -p /export/apps/qiime2/2020.8 +$ sudo mkdir -p /export/apps/qiime2/2021.8 
-$ sudo chown aorth /export/apps/qiime2/2020.8 +$ sudo chown aorth /export/apps/qiime2/2021.8 
-$ rsync -av /var/tmp/chroot/qiime2/export/apps/qiime2/2020.8/ /export/apps/qiime2/2020.8 +$ rsync -av /var/tmp/chroot/qiime2/export/apps/qiime2/2021.8/ /export/apps/qiime2/2021.8 
-$ sudo chown -R root:root /export/apps/qiime2/2020.8+$ sudo chown -R root:root /export/apps/qiime2/2021.8
 $ sudo umount /var/tmp/chroot/qiime2/dev /var/tmp/chroot/qiime2/proc /var/tmp/chroot/qiime2/sys</code> $ sudo umount /var/tmp/chroot/qiime2/dev /var/tmp/chroot/qiime2/proc /var/tmp/chroot/qiime2/sys</code>
  
-QIIME2 has over 200 dependencies and is essentially impossible to install without the use of [[https://conda.io/miniconda.html|Miniconda]] (it is not even published on PyPy anymore, so installing it with pip is not an option). My strategy is to install Conda somewhere globally and then use it to install QIIME2. After the installation is done I think we don't technically need Conda itself anymore, as all binaries seem to be linked against libraries in the qiime2/2020.8 directory. Furthermore, I first installed qiime2/2020.8 in a chroot on the local file system and then rsynced it over to the network applications directory. This is MUCH faster, but more importantly, it avoids random "permission denied" errors I was getting when installing on the network file system.+QIIME2 has over 200 dependencies and is essentially impossible to install without the use of [[https://conda.io/miniconda.html|Miniconda]] (it is not even published on PyPy anymore, so installing it with pip is not an option). My strategy is to install Conda somewhere globally and then use it to install QIIME2. After the installation is done I think we don't technically need Conda itself anymore, as all binaries seem to be linked against libraries in the qiime2/2021.8 directory. Furthermore, I first installed qiime2/2021.8 in a chroot on the local file system and then rsynced it over to the network applications directory. This is MUCH faster, but more importantly, it avoids random "permission denied" errors I was getting when installing on the network file system.
  
 To create the [[https://github.com/ilri/hpc-environment-modules/tree/master/qiime2|modulefile]] I compared the output ''env'' before and after loading the Qiime2 environment with Conda. To create the [[https://github.com/ilri/hpc-environment-modules/tree/master/qiime2|modulefile]] I compared the output ''env'' before and after loading the Qiime2 environment with Conda.
qiime2-software.txt · Last modified: by aorth