Compiling DIDA from source

To compile and install DIDA in /usr/local:

$ ./configure
$ make 
$ sudo make install 

To install DIDA in a specified directory:

$ ./configure --prefix=/opt/dida
$ make 
$ sudo make install 

DIDA uses OpenMP for parallelization, which requires a modern compiler such as GCC 4.2 or greater. If you have an older compiler, it is best to upgrade your compiler if possible. If you have multiple versions of GCC installed, you can specify a different compiler:

$ ./configure CC=gcc-4.9 CXX=g++-4.9 

If you wish to build the DIDA with MPI support, MPI should be found in /usr/include and /usr/lib or its location specified to configure:

$ ./configure --with-mpi=/usr/lib/openmpi 

To run DIDA, its executables should be found in your PATH. If you installed DIDA in /opt/DIDA, add /opt/DIDA/bin to your PATH:

$ PATH=/opt/dida/bin:$PATH

To run DIDA, its executables should be found in your PATH. If you installed DIDA in /opt/DIDA, add /opt/DIDA/bin to your PATH:

$ PATH=/opt/dida/bin:$PATH

Distribute Indexing and Alignment

To align a library of paired reads named against the target named using the batch version of DIDA, run the set of following commands:

• prt –p <partition> <target>
• index <sub-target>
• dsp –p <partition> -b <bmer> <query>
• map <sub-query> <sub-target>
• mrg –p <partition> -a <aligner> -m <mode>

Example of aligning a subset of chromosome 14 reads, chr14.in, against its draft assembly, CHR14.fa,CHR14.adj on 4 nodes using DIDA+ABySS-map. To install ABySS-map from ABySS Package: http://www.bcgsc.ca/platform/bioinfo/software/abyss

#!/bin/bash

# step 1: partition target
prt –p4 CHR14.fa

# step 2: index target partitions
for i in {1..4}
do
	abyss-index mref-$i.fa
done

# step 3: dispatch reads to target partitions
dsp -p4 -b28 chr14.in

# step 4: align reads against target partitions
for i in {1..4}
do
	abyss-map -l28 –j12 --order mreads-$i.fa mref-$i.fa > aln-$i.sam
done

# step 5: merge alignments against target partitions
mrg -p4 -a abyss-map -m ord > output.sam

If we want to use bwa-mem instead of ABySS-map, we would use the same script with changes to steps 2, 4 and 5:

#!/bin/bash

# step 1: partition target
prt –p4 CHR14.fa

# step 2: index target partitions
for i in {1..4}
do
		bwa index mref-$i.fa
done

# step 3: dispatch reads to target partitions
dsp -p4 -b28 chr14.in

# step 4: align reads against target partitions
for i in {1..4}
do
		bwa mem –t12 –k28 mref-$i.fa mreads-$i.fa > aln-$i.sam
done

# step 5: merge alignments against target partitions
mrg -p4 -a bwa-mem -m ord > output.sam

Running DIDA on a cluster

DIDA integrates well with cluster job schedulers, such as: SGE (Sun Grid Engine) Portable Batch System (PBS) Load Sharing Facility (LSF) IBM LoadLeveler

For example, to submit the above DIDA job for aligning a subset of chromosome 14 reads, chr14.in, against its draft assembly, CHR14.fa,CHR14.adj on 4 nodes using DIDA+ABySS-map:

$ qsub -N dida-chr14 -pe openmpi 5 <<< 'mpirun –np 5 dida-wrapper –b28 –l28 –a abyss-map –m ord chr14.in CHR14.fa > output.sam'

DIDA has a fully streamlined version, which performs the dispatch, align, and merge steps over MPI communications. To run that version, run the command:

$ qsub -N dida-chr14 -pe openmpi 6 <<< 'mpirun –np 5 dida-mpi –l28 frag_1.fastq frag_2.fastq CHR14.fa > res-chr14.sam > output.sam'

Compatibility

Both dida-wrapper and dida-mpi require MPI libraries with support for multithreading.

dida-wrapper is known to work well with:

• MPICH 3.1.3, with configure option --enable-threads=funneled

dida-wrapper has known issues with:

• Open MPI 1.8.4, with configure option --enable-mpi-thread-multiple (deadlock issues)

Acknowledgements

This project uses the gzstream library written by Deepak Bandyopadhyay and Lutz Kettner at the Computational Geometry Group at UNC Chapel Hill (LGPL license).

Publications

DIDA

Hamid Mohamadi, Benjamin P Vandervalk, Anthony Raymond, Shaun D Jackman, Justin Chu, Clay P Breshears, Inanc Birol. DIDA: Distributed Indexing Dispatched Alignment. PLOS ONE (2015) 10(4): e0126409. 10.1371/journal.pone.0126409