This repo is deprecated.
Please use Cenote-Taker 3. It's great!!
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
######### ######### ######### ######### ######### ######### ######### ######### #########
***** Before attempting set up Cenote-Taker, know that the easiest way to use it is through CyVerse: http://www.cyverse.org/discovery-environment. There you can use Cenote-Taker for free and without knowledge of command-line interface while leveraging a high performance computing cluster. The code here will require some modifications to port it to your server. If you want to set it up, please see the comments in the scripts denoted with a triple hash (###) regarding dependencies, etc. *****
Few of the complete viral genomes assembled from metagenomic deep sequencing reads have been deposited on NCBI's GenBank database, contributing to a lack of viral reference genomes available to the scientific community for analysis and comparison. The primary reasons for not depositing genomes include challenges in gene annotation, dealing with file format conversions, and determining which contigs represent complete genomes. Relatedly, the arduousness in manually curating maps of Open Reading Frames (ORFs) in novel viral genomes and contigs hinders analysis. Finally, sequences that are highly divergent from any reference genome present even greater problems in regards to ab initio gene prediction.
Cenote-Taker (a portmanteau of Cenote, a naturally occuring circular water pool, and note-taker) was designed to overcome the most challenging obstacles in high throughput viral (and plasmid) genome/sequence annotation and facilitation of GenBank deposition of annotated genomes. Cenote-Taker should work for annotation of genomes closely related to extant reference genomes, but is specifically designed for annotation of sequences that are highly divergent from known sequences.
For users interested in discovering which sequences amongst their metagenomic contigs are circular, the '-default' option can take contigs directly from de novo assembly (ideally assembled with SPADes with the '--plasmid' option), scan each sequence for terminally redundant ends (indicating a complete circular DNA molecule), and annotate all ORFs on circular sequences. Then, genome maps and submission files are created.
For users who have a set of contigs that they have already determined circularity for and 'wrapped', the options '-given_circular' or '-needs_rotation' can be submitted, depending on whether the user has rotated the contig to exclude ORFs from crossing the 'wrap point' of the genomes.
For users who have a set of linear genomes or contigs, the '-given_linear' option can be used to annotate their sequences, etc.
GenBank requires that genome submissions include metadata about each genome. Therefore, Cenote-taker gives users the opportunity to include that information to be incorporated into the output.
Note that 11 (or 12 if using '-keep_known') options are required. They must all be there and in the correct order specified here, separated by a space. (1)main mode [-default,-given_circular,-given_linear,-needs_rotation] (2) contigs in .fasta format (3) run title [one word less than 20 characters! underscores are OK] (4) isolation source/animal (5) collection date [eg 01-Jun-2016] (6) metagenome type (7) SRR number (8) SRX number (9) Biosample number (10) Bioproject number (11) template file (.sbt) for genbank (12) optional -keep_known mode, can be left blank if you don't want this If you don't have the SRA info for some samples, just put in space holder words for these options. If, for some options, you use phrases with spaces (such as isolation source) put the option in quotes like: "ocean water" If you use any of the options other than -default, and your fasta headers are longer than 20 characters, they will be trimmed to only keep the last 17 characters.
Here's an example of a command:
bash cenote-taker1.sh -default stool_rca_ps_contigs.fasta stool_dsfe_2ct "macaque stool" 09-Mar-2015 "fecal metagenome" SRR7122341 SRX4043905 SAMN09074565 PRJNA393166 template1.sbt
Also, I use 56 GB of memory and 56 CPUs on a cloud server for each run.
Make a GenBank submission template file here: https://submit.ncbi.nlm.nih.gov/genbank/template/submission/
-default option
(1) The specified .fasta file will be parsed to remove sequences less than 1000 nts.
(2) Sequences will be scanned for terminally redundant ends (circular sequences) and only sequences that are determined to be circular will be kept.
(3) Determines if circular contig has any ORFs of 80 AA or larger or else discards sequence.
(4) (optional: see '-keep_known') Uses BLASTN against GenBank 'nt' to disregard any circular sequences that are >90% identical to known sequences across a >500bp window
(5) Uses Circlator () to rotate circular contigs so that a non-intragenic start codon of one of the ORFs will be the wrap point.
-needs_rotation option
(1) The specified .fasta file of pre-wrapped circular contigs will be used for Circlator (https://github.com/sanger-pathogens/circlator) to rotate circular contigs so that a non-intragenic start codon of one of the ORFs will be the wrap point.
-given_linear or -given_circular options
(1) given .fasta file will be kept more or less as is for annotation
(1) Uses BLASTX against a custom virus + plasmid database (derived from GenBank 'nr') to guess family-level taxon of each circular sequence (note: this taxonomy method should not be considered definitive)
(2) Translates each ORF of 80 AA or larger
(3) Uses RPS-BLAST to predict function of each ORF by aligning to known NCBI Conserved Domains
(4) Generates a .tbl file of RPS-BLAST results
(5) Takes ORFs without RPS-BLAST hits and queries the GenBank viral database (predicted viruses) or nr database (predicted plasmids) with BLASTP
(6) Generates a .tbl file of BLASTP results
(7) Takes ORFs without any BLASTP hits and tries to find structural homology to known proteins using HHblits (databases: uniprot20, pdb70, scop70, pfam_31, NCBI_CD)
(8) Generates a .tbl file of HHblits results
(9) Removes ORFs within ORFs that do not contain conserved sequences
(10) Combines all .tbl files into a master .tbl file
(11) Generates a name for each virus/plasmid based on taxonomic results and nature of sample
(12) Generates properly formatted .fsa and .tbl files in a separate directory
(13) Uses tbl2asn to make gbf, val, and sqn files
Review all files and make any necessary changes before submitting to GenBank ([(https://www.ncbi.nlm.nih.gov/books/NBK53709/)]). You will submit the .sqn file. Changes made to .gbf files will NOT be reflected on the .sqn file, unfortunately. However, the .gbf file should be looked at in a sequence map viewer such as MacVector, Geneious, or Ugene (free to use).