Testing effects of missing data on phylogenetic inferences
All code within the MissingDataFX v0.1.1 repository is available "AS IS" under a generous 3-Clause BSD license. See the LICENSE file for more information.
If you use scripts from this repository as part of your published research, I require that you cite the repository as follows (also see DOI information below):
- Bagley, J.C. 2017. MissingDataFX v0.1.1. GitHub repository, Available at: http://github.com/justincbagley/MissingDataFX.
Alternatively, please provide the following link to this software repository in your manuscript:
The DOI for MissingDataFX v0.1.1, via Zenodo, is as follows: 
Bagley, J.C. 2017. MissingDataFX v0.1.1. GitHub package, Available at: http://doi.org/10.5281/zenodo.398992.
"The long term goal of phylogenetics, both neontological and paleontological, is to reconstruct an accurate phylogeny for all species of living and fossil organisms. The problem of missing data has been considered to be the major obstacle to accurately reconstructing the phylogeny of fossil taxa and their relationships to living taxa. Recent simulation studies show that there is not a single missing data problem... there are potentially two problems... Adding incomplete taxa ...[and] adding incomplete characters ... Identifying the mechanisms that may cause incomplete taxa and characters to be problematic is an important step in devising effective solutions." - Wiens (2003)
"As fossil taxa will necessarily introduce a large proportion of missing data in any combined data set (Wiens 2009), the impact of these absent characters on branch length estimation and support may be substantial. In particular, the interaction between among partition rate variation and missing data may negatively affect phylogenetic inference (Lemmon et al. 2009). Additionally, heterogeneity in evolutionary rates between the morphological characters may also affect estimated branch lengths (Clarke and Middleton 2008)." - Pyron (2011)
Missing data is an important consideration in the theory and practice of phylogenetic systematics, as well as the design of phylogenetics studies (Wiens 2003; Wiens et al. 2005; Wiens 2006; Pyron 2011). This software automates exploratory analyses calculating the amount of missing data in phylogenetic datasets (NEXUS character partitions), as well as testing the form and potential significance of relationships between missing characters and phylogenetic tree parameters. Parts of MissingDataFX were inspired by, and recreate, correlational/exploratory analyses of the effects of missing data on phylogenies used previously by Wiens et al. (2005) and Pyron (2011). I wrote MissingDataFX code to help me automate these and related analyses for a recent project on molecular phylogenetics and Bayesian total-evidence dating, as well as the effects of missing data on phylogenetic results, in 'sucker' fishes of the family Catostomidae (Bagley et al., in revision).
The current version of this software focuses on developing MissingDataFX.sh, a shell script that looks at potential effects of missing data on phylogenetic analyses in two basic ways: 1) by characterizing the contents of data blocks in a NEXUS input file, including proportions of data versus missing data for each partition, and 2) by performing a customized R analysis. Three main operations are performed in the R environment: a) extracting tree parameters (terminal branch lengths, terminal/subtending branch heights, posterior support) from BEAST or MrBayes trees generated from the input NEXUS; b) using appropriate standard or nonparametric tests for correlations between missing data proportions and the tree parameters; and c) plotting relationships among variables. More details are given below.
As in the case of the author's software package for phylogenetic and phylogeographic inference, PIrANHA, the MissingDataFX package is fully command line-based and is available as open-source software according to the license.
Code in the MissingDataFX repository depends on R and a series of R packages, as follows:
- The R software environment
- available from download mirrors from The Comprehensive R Archive Network (CRAN), such as https://cloud.r-project.org
- tools - a default R package with "base" priority
- ape
- ips
- phytools
- phangorn
💻 MissingDataFX uses UNIX shell and R scripts, thus runs on a variety of operating systems, but was especially designed with UNIX/LINUX-like systems in mind. MissingDataFX code should run "out-of-the-box" from most any folder on your machine. To 'install' MissingDataFX, download the repository, move into the repository folder and enter $ chmod u+x ./*.sh into the command line interface (e.g. Terminal app on Mac). This changes file mode bits in the .sh files to allow the user permission to access and execute them, which is an important prerequisite for the MissingDataFX code to run.
Ideally, users will run MissingDataFX on multiple NEXUS-tree file combinations. For example, you might be interested in running on 1) mtDNA sequences only, 2) nuclear DNA sequences only, 3) morphological characters only, and 4) all data combined--or a 'combined data' (mtDNA + nuclear) or 'total-evidence' (sequence + morphology) matrix and tree. Each of these analyses would be run within a separate sub-folder in the master distro folder.
- MissingDataFX.sh script (copy/paste into dir)
- Input NEXUS file
- Input BEAST or MrBayes tree file
- Optional 'drop file' (one per tree file)
Please follow the guidelines below when constructing input files for analysis.
For the NEXUS input file, we assume that there are no spaces or special characters in the filename (though underscores are OK), and that the file contains only DNA sequences or morphological data in simplified NEXUS format--i.e. header followed by a matrix block, and no subsequent data/info blocks (e.g. sets or MrBayes blocks; these must be removed). The input NEXUS may combine morphological and DNA sequence characters and it doesn't matter how these are specified after FORMAT DATATYPE (so long as DATATYPE input sits on a single line); for example, FORMAT DATATYPE=mixed(standard:1-100,DNA:101-5000) interleave=yes gap=- missing=? and FORMAT DATATYPE=DNA interleave=yes gap=- missing=? are both fine. However, if one or more morphological data blocks are included in the NEXUS, then users must NOT include a 'CharStateLabels' or 'CHARACTERS' block in the file, or there will be issues. Prior to running MissingDataFX, users should check their input NEXUS filenames and contents to ensure that they meet these assumptions.
Regarding tree files, let me say I'm very much a Bayesian, and my empirical research focuses frequently entails making model-based inferences in phylogenetics and phylogeography based on Bayesian or approximate Bayesian computation (e.g. ABC, hABC) methods (see my Research, Publications, and ResearchGate pages). Thus, it's no surprise that the initial development offering of MissingDataFX Only provides support for Bayesian phylogenetic trees. Accepted tree files include BEAST maximum clade credibility (MCC) trees annotated with posterior parameter distributions in TreeAnnotator, and MrBayes consensus tree files generated by running sumt command (only tested with version 3.2+). Multiple tree file extensions are supported; however, ...
- You may use any MrBayes consensus tree file with the default '.con.tre' extension, or you may change the extension to '.tree'.
- By contrast, users must rename any BEAST tree file with '.out' (TreeAnnotator) extension to have the extension '.tree' instead.
Optional 'drop files' are files the user creates in a text editor that contain a list of taxa (with names exactly matching taxon labels in the NEXUS and tree files), with one taxon name per line followed by an empty line, and saved with '.drop' file extensions. Drop files specify taxa to be pruned from the phylogeny in R prior to further analyses. Drop files provide additional flexibility to the analysis, and they are handy when the user would like to exclude certain taxa, for example a) extinct taxa or b) taxa with low or high amounts of missing data. Why extinct taxa? Some BEAST or MrBayes trees may result from analyses including extinct taxa as tips, e.g. tip-dating analyses (Pyron 2011) or Bayesian total-evidence dating using fossilized birth-death (FBD) models (Heath et al. 2014). In such cases, the extinct taxa usually have tip dates older than a few hundred to thousands of years ago (>300-1000 yr BP), and this produces a set of non-contemporaneous tips in resulting phylogenies--enough to majorly effect the distribution of branch lengths (especially with more than just a 1-5 extinct taxa). Remember:
- Drop files are optional. MissingDataFX will run just fine whether they are included or not.
- At present, there can only be one '.drop' file and one tree file per input NEXUS analyzed in MissingDataFX. So, if you want to analyze two NEXUS files with only one corresponding Bayesian tree file (e.g. you're running different alignments from a partitioned Bayesian analysis that yielded a single MrBayes or BEAST tree), then the tree file MUST be duplicated and given separate names matching each NEXUS, and sets of files for each analysis should be run in separate sub-folders, as per 'Run directory structure' section above.
For simplicity, all filenames supplied to MissingDataFX for a given analysis should have the same basename. A suitable set of files for analysis might look like the following example, where MY_BASENAME is the basename applied to all of the files:
| Input file type | Example filename |
|---|---|
| NEXUS file | MY_BASENAME.nex |
| Tree file | MY_BASENAME.tree (BEAST, MrBayes), OR MY_BASENAME.con.tre (MrBayes) |
| Drop file | MY_BASENAME.drop |
We use this naming convention so that the tree filenames can be linked to the original NEXUS input file(s) without conflicting with the NEXUS filenames used in other procedures used in the shell script.
Following several steps summarizing the NEXUS input file using operations in the shell, MissingDataFX.sh creates and runs a customized R script that loads the 'Interfaces to Phylogenetic Software in R' or 'ips' R package (plus my fixed version of one of its functions) and related phylogenetics packages, and then reads in the tree, plots the tree (and saves to file), extracts the node and branch length annotations into a matrix (also saved to file). Next, Shapiro-Wilk tests are conducted to evaluate whether the log-transformed data and tree parameters meet normality criteria for subsequent analyses. Then MissingDataFX tests for correlations between the proportions of data or missing data and (y-axis/independent var.:) posterior support for terminal taxa and length of terminal branch (same as height estimate for terminal taxon tmrca/node, in case of BEAST chronograms). If the data are normal (Shapiro-Wilk tests were non-significant at the alpha = 0.05 level), regular Pearson correlations and generalized linear modeling analyses are conducted. However, if the data are non-normal (Shapiro-Wilk tests were significant), then correlations are conducted using nonparametric Spearman's rank correlation coefficient and linear relationships among log-transformed variables are plotted, but not given trendlines. Results are output to file in text or PDF (graphics) files.
It's so easy to use, the MissingDataFX.sh script doesn't display any sophisticated Usage or help flag info yet, because it doesn't need to! Everything you need to know is given here in the README! Assuming that you have installed the dependencies and the repo and followed guidelines for input files above, you may run MissingDataFX by simply entering the script name at the command line and hitting return!
$ ./MissingDataFX.sh
Note that there are two basic types of MissingDataFX runs, in practice: "regular" runs, and "repeat" runs. These are discussed next with screen output examples.
Under normal conditions, MissingDataFX.sh runs without any errors. Here is an example of what output to screen would look like for a normal MissingDataFX analysis including a NEXUS file and a MrBayes tree file with '.tree' extension, and no drop file:
$ ./MissingDataFX.sh
##########################################################################################
# MissingDataFX v0.1.1, March 2017 #
##########################################################################################
INFO | Wed Mar 15 15:04:03 CDT 2017 | Starting MissingDataFX analysis...
INFO | Wed Mar 15 15:04:03 CDT 2017 | STEP #1: SETUP AND USER INPUT.
INFO | Wed Mar 15 15:04:03 CDT 2017 | Setting working directory to: /GitHub/MissingDataFX-master/regular_test
INFO | Wed Mar 15 15:04:03 CDT 2017 | Reading in input NEXUS file(s)...
INFO | Wed Mar 15 15:04:03 CDT 2017 | STEP #2: PROCESSING INPUT NEXUS, SPLITTING TAXON LABELS AND DATA BLOCKS INTO SEPARATE FILES.
INFO | Wed Mar 15 15:04:03 CDT 2017 | Catostomidae_4loci_new_forMrBayes.NEX
INFO | Wed Mar 15 15:04:03 CDT 2017 | STEP #3: USING TAXON LABEL AND CONCATENATED SEQUENCE FILES GENERATED DURING PREVIOUS STEP TO CREATE ONE
INFO | Wed Mar 15 15:04:03 CDT 2017 | FILE WITH MISSING DATA COUNTS AND PROPORTIONS FOR EACH INDIVIDUAL.
INFO | Wed Mar 15 15:04:04 CDT 2017 | STEP #4: PRE-PROCESSING MRBAYES CONSENSUS TREE INPUT FILE, IF PRESENT: SPLIT .con.tre FILE, EXTRACT
INFO | Wed Mar 15 15:04:04 CDT 2017 | TERMINAL BRANCH LENGTHS & THEIR CONFIDENCE INTERVALS, AND CREATE BRANCH LENGTH SUMMARY TABLE.
INFO | Wed Mar 15 15:04:04 CDT 2017 | Found '.con.tre' file. Reading in MrBayes consensus tree from current working directory...
INFO | Wed Mar 15 15:04:04 CDT 2017 | Running mbTreeStatMiner script...
INFO | Wed Mar 15 15:04:04 CDT 2017 | STEP #5: MAKE R SCRIPT THAT A) EXTRACTS PARAMETER ESTIMATES FROM BEAST TREES OR READS IN MRBAYES DATA
INFO | Wed Mar 15 15:04:04 CDT 2017 | TABLE (STEP #3) IN WORKING DIR THEN B) TESTS FOR IMPACT OF MISSING DATA ON PHYLO SUPPORT AND BRANCH LENGTHS.
INFO | Wed Mar 15 15:04:04 CDT 2017 | STEP #6: RUN THE R SCRIPT (WHICH ALSO SAVES RESULTS TO FILE).
INFO | Wed Mar 15 15:04:10 CDT 2017 | STEP #7: CLEANUP: ORGANIZE RESULTS, REMOVE UNNECESSARY FILES.
INFO | Wed Mar 15 15:04:10 CDT 2017 | R workspace file confirmed in dir: /GitHub/MissingDataFX-master/regular_test
INFO | Wed Mar 15 15:04:11 CDT 2017 | STEP #8: TEST RUN OUTPUT USING MDFXTester:
### RUNNING MDFXTester.sh ###
DO GRAPHICS CHECK ON BASIC SCATTERPLOTS FROM R; IF FAILED, DO fetchTaxonLabels.sh FIX
AND COMPLETELY RERUN MissingDataFX SCRIPT.
Passed graphics check. Moving on...
INFO | Wed Mar 15 15:04:11 CDT 2017 | Done analyzing the amount and potential effects of missing data on phylogenetic support and branch
INFO | Wed Mar 15 15:04:11 CDT 2017 | lengths using MissingDataFX.
INFO | Wed Mar 15 15:04:11 CDT 2017 | Bye.
Under error conditions, specifically when there are "No such file or directory" errors on sed and rm calls for '*_taxonLabels.txt' files under STEP #3, this causes the final data files and R script graphics NOT to be generated. This was a bug in the previous/major version zero release. In the current release, I have fixed this problem by planning a "repeat run" scenario. I did this by adding scripts that check the initial MissingDataFX.sh run output (MDFXTester.sh), fix the problem by creating a "*_taxonLabels.txt" file (fetchTaxonLabels.sh), and then re-run MissingDataFX.sh on the sub-folder contents, completely from scratch! Although not a particularly elegant solution, it works until I have time to overcome the need to re-run the main script!!
Here is an example of what output to screen would look like during a "repeat run" of MissingDataFX:
$ ./MissingDataFX.sh
##########################################################################################
# MissingDataFX v0.1.1, March 2017 #
##########################################################################################
INFO | Wed Mar 15 14:52:56 CDT 2017 | Starting MissingDataFX analysis...
INFO | Wed Mar 15 14:52:56 CDT 2017 | STEP #1: SETUP AND USER INPUT.
INFO | Wed Mar 15 14:52:56 CDT 2017 | Setting working directory to: /GitHub/MissingDataFX-master/repeat_test
INFO | Wed Mar 15 14:52:56 CDT 2017 | Reading in input NEXUS file(s)...
INFO | Wed Mar 15 14:52:56 CDT 2017 | STEP #2: PROCESSING INPUT NEXUS, SPLITTING TAXON LABELS AND DATA BLOCKS INTO SEPARATE FILES.
INFO | Wed Mar 15 14:52:56 CDT 2017 | CatmtDNAonly_NoMt23_part_run1.nex
INFO | Wed Mar 15 14:52:56 CDT 2017 | STEP #3: USING TAXON LABEL AND CONCATENATED SEQUENCE FILES GENERATED DURING PREVIOUS STEP TO CREATE ONE
INFO | Wed Mar 15 14:52:56 CDT 2017 | FILE WITH MISSING DATA COUNTS AND PROPORTIONS FOR EACH INDIVIDUAL.
sed: CatmtDNAonly_NoMt23_part_run1_taxonLabels.txt: No such file or directory
rm: CatmtDNAonly_NoMt23_part_run1_taxonLabels.txt: No such file or directory
INFO | Wed Mar 15 14:52:56 CDT 2017 | STEP #4: PRE-PROCESSING MRBAYES CONSENSUS TREE INPUT FILE, IF PRESENT: SPLIT .con.tre FILE, EXTRACT
INFO | Wed Mar 15 14:52:56 CDT 2017 | TERMINAL BRANCH LENGTHS & THEIR CONFIDENCE INTERVALS, AND CREATE BRANCH LENGTH SUMMARY TABLE.
INFO | Wed Mar 15 14:52:56 CDT 2017 | Found '.con.tre' file. Reading in MrBayes consensus tree from current working directory...
INFO | Wed Mar 15 14:52:56 CDT 2017 | Running mbTreeStatMiner script...
INFO | Wed Mar 15 14:52:57 CDT 2017 | STEP #5: MAKE R SCRIPT THAT A) EXTRACTS PARAMETER ESTIMATES FROM BEAST TREES OR READS IN MRBAYES DATA
INFO | Wed Mar 15 14:52:57 CDT 2017 | TABLE (STEP #3) IN WORKING DIR THEN B) TESTS FOR IMPACT OF MISSING DATA ON PHYLO SUPPORT AND BRANCH LENGTHS.
INFO | Wed Mar 15 14:52:57 CDT 2017 | STEP #6: RUN THE R SCRIPT (WHICH ALSO SAVES RESULTS TO FILE).
INFO | Wed Mar 15 14:53:02 CDT 2017 | STEP #7: CLEANUP: ORGANIZE RESULTS, REMOVE UNNECESSARY FILES.
usage: mv [-f | -i | -n] [-v] source target
mv [-f | -i | -n] [-v] source ... directory
INFO | Wed Mar 15 14:53:02 CDT 2017 | R workspace file confirmed in dir: /GitHub/MissingDataFX-master/repeat_test
usage: mv [-f | -i | -n] [-v] source target
mv [-f | -i | -n] [-v] source ... directory
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #8: TEST RUN OUTPUT USING MDFXTester:
### RUNNING MDFXTester.sh ###
DO GRAPHICS CHECK ON BASIC SCATTERPLOTS FROM R; IF FAILED, DO fetchTaxonLabels.sh FIX
AND COMPLETELY RERUN MissingDataFX SCRIPT.
find: ../R_results/: No such file or directory
WARNING! FAILED graphics check. Running fetchTaxonLabels script, then re-running MissingDataFX.sh...
### RUNNING fetchTaxonLabels.sh ###
Setting working directory to dir:
/GitHub/MissingDataFX-master/repeat_test
Reading in input NEXUS file(s)...
Making a taxonLabels file for taxa in CatmtDNAonly_NoMt23_part_run1.nex
rm: ./missingDataFXTester.Rout: No such file or directory
rm: ./MissingDataFX_R_Workspace.RData: No such file or directory
rm: ./*.pdf: No such file or directory
### RE-RUNNING MissingDataFX.sh!!! ###
##########################################################################################
# MissingDataFX v0.1.1, March 2017 #
##########################################################################################
INFO | Wed Mar 15 14:53:03 CDT 2017 | Starting MissingDataFX analysis...
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #1: SETUP AND USER INPUT.
INFO | Wed Mar 15 14:53:03 CDT 2017 | Setting working directory to: /GitHub/MissingDataFX-master/repeat_test 9/test
INFO | Wed Mar 15 14:53:03 CDT 2017 | Reading in input NEXUS file(s)...
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #2: PROCESSING INPUT NEXUS, SPLITTING TAXON LABELS AND DATA BLOCKS INTO SEPARATE FILES.
INFO | Wed Mar 15 14:53:03 CDT 2017 | CatmtDNAonly_NoMt23_part_run1.nex
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #3: USING TAXON LABEL AND CONCATENATED SEQUENCE FILES GENERATED DURING PREVIOUS STEP TO CREATE ONE
INFO | Wed Mar 15 14:53:03 CDT 2017 | FILE WITH MISSING DATA COUNTS AND PROPORTIONS FOR EACH INDIVIDUAL.
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #4: PRE-PROCESSING MRBAYES CONSENSUS TREE INPUT FILE, IF PRESENT: SPLIT .con.tre FILE, EXTRACT
INFO | Wed Mar 15 14:53:03 CDT 2017 | TERMINAL BRANCH LENGTHS & THEIR CONFIDENCE INTERVALS, AND CREATE BRANCH LENGTH SUMMARY TABLE.
INFO | Wed Mar 15 14:53:03 CDT 2017 | Found '.con.tre' file. Reading in MrBayes consensus tree from current working directory...
INFO | Wed Mar 15 14:53:03 CDT 2017 | Running mbTreeStatMiner script...
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #5: MAKE R SCRIPT THAT A) EXTRACTS PARAMETER ESTIMATES FROM BEAST TREES OR READS IN MRBAYES DATA
INFO | Wed Mar 15 14:53:03 CDT 2017 | TABLE (STEP #3) IN WORKING DIR THEN B) TESTS FOR IMPACT OF MISSING DATA ON PHYLO SUPPORT AND BRANCH LENGTHS.
INFO | Wed Mar 15 14:53:03 CDT 2017 | STEP #6: RUN THE R SCRIPT (WHICH ALSO SAVES RESULTS TO FILE).
INFO | Wed Mar 15 14:53:09 CDT 2017 | STEP #7: CLEANUP: ORGANIZE RESULTS, REMOVE UNNECESSARY FILES.
INFO | Wed Mar 15 14:53:09 CDT 2017 | R workspace file confirmed in dir: /GitHub/MissingDataFX-master/repeat_test
INFO | Wed Mar 15 14:53:09 CDT 2017 | STEP #8: TEST RUN OUTPUT USING MDFXTester:
### RUNNING MDFXTester.sh ###
DO GRAPHICS CHECK ON BASIC SCATTERPLOTS FROM R; IF FAILED, DO fetchTaxonLabels.sh FIX
AND COMPLETELY RERUN MissingDataFX SCRIPT.
Passed graphics check. Moving on...
INFO | Wed Mar 15 14:53:09 CDT 2017 | Done analyzing the amount and potential effects of missing data on phylogenetic support and branch
INFO | Wed Mar 15 14:53:09 CDT 2017 | lengths using MissingDataFX.
INFO | Wed Mar 15 14:53:09 CDT 2017 | Bye.
The software creates a number of different summary files, modified tree files (e.g. converts .con.tre to .tree), Rscript files and R output text and PDF graphics files (among others). Resulting files are organized by the scripts into the following four folders: "final_dataset", "mb_tree_stats", "NEXUS_data", "R_results". The contents of the main output of interest--the R output in R_results--varies slightly, depending on which type of tree file was supplied for anlaysis.
If running on BEAST tree file, R_results will include:
- ladderized/nonladderized plots of phylogeny supplied to script, with node numbers; multipled rolled into single PDF file.
- "basic_scatterplots.pdf" -- simple scatterplots of posterior ~ proportion data, posterior ~ proportion missing data, posterior ~ terminal branch lengths, terminal branch lengths ~ proportion data, and terminal branch lengths ~ proportion missing data, all rolled into a single PDF file.
- "MissingDataFX_R_Workspace.RData" -- R workspace file, allowing you to open the environment of the Rscript run again in the R Console.
- "missingDataFXTester.Rout" -- output of R Console log, including any error messages etc.
- Shapiro-Wilk p-values for the four variables summarized from BEAST trees (above)
- Parametric or non-parametric correlation test output
If running on MrBayes tree file, R_results will include THE SAME AS ABOVE, WITH THE FOLLOWING EXCEPTIONS:
- "basic_scatterplots.pdf" -- simple scatterplots of terminal branch lengths ~ proportion data, and terminal branch lengths ~ proportion missing data, rolled into a single PDF file. NO POSTERIOR SUPPORT plots. For example, you can get something like the following plots showing relationships of terminal branch lengths with data characteristics, for a ~5kb/4 locus, 126 tip taxa dataset:
- Shapiro-Wilk p-values for the three variables summarized from MrBayes trees (above)
How to troubleshoot some potentially common problems:
(1) One problem you may run into is the 'permission denied' error returned by the shell when attempting to execute the shell scripts; for example, bash might return "-bash: ./MissingDataFX.sh: Permission denied". This indicates that permissions for .sh files were not correctly set during Installation. Fix this by moving into the repository master folder and entering $ chmod u+x ./*.sh at the command line, then using the shell script(s) in the repo folder from that point forward.
During the development of this software, J.C.B. received stipend support from a Ciência Sem Fronteiras (Science Without Borders) postdoctoral fellowship from the Brazilian Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq; Processo 314724/2014-1). Lab and computer space was also supplied by The University of Alabama, during an internship in the Lozier Lab in the UA Department of Biological Sciences.
- Bagley JC, Mayden RL, Harris PM (in revision) Phylogeny, temporal diversification, and conflicting relationships of suckers (Cypriniformes: Catostomidae) inferred from Bayesian total-evidence dating. Molecular Phylogenetics and Evolution.
- Clarke JA, Middleton K (2008) Mosaicism, modules, and the evolution of birds: results from a Bayesian approach to the study of morphological evolution using discrete character data. Systematic Biology, 57, 185-201.
- Lemmon AR., Brown JM, Stanger-Hall K, Lemmon EM (2009) The effect of missing data on phylogenetic estimates obtained by maximum-likelihood and Bayesian inference. Systematic Biology, 58, 130-145.
- Pyron RA (2011) Divergence time estimation using fossils as terminal taxa and the origins of Lissamphibia. Systematic Biology, 60, 466-481.
- Wiens JJ (2003) Incomplete taxa, incomplete characters, and phylogenetic accuracy: is there a missing data problem? Journal of Vertebrate Paleontology, 23, 297-310.
- Wiens JJ (2006) Missing data and the design of phylogenetic analyses. Journal of Biomedical Informatics, 39, 34-42.
- Wiens JJ, Fetzner JW, Parkinson CL, Reeder TW (2005) Hylid frog phylogeny and sampling strategies for speciose clades. Systematic Biology, 54, 719-748.
Current:
- Add capacity to extract posterior information for terminal nodes in MrBayes trees. This not only keeps us from being able to plot linear relationships between posterior support and proportion of data or missing data, but also bars us from conducting formal correlation tests of relationships with posterior nodal support. Currently, if the user wants to be able to examine relationships among all four variables of interest--terminal posterior nodal support, terminal branch lengths, proportion data, and proportion missing data, then they will have to conduct their analysis Only on a BEAST tree.
- Provide graphical summaries of data/missing data proportions for different data blocks (though it's difficult to carry names of blocks/partitions into R).
- Provide graphical output showing linear relationships between posterior support and data characteristics, at the level of blocks/partitions rather than individual nodes.
- Modify to accomodate and extract parameters from annotated maximum-likelihood trees from programs like RAxML (check extent and format of branch/node labels on ML trees from different programs).
- Add screenshots/files of example R analyses or code
- Add screenshots/files of example text and graphical output produced by R, as directed by the scripts.
Recently finished/fixed:
- Fix bug where bivariate relationships of posterior nodal support with other variables were not being plotted. DONE! ✅
- Fix bug giving "No such file or directory" errors on
sedandrmcalls for '*_taxonLabels.txt' files under STEP #3, which causes final data files and R script graphics NOT to be generated! DONE! ✅ - Solve two input file problem--accomodate MrBayes trees, in addition to BEAST MCC trees. DONE! ✅
- Allow MrBayes tree files with '.con.tre' or '.tree' extensions (previously automatically converted .con.tre to .tree). DONE! ✅
- Correct issue in R code with 'ALL data' dataframe name for the non-drop file case. DONE! ✅
March 15, 2017 Justin C. Bagley, Tuscaloosa, AL, USA