Answers.Body: <p>I will give an answer that is specific to closely-related microbial genomes. Core-SNPs, SNPs which are within conserved and likely orthologous sequences, have been shown to be relatively informative for constructing phylogenies of large sequence sets<a href="http://scholar.google.com/scholar_lookup?&amp;title=Genomics%20and%20outbreak%20investigation%3A%20from%20sequence%20to%20consequence&amp;journal=Genome%20Med&amp;volume=5&amp;publication_year=2013&amp;author=Robinson%2CER&amp;author=Walker%2CTM&amp;author=Pallen%2CMJ" rel="nofollow noreferrer">[1]</a>.</p>
  <p><a href="https://genomebiology.biomedcentral.com/articles/10.1186/s13059-014-0524-x" rel="nofollow noreferrer">Parsnp</a> is the most popular tool for constructing core-genome alignments on microbial genomes, and extracts the core SNPs from the alignments. Parsnp then uses raxml or FastTree in order to produce a phylogeny from the core SNPs. I will say, though, that 20k sequences may be too many for Parsnp to run on (depending on how large the sequences are and your available resources).</p>
  <p>Disclaimer: I am the maintainer of Parsnp (:</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-08T18:11:10.547Z
Answers.LastActivityDate: 2021-10-10T13:23:14.887Z
Answers.LastEditDate: 2021-10-10T13:23:14.887Z
Answers.UserDisplayName: Throckmorton
Answers.Body: <p>The subset that gives you the tree closest to the one you obtain with the full dataset does not necessarily is the tree nearest to reality... It could be that you get a more realistic result using only partial data for multiple reasons. Your best chance is in my opinion, as it usually is, making lots of tests and contrasting hypotheses.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-01-09T21:43:06.877Z
Answers.LastActivityDate: 2021-01-09T21:51:27.587Z
Answers.LastEditDate: 2021-01-09T21:51:27.587Z
Answers.UserDisplayName: juanjo75es
Body: <p>I have got a quite large VCF file (about 20k samples with 160k SNPs after filtering for quality etc.) and I would like to get a phylogeny for it. However, the whole dataset's too large for my computational resources (unless I go for fasttree which would be my last resort). Therefore, I need to subset the SNPs and there's plenty of possible ways to do this (dump all rare SNPs with MAF below a threshold, only use SNPs in coding regions, only use missense SNPs; just to name a few).</p>
  <p>Is there a consensus (or at least some comparative work or recent review; I found nothing) on what method works best and gives the tree that's closest to using the full dataset?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-01-09T15:05:01.967Z
Comments.Text: Yes, the SNPs have already been filtered on a handful of metrics.
Comments.UserDisplayName: zeawoas
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-01-09T17:05:52.063Z
Comments.Text: OK - what species are you working on? It's worth looking at a paper that tries to build a tree using the same species as you and then following some of the steps they have performed. For example [this paper](https://www.sciencedirect.com/science/article/pii/S1567134820301829) if you are working with viruses.
Comments.UserDisplayName: user438383
Tags: <phylogenetics><vcf><phylogeny>
Title: Consensus on how to select SNPs for creating a phylogeny when the full dataset is too large
ThreadText: # Consensus on how to select SNPs for creating a phylogeny when the full dataset is too large
  
  (Asked by: username_0 on 2021-01-09)
  
  I have got a quite large VCF file (about 20k samples with 160k SNPs after filtering for quality etc.) and I would like to get a phylogeny for it. However, the whole dataset's too large for my computational resources (unless I go for fasttree which would be my last resort). Therefore, I need to subset the SNPs and there's plenty of possible ways to do this (dump all rare SNPs with MAF below a threshold, only use SNPs in coding regions, only use missense SNPs; just to name a few).
  
  Is there a consensus (or at least some comparative work or recent review; I found nothing) on what method works best and gives the tree that's closest to using the full dataset?
  
  **Tags:** phylogenetics, vcf, phylogeny
  
  > **Comments:**
  > **username_0**: Yes, the SNPs have already been filtered on a handful of metrics.  
  > **username_1**: OK - what species are you working on? It's worth looking at a paper that tries to build a tree using the same species as you and then following some of the steps they have performed. For example [this paper](https://www.sciencedirect.com/science/article/pii/S1567134820301829) if you are working with viruses.  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2021-10-08. Score: 2 | Accepted answer
  
  I will give an answer that is specific to closely-related microbial genomes. Core-SNPs, SNPs which are within conserved and likely orthologous sequences, have been shown to be relatively informative for constructing phylogenies of large sequence sets[[1]](http://scholar.google.com/scholar_lookup?&title=Genomics%20and%20outbreak%20investigation%3A%20from%20sequence%20to%20consequence&journal=Genome%20Med&volume=5&publication_year=2013&author=Robinson%2CER&author=Walker%2CTM&author=Pallen%2CMJ).
  
  [Parsnp](https://genomebiology.biomedcentral.com/articles/10.1186/s13059-014-0524-x) is the most popular tool for constructing core-genome alignments on microbial genomes, and extracts the core SNPs from the alignments. Parsnp then uses raxml or FastTree in order to produce a phylogeny from the core SNPs. I will say, though, that 20k sequences may be too many for Parsnp to run on (depending on how large the sequences are and your available resources).
  
  Disclaimer: I am the maintainer of Parsnp (:
  
  
  ---
  
  ### Answer by username_3 on 2021-01-09. Score: 1
  
  The subset that gives you the tree closest to the one you obtain with the full dataset does not necessarily is the tree nearest to reality... It could be that you get a more realistic result using only partial data for multiple reasons. Your best chance is in my opinion, as it usually is, making lots of tests and contrasting hypotheses.
  
  
  ---
  
  