Releases: popsim-consortium/stdpopsim
Major feature release
Major feature release adding documented, stable support for simulating selection (via SLiM),
as well as new species and models.
Bug fixes:
-
Incorrect scaling of the DroMel/LognormalPlusPositive_R16 DFE led to negative selection
coefficients that were too large (many on the order of -1e3); scaling was fixed for the
log scale (@clararehmann, #1699) -
Factor of two error fixed in HomSap/Gamma_K17 DFE (@RyanGutenkunst, #1478)
-
Discretization for exponential growth using the SLiM engine led to the final size
in growing/declining populations not matching (by a small amount) what is listed
in the model; improved discretization scheme (@petrelharp, #1622) -
Updates to SLiM support: updated the
active
flag in the SLiM code to be integer.`
Breaking changes:
-
The 2018 Browning et al HomSap demographic model previously named
"AmericanAdmixture_4B11" is now named "AmericanAdmixture_4B18"; the old name
works but throws a deprecation warning. (@petrelharp, #1603) -
The
time_units
attribute of tree sequence metadata is now set to "generations"
for SLiM output, avoiding the "time units mismatch warning".
(@nspope, #1567) -
Previously, Contigs specified with
left
andright
arguments produced
simulations having coordinates shifted so they were relative toleft
. This
is no longer the case: coordinates in resulting simulations retain the
original chromosome's coordinates. As a result, regions outside[left, right)
will now have missing data. To produce simulation output with the
previous behavior, use the.trim()
method of the resulting TreeSequence.
So, the Contig's.original_coordinates
attribute is now called
.coordinates
, and several methods (e.g.,Contig.basic_contig()
) now take
left
andright
arguments as well aslength
. Finally, arguments such as
relative_coordinates=True/False
toContig.dfe_breakpoints()
are no longer
necessary and are deprecated. (@petrelharp, #1570) -
To add the possibility for a relationship between dominance and selection
coefficient, now each stdpopsim MutationType might have more than one
underlying SLiM mutation type; so, where this is recorded in top-level
metadata (underts.metadata["stdpopsim"]["DFEs"]
) is now a list
instead of a single value. This will not affect anyone who is not
parsing the metadata related to DFEs. -
SLiM extended events and selective sweep infrastructure have been
moved from thestdpopsim.ext
namespace intostdpopsim
proper. -
The
length_multiplier
option toSpecies.get_contig
is deprecated and
prints a warning. The optionsleft
andright
should be used to truncate a
contig, instead. (@nspope, #1605) -
Added
assembly_source
andassembly_build_version
properties to
Genome
objects, so that different genomes could be based on
different sources (previously, all were with reference to the Ensembl
release 103). (@andrewkern, #646
New features:
-
Relationship between dominance and selection coefficient:
Added thedominance_coeff_list
argument toMutationType
, allowing
for DFEs with a discretized relationship between h and s.
(@petrelharp, #1498) -
Model specific recombination rates:
Added therecombination_rate
attribute to demographic model,
allowing for model specific recombination rates in addition to
the species default rates.
(@gregorgorjanc, #1591) -
Added support for the SLiM engine on Windows. (@petrelharp, #1571)
New species:
-
Mus musculus (@peterdfields, #1437).
QC'd by @igronau, #1454. -
Orzya sativa (@ornobalam, #1453).
QC'd by @minesrebollo, #1461 -
Phocoena sinus (@igronau, #1514).
QC'd by @ckyriazis, #1538 -
Gorila gorila (@ChristianHuber, #1517)
QC'd by @andrewkern, #1701 -
Rattus norvegicus (@kevinkorfman, #1700)
QC'd by @andrewkern, #1706 -
Sus scrofa (@AprilYUZhang, #1672)
QC'd by @gregorgorjanc, #1689
New DFEs:
-
Generic "uniform" DFE (@petrelharp, #1492)
-
HomSap/LogNormal_H17 (@RyanGutenkunst, #1480)
QC'd by @clararehmann, #1698 -
HomSap/Mixed_K23 (@chriscrsmith, #1505)
QC'd by @clararehmann, #1696 -
PhoSin/Gamma_R22 (@igronau, #1547)
QC'd by @ckyriazis, #1560 -
AraTha/Gamma_H18 (@chriscrsmith, #1324)
QC'd by @clararehmann, #1647 -
HomSap/GammaPos_H17 and DroMel/GammaPos_Z21 (@petrelharp, #1656)
QC'd by @clararehmann, #1694 & #1695
New demographic models:
-
MusMus/DomesticusEurope_1F22 (@peterdfields, #1485)
QC'd by @igronau, #1531 -
MusMus/MusculusKorea_1F22 (@peterdfields, #1485)
QC'd by @igronau, #1531 -
MusMus/CastaneusIndia_1F22 (@peterdfields, #1485)
QC'd by @igronau, #1531 -
OrySat/BottleneckMigration_3C07 (@ornobalam, #1453)
QC'd by @minesrebollo, #1466 and @petrelharp, #1524 -
PhoSin/Vaquita2Epoch_1R22 (@igronau, #1526)
QC'd by @ckyriazis, #1538 -
CanFam/EarlyWolfAdmixture_6F14 (@agladstein, #1632)
QC'd by @gregorgorjanc, #1644 -
BosTau/HolsteinFriesian_1B16, BosTau/Angus_1B16, BosTau/Fleckvieh_1B16, and
BosTau/Jersey_1B16 (@gregorgorjanc, #1593)
New annotations:
- PhoSin exons and CDS (@chriscrsmith, #1520)
New QCs:
-
DroMel/Gamma_H17 (@clararehmann, #1668)
-
DroMel/LognormalPlusPositive_R16 (@clararehmann, #1699)
-
HomSap/Gamma_K17 (@clararehmann, #1687).
-
MusMus/Gamma_B21 (@clararehmann, #1669)
Alpha release for 0.2.1: additional DFEs, species, and maintenance
This is an alpha release in preparation for an 0.2.1 release, incorporating a number of additional DFEs and species, and some maintenance.
Major feature release
Major feature release adding many new species and models, as well as support
for simulating selection via SLiM.
Bug fixes:
-
Parameters in the HomSap/Zigzag_1S14 model now match those in Schiffels &
Durbin (2014) (@grahamgower, #750). -
Recombination rate for DroMel chr4 changed to 0
(@izabelcavassim, #1092). -
Per-chromosome mean recombination rates for HomSap were incorrectly
calculated (@nspope, #1345).
Breaking changes:
-
Removed
GeneticMap
class from public API (@jeromekelleher, #713). -
Samples are now specified via population/individual pairs, using
species/chromosome ploidy. The old API for specifying haploid samples via
population index has been retained, but is deprecated and will be
removed at some point (@nspope, #1361).
New species:
-
Aedes aegypti (@manolofperez, #871).
QC'd by @petrelharp, #893. -
Anas platyrhynchos (@petrelharp, #826).
QC'd by @igronau, #1070. -
Anolis carolinensis (@Vcaudill, #874).
QC'd by @andrewkern, #896. -
Anopheles gambiae (@andrewkern, #856).
QC'd by @petrelharp, #906. -
Apis mellifera (@janaobsteter, #1025).
QC'd by @manolofperez, #1268. -
Bos taurus (@grahamgower, #600).
QC'd by @gtsambos, #1269. -
Caenorhabditis elegans (@attrna, #910).
QC'd by @chriscrsmith, #1265. -
Chlamydomonas reinhardtii (@aays, #863).
QC'd by @izabelcavassim, #1067. -
Drosophila sechellia (@jradrion, #872).
QC'd by @vitorpavinato, #1264. -
Gasterosteus aculeatus (@vitorpavinato, #1105).
QC'd by @manolofperez, #1253. -
Helianthus annuus (@chriscrsmith, #1218).
QC'd by @xin-huang, #1250. -
Heliconius melpomene (@percyfal, #870).
QC'd by @noscode, #1165. -
Pan troglodytes (@xin-huang, #1215).
QC'd by @janaobsteter, #1291. -
Papio anubis (@saurabhbelsare, #1216).
QC'd by @mufernando, #1263. -
Streptococcus agalactiae (@jeanrjc, #854).
QC'd by @vitorpavinato, #1251.
New models:
-
AnaPla/MallardBlackDuck_2L19 (@petrelharp, #883).
QC'd by @igronau, #1021. -
AnoGam/GabonAg1000G_1A17 (@andrewkern, #856).
QC'd by @petrelharp, #1279. -
BosTau/HolsteinFriesian_1M13 (@grahamgower, #600).
QC'd by @igronau, #1272. -
HomSap/OutOfAfricaExtendedNeandertalAdmixturePulse_3I21
(@leonardolasi, #1066).
QC'd by @awohns, #1259. -
HomSap/OutOfAfrica_4J17 (@rwaples, #726).
QC'd by @jeffspence, #1246. -
HomSap/Africa_1B08 (@izabelcavassim, #993).
QC'd by @petrelharp, #995. -
HomSap/AncientEurope_4A21 (@AliPearson, #941).
QC'd by @mufernando, #1256. -
PanTro/BonoboGhost_4K19 (@xin-huang, #1215).
QC'd by @kuhlwilm, #1370. -
PapAnu/SinglePopSMCpp_1W22 (@saurabhbelsare, #1216).
QC'd by @attrna, #1261.
New genetic maps:
-
DroMel/ComeronCrossoverV2_dm6 liftover (@grahamgower, #592).
-
HomSap/HapMapII_GRCh38 liftover (@saurabhbelsare, #1301).
-
HomSap/DeCodeSexAveraged_GRCh38 liftover (@saurabhbelsare, #1301).
-
HomSap/PyrhoXXX_GRCh38 (@jeffspence, #572` and #575),
for XXX in ACB, ASW, BEB, CDX, CEU, CHB, CHS, CLM, ESN, FIN, GBR, GIH, GWD,
IBS, ITU, JPT, KHV, LWK, MSL, MXL, PEL, PJL, PUR, STU, TSI, and YRI. -
PapAnu/Pyrho_PAnubis1_0 (@saurabhbelsare, #1216)
New features:
-
Distributions of fitness effects ("DFEs") defined over genomic intervals
(@mufernando, #644; @izabelcavassim, #1002;
plus numerous others). -
DFE simulation via SLiM
(@mufernando, #930; plus numerous others). -
Metadata for tree sequences produced by SLiM
(@mufernando, #1152). -
Per-generation fitness statistics for SLiM simulations
(@petrelharp, #1200). -
Selective sweep simulation and allele frequency conditioning via SLiM
(@grahamgower, #462; @nspope, #1341). -
Gene conversion simulation via msprime and SLiM
(@fbaumdicker, #1106; @petrelharp, #1355). -
Genome annotation tracks
(@andrewkern, #560` and #960). -
Masking intervals in simulated data
(@apragsdale, #664). -
Method to get generic contig of arbitrary length for a species
(@apragsdale, #664). -
Method to get contig from a segment of a named chromosome
(@nspope, #1348). -
Pass keyworded arguments from simulation engine to msprime
(@awohns, #736). -
Use msprime 1.0 for simulation from msprime engine
(@jeromekelleher, #764). -
Use SLiM 4.0 for simulation from SLiM engine
(@petrelharp, #1326). -
Mutation rates can be stored in catalog models
(@apragsdale, #839). -
Ploidy is a species and chromosome attribute
(@nspope, #1361). -
Mutations from SLiM simulations converted to nucleotides
(@nspope, #1356). -
Various improvements and fixes to the documentation and error messaging.
Additions to CLI:
-
Sample specification has switched from positional and haploid (e.g.
stdpopsim HomSap -d OutOfAfrica_3G09 6 0 10
) to named with species-specific ploidy (equivalent tostdpopsim HomSap -d OutOfAfrica_3G09 YRI:3 CEU:0 CHB:5
). Positional sample specification is still supported but will raise a deprecation warning. -
Arguments
--dfe
,--dfe-interval
,--dfe-bed-file
,--help-dfe
for specifying DFEs (@izabelcavassim, #1052). -
Arguments
--help-annotations
,--dfe-annotation
for associating annotation
tracks with DFEs (@andrewkern, #1117). -
Argument
--length
for simulating from a generic contig
(@apragsdale, #664). -
Arguments
--inclusion-mask
,--exclusion-mask
for masking simulated sequences
(@apragsdale, #664). -
Arguments
--left
and--right
for simulating an interval on a named chromosome
(@nspope, #1348) -
Argument
--keep-mutation-ids-as-alleles
retains SLiM mutation IDs for
allele codes instead of converting these to nucleotides (@nspope, #1356).
Catalog maintenance infrastructure:
-
Quality control infrastructure for DFEs
(@xin-huang, #1292). -
Pull species information from NCBI
(@andrewkern, #875). -
Automated species addition to catalog
(@jeromekelleher, #790). -
Github issue template for requesting addition of species
(@petrelharp, #772). -
Pull genome data from Ensembl
(@jeromekelleher, #563).
New annotations:
-
AraTha/araport_11 (@andrewkern, #1327).
-
DroMel/FlyBase_BDGP6.32.51 (@andrewkern, #1042).
-
HomSap/ensembl_havana_104 (@andrewkern, #960).
New DFEs:
-
DroMel/Gamma_H17 (@izabelcavassim, #1046).
-
DroMel/LognormalPlusPositive_R16 (@apragsdale, #1178).
-
HomSap/Gamma_K17 (@izabelcavassim, #1002).
-
HomSap/Gamma_H17 (@chriscrsmith, #1099).
Important bugfix and feature release
Important bugfix and feature release, recommended for all users.
Significant errors in the HomSap/OutOfAfrica_3G09 and HomSap/OutOfAfrica_2T12 models have been fixed. We recommend repeating any analyses performed using these models. See here for more details on the error in the three population Out of Africa model and analysis of the differences from the correct model.
The recombination rate for AraTha was also off by a factor of 10. We recommend repeating any analyses performed using this species.
Bug fixes:
-
Fix error in HomSap/OutOfAfrica_3G09 model, in which migration between ancestral African and European populations was allowed to continue in the most ancient time period (@apragsdale, #496, #516).
-
Fix similar error in HomSap/OutOfAfrica_2T12 model (@ndukler, #520, #516).
-
Fix recombination rate estimate for AraTha (@grahamgower, #537, #527), which was off by a factor of 10.
-
Require attrs >=19.10 (@grahamgower, #399, #394)
New species:
-
Canis familiaris (@grahamgower, #375).
-
Pongo abelii (@apragsdale, #363).
New models:
-
HomSap/PapuansOutOfAfrica_10J19 model (@grahamgower, #372). QC’d by @noscode, #387.
-
HomSap/AshkSub_7G19 model (@agladstein, #494). QC’d by @ndukler, #536.
New features:
-
SLiM simulation engine (@grahamgower, #409, plus numerous others. See e.g. #132 and #133 for background.)
-
Support for DTWF, SMC, and SMC’ models in msprime engine (@grahamgower, #398, #392).
-
Warnings for users running simulations on non-autosomes (@grahamgower, #407).
-
Warnings for users running simulations on non QC’d models (@grahamgower, #525).
-
Add generation_time (default=1) attribute to generic models (@grahamgower, #477, #471).
-
Various documentation and citation improvements.
Breaking changes:
-
Move the –quiet/-q command line option to the top-level. Previously we would write stdpopsim HomSap -q 10 whereas we now write stdpopsim -q HomSap. (@jeromekelleher, #515, #547)
-
The long form --verbosity argument has been changed to --verbose (#547).
-
Removed DroMel chrM (@grahamgower, #528, #405).
Bugfix release
Bugfix release. Fixes some distribution issues and temporarily removes the PonPyg species.
Bug fixes:
- Pin the msprime and attrs packages to resolve some distribution problems (#366; @jgallowa07 and @gtsambos).
New features:
- Provide citations for the genome assembly (#359, #360; @andrewkern and @grahamgower).
Breaking changes:
- Temporarily remove the PonPyg species from the catalog to provide time to fix issues with genomes and multi-species models (#365).
Initial release
Initial release of the stdpopsim resource.