In genetics, a muton refers to the smallest unit of DNA, potentially a single nucleotide, that can produce a mutation.
muton is a tool for running mutation testing campaigns against TON smart contracts written in FunC and Tact. Language is auto-detected by file extension (.fc/.func, .tact).
npm install @trailofbits/mutoncurl --proto '=https' --tlsv1.2 -LsSf https://github.com/trailofbits/muton/releases/download/v1.0.0/muton-installer.sh | shWith Nix flakes enabled:
git clone https://github.com/trailofbits/muton.git
cd muton
nix develop --command bash -c 'just build' # or 'direnv allow' then 'just build'
muton --versionRequirements:
- Rust toolchain (via rustup)
- C toolchain (gcc/clang) and
make pkg-config- SQLite development headers (
libsqlite3-dev/sqlite)
Install common prerequisites:
- macOS (Homebrew):
# Command Line Tools (if not already installed)
xcode-select --install || true
brew install rustup-init sqlite pkg-config
rustup-init -y
source "$HOME/.cargo/env"- Ubuntu/Debian:
sudo apt update
sudo apt install -y build-essential pkg-config libsqlite3-dev curl
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y
source "$HOME/.cargo/env"Build and run:
cargo build --release
./target/release/muton --helpOptional (install into your cargo bin):
cargo install --path . --locked --force
muton --version- Mutate a single file (auto-detected language):
muton run path/to/contract.tact- Mutate all supported files in a directory (recursive):
muton run path/to/project- List available mutation slugs for a language:
muton print mutations --language tact- Print all mutants for a target path:
muton print mutants --target path/to/contract.tact- Show mutation test results (optionally filtered by target):
muton print results --target path/to/contract.tact- Test all mutants even if more severe ones were uncaught (disable skip optimization):
muton run path/to/contract.tact --comprehensiveThis tool is designed to provide as pleasant a developer experience as possible while conducting mutation campaigns, which are notoriously messy and slow.
Muton operates on one single muton.sqlite database, this stores the target files and muton will reliably restore the original after a given mutation is tested, or after the campaign is interrupted with ctrl-c. However, this software is a work in progress so we strongly recommend running mutation campaigns against a clean git repo so that you can use git reset --hard HEAD to restore any mutations that escape the cleanup phase.
All target files are stored in the database and linked to a series of mutations. Each mutation is linked to one or zero outcomes. At the beginning of a mutation campaign, all targets are saved and all mutations are generated. This generally happens quickly, within a couple seconds.
Then, the real work begins: muton will work through the list of target files, replacing it with a mutated version. For each mutated version, it will run the test command and save the outcome. If the mutation campaign is interrupted, it will pick up where it left off (unless the target file changed, in which case it will start over).
This may take a very long time. Assuming the tests take 1 minute to run, there are 10 files, and 100 mutants were generated for each, the runtime (assuming zero muton overhead) will be 1 * 10 * 100 = 1000 minutes or 16 hours.
For this reason, making muton run fast is not enough to conduct fast mutation campaigns. Instead, a few features make this process somewhat less painful:
- resume by default: if a campaign gets interrupted halfway through for whatever reason, we don't need to restart from the very beginning
- customizable targets: you can give muton a directory as its
targetand it will mutate all supported files in this directory, which may take a long time. Or, you can give it one file and it will only mutate that file. - skipping less severe mutants when more severe ones are uncaught: if replacing an expression with a
throwstatement is not caught by the test suite, this indicates the expression is never run by the test suite. Therefore, it's safe to assume that any other mutation to this line, will also not be caught by the test suite so subsequent mutations are skipped. This can drastically decrease the runtime against poorly tested code. However, this also means the runtime will increase after the test suite is improved and the mutation campaign starts testing parts of the code more deeply than it did before.
Tip: pass --comprehensive to muton run to disable this optimization and test all mutants even when more severe ones on the same line are uncaught.
Despite these features, mutation campaigns are best conducted infrequently eg after an overhaul to the test suite rather than after adding each individual test. Therefore, mutation testing is not suitable for running in the CI after every push. You may want to run a campaign at the end of the day so that it can run overnight.
The architecture is language-agnostic. To add a new language, follow these steps. Where possible, prefer using the grammar update script to automate vendor steps.
- Vendor the grammar (recommended: use the script)
- Add entries for your language to
ops/update-grammar.shin bothREPO_URLSandGRAMMAR_PATHS. - Preview:
just update-grammar language=<language> dry_run=true- Perform the update (copies
parser.c, headers, andgrammar.jsintogrammar/<language>/and records vendored metadata):
just update-grammar language=<language>You can also vendor manually by placing generated C sources under grammar/<language>/src/ (must include parser.c) and grammar/<language>/grammar.js.
- Build integration
- Extend
build.rsto compilegrammar/<language>/src/parser.cinto a static library (see existing FunC/Tact blocks for reference).
- Language enumeration
- Update
src/types/language.rs:- Add a new enum variant
- Update
Display/FromStrand extension detection
- Parser utilities
- Extend
src/mutations/parser.rsto bind the tree-sitter language and route parsing for the new enum variant.
- Mutation engine
- Create
src/mutations/<language>/with:engine.rsimplementingMutationEngine(copying and modifying an existing engine is easiest)kinds.rslist additional language-specific mutations. Will be merged with language-agnostic mutations insrc/mutations/common/kinds.rssyntax.rsprovide grammar node/field names used by patterns, pulled from strings ingrammar/<lang>/src/parser.c
- Wire dispatch in
src/mutations/mod.rsto return your engine for the new language
- Tests and examples
- Add example files under
tests/examples/<language>/ - Add parser and mutation tests under
tests/language_specific/<language>/
- Validate
just checkmuton print mutations --language <language>shows your slugsmuton print mutants --target tests/examples/<language>/...generates mutants
Configuration sources (highest to lowest priority):
- CLI flags
- Environment variables
- Nearest
muton.tomlfound by walking up from the current working directory - Built-in defaults
Notes:
- CLI defaults are treated as built-in defaults (lowest); only flags explicitly provided override.
- Mutation slug whitelist overrides at the highest non-empty source; not merged.
- Ignore targets are merged additively across sources.
Config file discovery: starting from cwd, search for muton.toml in that directory, then its parent, and so on, stopping at the first match.
Example config:
[log]
level = "info" # one of: trace, debug, info, warn, error
color = true # optional boolean; omit for auto
[general]
db = "muton.sqlite"
ignore_targets = ["**/build/**", "**/node_modules/**"]
[mutations]
slugs = ["ER", "CR"] # global whitelist; overrides other sources if set/non-empty
[test]
cmd = "npx blueprint test"
timeout = 120Environment variables:
MUTON_LOG_LEVEL,MUTON_LOG_COLOR("on"/"off")MUTON_DBMUTON_IGNORE_TARGETS(CSV)MUTON_SLUGS(CSV; highest non-empty wins)MUTON_TEST_CMD,MUTON_TEST_TIMEOUT
This repo includes example contracts you can try:
- FunC:
tests/examples/func/hello-world.fc - Tact:
tests/examples/tact/hello-world.tact,tests/examples/tact/complex-contract.tact,tests/examples/tact/type-features.tact
- Mixed-language projects are supported. When a directory is targeted, only files with supported extensions are considered.
- Default test command is
npx blueprint test. Override with--test-cmdor viaMUTON_TEST_CMDenv var or config file.