Skip to content

Get rid of addWantedOutputs #13240

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Ericson2314
Copy link
Member

@Ericson2314 Ericson2314 commented May 21, 2025

Motivation

DerivationGoal now only tracks a single output, and is back to tracking a plain store path drvPath, not a deriving path one. Its addWantedOutputs method is gone. These changes will allow subsequent PRs to simplify it greatly.

Because the purpose of each goal is back to being immutable, we can also once again make Goal::buildResult a public field, and get rid of the getBuildResult method. This simplifies things also.

DerivationCreationAndRealisationGoal is a cheap "trampoline" goal. It takes immutable sets of wanted outputs, and just kicks of DerivationGoals for them. Since now "actual work" is done in these goals, it is not wasteful to have separate ones for separate sets of outputs, even if those outputs (and the derivations they are from) overlap.

This separation of concerns will make it possible for future work on issues like #11928, and to continue the path of having more goal types, but each goal type does fewer things (issue #12628).

Context

This commit in some sense reverts f4f28cd, but that one kept around addWantedOutputs. I am quite sure it was having two layers of goals with addWantedOutputs that caused the issues --- restarting logic like addWantedOutputs has is very tempermental! In this version of the change, we have zero layers of addWantedOutputs --- no goal type needs it, or otherwise has a mutable objective --- and so I think this change is safe.


depends on #13186

Add 👍 to pull requests you find important.

The Nix maintainer team uses a GitHub project board to schedule and track reviews.

@github-actions github-actions bot added with-tests Issues related to testing. PRs with tests have some priority fetching Networking with the outside (non-Nix) world, input locking labels May 21, 2025
@Ericson2314 Ericson2314 marked this pull request as ready for review May 21, 2025 00:24
@Ericson2314 Ericson2314 requested a review from edolstra as a code owner May 21, 2025 00:24
@github-project-automation github-project-automation bot moved this to To triage in Nix team May 21, 2025
@Ericson2314 Ericson2314 changed the title Introduce DerivationCreationAndRealisationGoal, get rid of addWantedOutputs Get rid of addWantedOutputs May 21, 2025
Due this by introducing `DerivationCreationAndRealisationGoal`.

`DerivationGoal` now only tracks a single output, and is back to
tracking a plain store path `drvPath`, not a deriving path one. Its
`addWantedOutputs` method is gone. These changes will allow subsequent
PRs to simplify it greatly.

Because the purpose of each goal is back to being immutable, we can also
once again make `Goal::buildResult` a public field, and get rid of the
`getBuildResult` method. This simplifies things also.

`DerivationCreationAndRealisationGoal` is a cheap "trampoline" goal. It
takes immutable sets of wanted outputs, and just kicks of
`DerivationGoal`s for them. Since now "actual work" is done in these
goals, it is not wasteful to have separate ones for separate sets of
outputs, even if those outputs (and the derivations they are from)
overlap.

This separation of concerns will make it possible for future work on
issues like NixOS#11928, and to continue the path of having more goal types,
but each goal type does fewer things (issue NixOS#12628).

This commit in some sense reverts
f4f28cd, but that one kept around
`addWantedOutputs`. I am quite sure it was having two layers of goals
with `addWantedOutputs` that caused the issues --- restarting logic like
`addWantedOutputs` has is very tempermental! In this version of the
change, we have *zero* layers of `addWantedOutputs` --- no goal type
needs it, or otherwise has a mutable objective --- and so I think this
change is safe.
Copy link

dpulls bot commented May 21, 2025

🎉 All dependencies have been resolved !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fetching Networking with the outside (non-Nix) world, input locking with-tests Issues related to testing. PRs with tests have some priority
Projects
Status: To triage
Development

Successfully merging this pull request may close these issues.

1 participant