You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have an application where I am defining an asset that represents a trained model which has multiple upstream dependencies. The dependencies all have time partitions, so the the model also has a time partition representing the time period used in the training. Is there a way to configure my project so that if I materialize the trained asset (either manually or through a schedule), I can materialize the upstream assets?
I have tried using the global lineage view, but because the downstream and upstream assets have different partitions, I cannot use "Materialize All". I think I could use Declarative Automation, but that seems designed for upstream assets to trigger downstream materializations, but perhaps I'm not thinking through that option thoroughly.
area: assetRelated to Software-Defined Assetsarea: pipeline-designIssues or discussions related to how to model a pipeline in Dagster
1 participant
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I have an application where I am defining an asset that represents a trained model which has multiple upstream dependencies. The dependencies all have time partitions, so the the model also has a time partition representing the time period used in the training. Is there a way to configure my project so that if I materialize the trained asset (either manually or through a schedule), I can materialize the upstream assets?
I have tried using the global lineage view, but because the downstream and upstream assets have different partitions, I cannot use "Materialize All". I think I could use Declarative Automation, but that seems designed for upstream assets to trigger downstream materializations, but perhaps I'm not thinking through that option thoroughly.
Beta Was this translation helpful? Give feedback.
All reactions