🔨 Allow passing parameters to YAML file

[Marigold]

Allow passing yaml_params dictionary to create_dataset function that makes them available in YAML template. This is especially useful as a replacement for {TODAY} "hack" that is causing spurious diffs.

Instead of

desc_update: The 2024 data is incomplete and was last updated {TODAY}.

we can now write

desc_update: The 2024 data is incomplete and was last updated {date_accessed}.

with

ds_garden = create_dataset(
        dest_dir, tables=[tb_agg], yaml_params={"date_accessed": tb_agg.yearly_count.m.origins[0].date_accessed}
    )

I'll start removing {TODAY} from recipes in a future PR.

[owidbot]

Quick links (staging server):

Site	Admin	Wizard

Login: ssh owid@staging-site-yaml-parameters

chart-diff: ✅

No charts for review.

data-diff: ❌ Found differences

= Dataset garden/artificial_intelligence/2024-08-05/epoch_aggregates_affiliation
  = Table epoch_aggregates_affiliation
    ~ Column cumulative_count (changed metadata)
-       -   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 16 August 2024.
        ?                                                                                                                                                   ^^
+       +   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 05 August 2024.
        ?                                                                                                                                                   ^^
    ~ Column yearly_count (changed metadata)
-       -   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 16 August 2024.
        ?                                                                                                                                                   ^^
+       +   Describes the sector where the authors of a notable AI system have their primary affiliations. The 2024 data is incomplete and was last updated 05 August 2024.
        ?                                                                                                                                                   ^^


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-09-02 13:26:19 UTC
Execution time: 13.70 seconds