🐛 AI: wrong unit in one of the epoch datasets

[veronikasamborska1994]

No description provided.

[owidbot]

Quick links (staging server):

Site	Admin	Wizard

Login: ssh owid@staging-site-epoch-bug

chart-diff: ✅

No charts for review.

data-diff: ❌ Found differences

= Dataset garden/artificial_intelligence/2024-02-15/epoch_llms
  = Table epoch_llms
    ~ Column dataset_size__tokens (changed metadata)
+       +   - |-
+       +     In the context of language models, this data size is often measured in tokens, which are chunks of text that the model processes. A 100 tokens is equivalent to around 75 words.
-       - unit: datapoints
+       + unit: tokens


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-09-20 10:59:57 UTC
Execution time: 15.25 seconds