feat: index chart entities into charts_x_entities table

[marcelgerber]

Implements #3401.

Currently, this is just a batch script that will update all charts.
But it is written in such a way that it will be easy to hook into it in the future, and we could call obtainAvailableEntitiesForGrapherConfig in a server-side onSave handler, and update charts_x_entities for that chart only.

Ready for review already, but some TODOs still:

• Think about handling of Marimekko, slope, scatter charts; where an entity not being selected doesn't mean that it's invisible
• Does it make sense to move obtainEntityNameToIdMap into an Entity.ts model file? We'll probably need the inverse, too...
• Makefile?
• yargs, and === "main" check

---

On my local machine, running the script takes 7.5 minutes.
The resulting table has 625,676 rows.

[marcelgerber]

• feat(search): match geographic entities in search #3388
• chore: remove $.data.availableEntities from configs and schema #3419
• feat(algolia): use charts_x_entities table for Algolia indexing #3424
• feat: index chart entities into charts_x_entities table #3418 👈
• master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @marcelgerber and the rest of your teammates on Graphite

[danyx23]

Looks good! Could you add a DbPlainChartXEntity type for completeness and add a similar type in the ETL (or ask Mojmir to do it) and add it to datasette so it will be exported?

Relevant ETL place: https://github.com/owid/etl/blob/master/etl/grapher_model.py
And datasette: https://github.com/owid/analytics/blob/e028289496b31f708fbd65cbae1bfa9b5f68d27d/snail/sqlite_from_mysql.py#L102-L129