🎉 Explorers in the Data Catalog

[ikesau]

This became a much larger refactor than I thought it would, but I couldn't in good conscience add a bunch of forks to the already large indexExplorerViewsToAlgolia script without composing things a little more sensibly.

Changes

• Separates record generating functions and the indexing scripts into multiple files (e.g. baker/algolia/utils/charts.ts and baker/algolia/indexChartsToAlgola.ts)
• Refactored Explorer View indexing to add available entities, and support for CSV-based and Grapher-based charts
  • The best way to make sense of this is to start at the bottom of explorerViews.ts and go up from there
  • In summary: Get basic explorer metadata from the DB, get extra metadata from the GitCMS, prepare a "base record" for each view, enrich each base record depending on what type of view it is (indicator/grapher/csv, finalize them with a few extra processing steps
• Adds a new indexExplorerViewsAndCharts script/index which uses the ChartHit interface (plus a new "type" enum)
  • Explorer view scores are scaled to the same range as chart scores
• Adds support for explorer views in the data catalog
  • This probably needs a little more love now - I haven't gone over the code again since I wrote it (I think the rest of the code is ready to review, if you're feeling keen, Marcel)

[owidbot]

Quick links (staging server):

Site	Admin	Wizard

Login: ssh owid@staging-site-data-catalog-explorers-algolia

• Site-screenshots: https://github.com/owid/site-screenshots/compare/data-catalog-explorers-algolia
• SVG tester: https://github.com/owid/owid-grapher-svgs/compare/data-catalog-explorers-algolia

SVG tester:

Number of differences (default views): 0 ✅
Number of differences (all views): 0 ✅

Edited: 2024-11-01 00:27:06 UTC
Execution time: 1.15 seconds

[marcelgerber]

Really nice work here, ike!

I left a few small comments here and there, but overall this seems great.

[marcelgerber]

Wow, this is really nicely done! And, also, a lot of effort!

[marcelgerber]

Good now, except for that you're getting an import error