Deploy dbt-docs with Metabase references (exposures)

[erikamov]

Description

There is always a question about where dbt models have been used in Metabase. When working on synchronizing Metabase, @ohrite and I learned about "exposures" in dbt-metabase.

This PR creates a workflow that extracts exposures from Metabase and generate dbt-docs to be visualized in Cal-ITP dbt docs.

The workflow runs every Monday at 8am UTC (1am PST) or when there is any changes on model merged to the main branch.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation

How has this been tested?

It was tested running locally and then through the workflow.

Post-merge follow-ups

• No action required
• Actions required (specified below)

[vevetron]

Can we update the pyproject.toml to use dbt-metabase=1.5.0. My install was using 0.10.3 and throwing errors.

Also, how do we authenticate?
I'm getting an error:

INFO     2025-03-28 18:35:48 -0700 — Metabase session established                                                           metabase.py:61
ERROR    2025-03-28 18:35:49 -0700 — HTTP request failed: Unauthenticated                                                   metabase.py:88
Traceback (most recent call last):
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/bin/dbt-metabase", line 8, in <module>
    sys.exit(cli())
             ^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/__main__.py", line 189, in wrapper
    return func(
           ^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/__main__.py", line 398, in exposures
    core.extract_exposures(
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/_exposures.py", line 94, in extract_exposures
    d["id"]: dbname(d["details"]) for d in self.metabase.get_databases()
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/metabase.py", line 100, in get_databases
    return list(self._api("get", "/api/database"))
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/metabase.py", line 86, in _api
    response.raise_for_status()
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://dashboards.calitp.org/api/database

[erikamov]

@vevetron You need a metabase API key. Evan has access to it.

[erikamov]

We found out this week that Exposures have been use to configure models that are published to Open Data Portal. So we should not add Metabase exposures to our code base to avoid conflicts.