You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description:
I encountered an issue while trying to configure DataHub's ingestion to connect to a Hive Metastore (via PostgreSQL) using the Web UI.
Issue Details:
Deployment Environment: Kubernetes
Error Message: "Failed to find a registered source for type hive-metastore" in the ingestion UI.
Verification Attempts:
I checked the installed plugins by running datahub check plugins --verbose inside the DataHub pod.
It only lists hive and presto-on-hive but no plugin for hive-metastore.
Steps to Reproduce:
Configured Hive Metastore ingestion through the Web UI -> Other
Connected via PostgreSQL in the ingestion section. I follow the doc:
`source:
type: hive-metastore
config:
host_port: localhost:5432
database: metastore
schema_pattern:
allow:
- "^public"
username: user
password: pass # optional
scheme: 'postgresql+psycopg2' # set this if metastore db is using postgres`
Ran the ingestion and got the error message: "Failed to find a registered source for type hive-metastore."
Verified the plugins in the DataHub pod, but hive-metastore was missing.
Expected Behavior:
As per the DataHub documentation, there should be support for hive-metastore. I expected the ingestion source to be recognized and executed successfully.
Current Behavior:
The UI and CLI fail to recognize hive-metastore as a valid source for ingestion.
Additional Information:
DataHub Version: v0.14.0.2
Is the hive-metastore plugin available or supported? If so, could it be a misconfiguration on my end, or is there a discrepancy between the documentation and the actual available sources?
The text was updated successfully, but these errors were encountered:
vegaskyo
changed the title
Ingestion Failure: "Failed to find a registered source for type hive-metastore" in Hive-Metastore Ingestion
Ingestion Failure: "Failed to find a registered source for type hive-metastore" in Ingestion
Sep 17, 2024
Description:
I encountered an issue while trying to configure DataHub's ingestion to connect to a Hive Metastore (via PostgreSQL) using the Web UI.
Issue Details:
datahub check plugins --verbose
inside the DataHub pod.hive
andpresto-on-hive
but no plugin forhive-metastore
.Steps to Reproduce:
Configured Hive Metastore ingestion through the Web UI -> Other
Connected via PostgreSQL in the ingestion section. I follow the doc:
`source:
type: hive-metastore
config:
host_port: localhost:5432
database: metastore
schema_pattern:
allow:
- "^public"
username: user
password: pass # optional
scheme: 'postgresql+psycopg2' # set this if metastore db is using postgres`
Ran the ingestion and got the error message: "Failed to find a registered source for type hive-metastore."
Verified the plugins in the DataHub pod, but
hive-metastore
was missing.Expected Behavior:
As per the DataHub documentation, there should be support for
hive-metastore
. I expected the ingestion source to be recognized and executed successfully.Current Behavior:
The UI and CLI fail to recognize
hive-metastore
as a valid source for ingestion.Additional Information:
Is the
hive-metastore
plugin available or supported? If so, could it be a misconfiguration on my end, or is there a discrepancy between the documentation and the actual available sources?The text was updated successfully, but these errors were encountered: