Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CredentialLoadErrors on Prod #898

Open
josephjclark opened this issue Mar 10, 2025 · 2 comments
Open

CredentialLoadErrors on Prod #898

josephjclark opened this issue Mar 10, 2025 · 2 comments
Assignees

Comments

@josephjclark
Copy link
Collaborator

josephjclark commented Mar 10, 2025

We're seeing some CredentialLoadErrors coming up on production

Image
GPC link but there's nothing else here

It looks like the credential is available one moment, and then not. And then later is OK again. So I don't think it's a genuinely missing credential.

The error serialisation code is suspect:

logger?.debug(`Error loading credential ${config}`);
errors.push({
  id: config,
  step: step.id!,
  error: e?.message || e?.toString() || e,
 });

And what we get in the run log isn't terribly helpful:

Run complete with status: exception
CredentialLoadError: Failed to load credential ef4e34ac-3fe3-459f-a42a-81f4199f9c18: [object Object]

There's a good chance that the error is lightning side, but at the very least we need better error reporting in the worker

@github-project-automation github-project-automation bot moved this to New Issues in v2 Mar 10, 2025
@josephjclark
Copy link
Collaborator Author

I have no idea how we'll repro this: I think I just need to get better logging in the worker as as priority

@josephjclark
Copy link
Collaborator Author

worker 1.12.1 has better logging, maybe that'll help us track this down

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: New Issues
Development

No branches or pull requests

1 participant