The ModelError(Unauthorized) issue sometimes appear while the self-signed-certificates was reading the relation data. Around 10 tries, I hit it 2 times.
2026-02-10T21:05:06.495Z [container-agent] 2026-02-10 21:05:06 WARNING juju-log charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:05:06.745Z [container-agent] 2026-02-10 21:05:06 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via hook dispatching script: dispatch)
2026-02-10T21:10:21.868Z [container-agent] 2026-02-10 21:10:21 WARNING juju-log <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:10:22.217Z [container-agent] 2026-02-10 21:10:22 ERROR juju-log At least 1 matching relation ID not found with the relation name 'send-ca-cert'
2026-02-10T21:10:22.598Z [container-agent] 2026-02-10 21:10:22 WARNING juju-log charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:10:22.884Z [container-agent] 2026-02-10 21:10:22 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via hook dispatching script: dispatch)
2026-02-10T21:10:35.466Z [container-agent] 2026-02-10 21:10:35 WARNING juju-log certificates:121: <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:10:35.540Z [container-agent] 2026-02-10 21:10:35 WARNING juju-log certificates:121: charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:10:35.795Z [container-agent] 2026-02-10 21:10:35 INFO juju.worker.uniter.operation runhook.go:186 ran "certificates-relation-departed" hook (via hook dispatching script: dispatch)
2026-02-10T21:12:34.521Z [container-agent] 2026-02-10 21:12:34 WARNING juju-log certificates:125: <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:12:34.617Z [container-agent] 2026-02-10 21:12:34 WARNING juju-log certificates:125: charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:12:34.859Z [container-agent] 2026-02-10 21:12:34 INFO juju.worker.uniter.operation runhook.go:186 ran "certificates-relation-created" hook (via hook dispatching script: dispatch)
2026-02-10T21:14:08.193Z [container-agent] 2026-02-10 21:14:08 WARNING juju-log certificates:125: <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:14:08.216Z [container-agent] 2026-02-10 21:14:08 WARNING juju-log certificates:125: charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:14:08.267Z [container-agent] 2026-02-10 21:14:08 ERROR juju-log certificates:125: Uncaught exception while in charm code:
2026-02-10T21:14:08.267Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3407, in _run
2026-02-10T21:14:08.267Z [container-agent] result = subprocess.run(args, **kwargs) # type: ignore
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/usr/lib/python3.12/subprocess.py", line 571, in run
2026-02-10T21:14:08.267Z [container-agent] raise CalledProcessError(retcode, process.args,
2026-02-10T21:14:08.267Z [container-agent] subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-self-signed-certificates-0/relation-get', '-r', '121', '-', 'self-signed-certificates', '--app', '--format=json')' returned non-zero exit status 1.
2026-02-10T21:14:08.267Z [container-agent]
2026-02-10T21:14:08.267Z [container-agent] The above exception was the direct cause of the following exception:
2026-02-10T21:14:08.267Z [container-agent]
2026-02-10T21:14:08.267Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/./src/charm.py", line 543, in <module>
2026-02-10T21:14:08.267Z [container-agent] main(SelfSignedCertificatesCharm)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/__init__.py", line 347, in __call__
2026-02-10T21:14:08.267Z [container-agent] return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 565, in main
2026-02-10T21:14:08.267Z [container-agent] manager.run()
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 550, in run
2026-02-10T21:14:08.267Z [container-agent] self._emit()
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 502, in _emit
2026-02-10T21:14:08.267Z [container-agent] self._emit_charm_event(self.dispatcher.event_name)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 537, in _emit_charm_event
2026-02-10T21:14:08.267Z [container-agent] event_to_emit.emit(*args, **kwargs)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 348, in emit
2026-02-10T21:14:08.267Z [container-agent] framework._emit(event)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 907, in _emit
2026-02-10T21:14:08.267Z [container-agent] self._reemit(event_path)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 997, in _reemit
2026-02-10T21:14:08.267Z [container-agent] custom_handler(event)
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:08.267Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1720, in _configure
2026-02-10T21:14:08.267Z [container-agent] self._remove_certificates_for_which_no_csr_exists()
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:08.267Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1723, in _remove_certificates_for_which_no_csr_exists
2026-02-10T21:14:08.267Z [container-agent] provider_certificates = self.get_provider_certificates()
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:08.267Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1909, in get_provider_certificates
2026-02-10T21:14:08.267Z [container-agent] for certificate in self._load_provider_certificates(relation):
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:08.267Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1809, in _load_provider_certificates
2026-02-10T21:14:08.267Z [container-agent] provider_relation_data = _ProviderApplicationData.load(relation.data[self.charm.app])
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 160, in load
2026-02-10T21:14:08.267Z [container-agent] data = {
2026-02-10T21:14:08.267Z [container-agent] ^
2026-02-10T21:14:08.267Z [container-agent] File "<frozen _collections_abc>", line 893, in __iter__
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 889, in __iter__
2026-02-10T21:14:08.267Z [container-agent] return iter(self._data)
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 876, in _data
2026-02-10T21:14:08.267Z [container-agent] data = self._lazy_data = self._load()
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 1846, in _load
2026-02-10T21:14:08.267Z [container-agent] return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3486, in relation_get
2026-02-10T21:14:08.267Z [container-agent] raw_data_content = self._run(*args, return_output=True, use_json=True)
2026-02-10T21:14:08.267Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:08.267Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3409, in _run
2026-02-10T21:14:08.267Z [container-agent] raise ModelError(e.stderr) from e
2026-02-10T21:14:08.267Z [container-agent] ops.model.ModelError: ERROR permission denied (unauthorized access)
2026-02-10T21:14:08.267Z [container-agent]
2026-02-10T21:14:08.502Z [container-agent] 2026-02-10 21:14:08 ERROR juju.worker.uniter.operation runhook.go:180 hook "certificates-relation-joined" (via hook dispatching script: dispatch) failed: exit status 1
2026-02-10T21:14:08.502Z [container-agent] 2026-02-10 21:14:08 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:13.522Z [container-agent] 2026-02-10 21:14:13 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:13.757Z [container-agent] 2026-02-10 21:14:13 WARNING juju-log certificates:125: <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:14:13.782Z [container-agent] 2026-02-10 21:14:13 WARNING juju-log certificates:125: charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:14:13.824Z [container-agent] 2026-02-10 21:14:13 ERROR juju-log certificates:125: Uncaught exception while in charm code:
2026-02-10T21:14:13.824Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3407, in _run
2026-02-10T21:14:13.824Z [container-agent] result = subprocess.run(args, **kwargs) # type: ignore
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/usr/lib/python3.12/subprocess.py", line 571, in run
2026-02-10T21:14:13.824Z [container-agent] raise CalledProcessError(retcode, process.args,
2026-02-10T21:14:13.824Z [container-agent] subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-self-signed-certificates-0/relation-get', '-r', '121', '-', 'self-signed-certificates', '--app', '--format=json')' returned non-zero exit status 1.
2026-02-10T21:14:13.824Z [container-agent]
2026-02-10T21:14:13.824Z [container-agent] The above exception was the direct cause of the following exception:
2026-02-10T21:14:13.824Z [container-agent]
2026-02-10T21:14:13.824Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/./src/charm.py", line 543, in <module>
2026-02-10T21:14:13.824Z [container-agent] main(SelfSignedCertificatesCharm)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/__init__.py", line 347, in __call__
2026-02-10T21:14:13.824Z [container-agent] return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 565, in main
2026-02-10T21:14:13.824Z [container-agent] manager.run()
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 550, in run
2026-02-10T21:14:13.824Z [container-agent] self._emit()
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 502, in _emit
2026-02-10T21:14:13.824Z [container-agent] self._emit_charm_event(self.dispatcher.event_name)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 537, in _emit_charm_event
2026-02-10T21:14:13.824Z [container-agent] event_to_emit.emit(*args, **kwargs)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 348, in emit
2026-02-10T21:14:13.824Z [container-agent] framework._emit(event)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 907, in _emit
2026-02-10T21:14:13.824Z [container-agent] self._reemit(event_path)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 997, in _reemit
2026-02-10T21:14:13.824Z [container-agent] custom_handler(event)
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:13.824Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1720, in _configure
2026-02-10T21:14:13.824Z [container-agent] self._remove_certificates_for_which_no_csr_exists()
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:13.824Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1723, in _remove_certificates_for_which_no_csr_exists
2026-02-10T21:14:13.824Z [container-agent] provider_certificates = self.get_provider_certificates()
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:13.824Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1909, in get_provider_certificates
2026-02-10T21:14:13.824Z [container-agent] for certificate in self._load_provider_certificates(relation):
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:13.824Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1809, in _load_provider_certificates
2026-02-10T21:14:13.824Z [container-agent] provider_relation_data = _ProviderApplicationData.load(relation.data[self.charm.app])
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 160, in load
2026-02-10T21:14:13.824Z [container-agent] data = {
2026-02-10T21:14:13.824Z [container-agent] ^
2026-02-10T21:14:13.824Z [container-agent] File "<frozen _collections_abc>", line 893, in __iter__
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 889, in __iter__
2026-02-10T21:14:13.824Z [container-agent] return iter(self._data)
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 876, in _data
2026-02-10T21:14:13.824Z [container-agent] data = self._lazy_data = self._load()
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 1846, in _load
2026-02-10T21:14:13.824Z [container-agent] return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3486, in relation_get
2026-02-10T21:14:13.824Z [container-agent] raw_data_content = self._run(*args, return_output=True, use_json=True)
2026-02-10T21:14:13.824Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:13.824Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3409, in _run
2026-02-10T21:14:13.824Z [container-agent] raise ModelError(e.stderr) from e
2026-02-10T21:14:13.824Z [container-agent] ops.model.ModelError: ERROR permission denied (unauthorized access)
2026-02-10T21:14:13.824Z [container-agent]
2026-02-10T21:14:14.057Z [container-agent] 2026-02-10 21:14:14 ERROR juju.worker.uniter.operation runhook.go:180 hook "certificates-relation-joined" (via hook dispatching script: dispatch) failed: exit status 1
2026-02-10T21:14:14.058Z [container-agent] 2026-02-10 21:14:14 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:18.919Z [container-agent] 2026-02-10 21:14:18 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:19.755Z [container-agent] 2026-02-10 21:14:19 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:22.133Z [container-agent] 2026-02-10 21:14:22 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:23.827Z [container-agent] 2026-02-10 21:14:23 INFO juju.worker.uniter resolver.go:180 awaiting error resolution for "relation-joined" hook
2026-02-10T21:14:24.107Z [container-agent] 2026-02-10 21:14:24 WARNING juju-log certificates:125: <class '__main__.SelfSignedCertificatesCharm'>._tracing_server_cert is None; sending traces over INSECURE connection.
2026-02-10T21:14:24.130Z [container-agent] 2026-02-10 21:14:24 WARNING juju-log certificates:125: charm tracing buffer exceeds max history length (100 events)
2026-02-10T21:14:24.171Z [container-agent] 2026-02-10 21:14:24 ERROR juju-log certificates:125: Uncaught exception while in charm code:
2026-02-10T21:14:24.171Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3407, in _run
2026-02-10T21:14:24.171Z [container-agent] result = subprocess.run(args, **kwargs) # type: ignore
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/usr/lib/python3.12/subprocess.py", line 571, in run
2026-02-10T21:14:24.171Z [container-agent] raise CalledProcessError(retcode, process.args,
2026-02-10T21:14:24.171Z [container-agent] subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-self-signed-certificates-0/relation-get', '-r', '121', '-', 'self-signed-certificates', '--app', '--format=json')' returned non-zero exit status 1.
2026-02-10T21:14:24.171Z [container-agent]
2026-02-10T21:14:24.171Z [container-agent] The above exception was the direct cause of the following exception:
2026-02-10T21:14:24.171Z [container-agent]
2026-02-10T21:14:24.171Z [container-agent] Traceback (most recent call last):
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/./src/charm.py", line 543, in <module>
2026-02-10T21:14:24.171Z [container-agent] main(SelfSignedCertificatesCharm)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/__init__.py", line 347, in __call__
2026-02-10T21:14:24.171Z [container-agent] return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 565, in main
2026-02-10T21:14:24.171Z [container-agent] manager.run()
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 550, in run
2026-02-10T21:14:24.171Z [container-agent] self._emit()
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 502, in _emit
2026-02-10T21:14:24.171Z [container-agent] self._emit_charm_event(self.dispatcher.event_name)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/_main.py", line 537, in _emit_charm_event
2026-02-10T21:14:24.171Z [container-agent] event_to_emit.emit(*args, **kwargs)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 348, in emit
2026-02-10T21:14:24.171Z [container-agent] framework._emit(event)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 907, in _emit
2026-02-10T21:14:24.171Z [container-agent] self._reemit(event_path)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/framework.py", line 997, in _reemit
2026-02-10T21:14:24.171Z [container-agent] custom_handler(event)
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:24.171Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1720, in _configure
2026-02-10T21:14:24.171Z [container-agent] self._remove_certificates_for_which_no_csr_exists()
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:24.171Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1723, in _remove_certificates_for_which_no_csr_exists
2026-02-10T21:14:24.171Z [container-agent] provider_certificates = self.get_provider_certificates()
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:24.171Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1909, in get_provider_certificates
2026-02-10T21:14:24.171Z [container-agent] for certificate in self._load_provider_certificates(relation):
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1116, in wrapped_function
2026-02-10T21:14:24.171Z [container-agent] return callable(*args, **kwargs) # type: ignore
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 1809, in _load_provider_certificates
2026-02-10T21:14:24.171Z [container-agent] provider_relation_data = _ProviderApplicationData.load(relation.data[self.charm.app])
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/lib/charms/tls_certificates_interface/v4/tls_certificates.py", line 160, in load
2026-02-10T21:14:24.171Z [container-agent] data = {
2026-02-10T21:14:24.171Z [container-agent] ^
2026-02-10T21:14:24.171Z [container-agent] File "<frozen _collections_abc>", line 893, in __iter__
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 889, in __iter__
2026-02-10T21:14:24.171Z [container-agent] return iter(self._data)
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 876, in _data
2026-02-10T21:14:24.171Z [container-agent] data = self._lazy_data = self._load()
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 1846, in _load
2026-02-10T21:14:24.171Z [container-agent] return self._backend.relation_get(self.relation.id, self._entity.name, self._is_app)
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3486, in relation_get
2026-02-10T21:14:24.171Z [container-agent] raw_data_content = self._run(*args, return_output=True, use_json=True)
2026-02-10T21:14:24.171Z [container-agent] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-10T21:14:24.171Z [container-agent] File "/var/lib/juju/agents/unit-self-signed-certificates-0/charm/venv/ops/model.py", line 3409, in _run
2026-02-10T21:14:24.171Z [container-agent] raise ModelError(e.stderr) from e
2026-02-10T21:14:24.171Z [container-agent] ops.model.ModelError: ERROR permission denied (unauthorized access)
2026-02-10T21:14:24.171Z [container-agent]
2026-02-10T21:14:24.408Z [container-agent] 2026-02-10 21:14:24 ERROR juju.worker.uniter.operation runhook.go:180 hook "certificates-relation-joined" (via hook dispatching script: dispatch) failed: exit status 1
Bug Description
Hello,
The ModelError(Unauthorized) issue sometimes appear while the self-signed-certificates was reading the relation data. Around 10 tries, I hit it 2 times.
To Reproduce
How to reproduce ?
Environment
Juju 3.6.14-genericlinux-amd64
Microk8s v1.33.7 revision 8596
self-signed-certificates 1/stable
Relevant log output
Additional context
No response